2024-03-04T08:27:43.939 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T08:27:43.939 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793 --name leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi --owner scheduled_leonidus@teuthology --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/orig.config.yaml 2024-03-04T08:27:43.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T08:27:44.069 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793 branch: wip-lusov-qdb description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} email: null first_in_suite: false job_id: '7580793' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5072 sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd sleep_before_teardown: 0 subset: 246/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLb7Z7EPVxMPYzF/6rWPNFS9DfiAeqlcl5Y1Q6EkJIe1yFjFj/+sf0mUP/7vvnFxPebkOnRqzY1AxeeEll4KJfE= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrqS1ehcIsnNv6RY6quTF0fMMAA5EcU54XZW/hflhW5HB5E4ECzFDA0eaVoDl9UJDaYVa58vro8uy76Yy5sQ74= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-03-04_07:05:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-04T08:27:44.069 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa; will attempt to use it 2024-03-04T08:27:44.070 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks 2024-03-04T08:27:44.070 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-04T08:27:44.072 INFO:teuthology.task.internal:Checking packages... 2024-03-04T08:27:44.094 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd' 2024-03-04T08:27:44.094 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T08:27:44.094 INFO:teuthology.packaging:ref: None 2024-03-04T08:27:44.095 INFO:teuthology.packaging:tag: None 2024-03-04T08:27:44.095 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-03-04T08:27:44.095 INFO:teuthology.packaging:sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:27:44.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb 2024-03-04T08:27:44.435 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1739.g1bc250c7 2024-03-04T08:27:44.438 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-04T08:27:44.445 INFO:teuthology.task.internal:no buildpackages task found 2024-03-04T08:27:44.445 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-04T08:27:44.469 INFO:teuthology.task.internal:Saving configuration 2024-03-04T08:27:44.501 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-04T08:27:44.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T08:27:44.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:22:41.871266', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLb7Z7EPVxMPYzF/6rWPNFS9DfiAeqlcl5Y1Q6EkJIe1yFjFj/+sf0mUP/7vvnFxPebkOnRqzY1AxeeEll4KJfE='} 2024-03-04T08:27:44.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:22:41.873201', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrqS1ehcIsnNv6RY6quTF0fMMAA5EcU54XZW/hflhW5HB5E4ECzFDA0eaVoDl9UJDaYVa58vro8uy76Yy5sQ74='} 2024-03-04T08:27:44.558 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-04T08:27:44.563 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-04T08:27:44.563 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-04T08:27:44.563 INFO:teuthology.run_tasks:Running task console_log... 2024-03-04T08:27:44.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2aa1c24f70>, signals=[15]) 2024-03-04T08:27:44.629 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-04T08:27:44.635 INFO:teuthology.task.internal:Opening connections... 2024-03-04T08:27:44.635 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T08:27:44.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:27:44.742 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T08:27:44.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:27:44.834 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-04T08:27:44.841 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-03-04T08:27:44.859 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-03-04T08:27:44.859 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:27:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:27:44.918 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:27:44.919 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-03-04T08:27:44.942 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-03-04T08:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-03-04T08:27:44.960 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:27:45.019 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-03-04T08:27:45.042 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-04T08:27:45.051 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-04T08:27:45.056 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-04T08:27:45.056 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:27:45.059 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:27:45.075 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-04T08:27:45.081 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-04T08:27:45.082 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:27:45.117 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:27:45.222 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-04T08:27:45.281 INFO:teuthology.run_tasks:Running task kernel... 2024-03-04T08:27:45.295 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-04T08:27:45.295 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-04T08:27:45.295 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-04T08:27:45.295 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:27:45.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:27:45.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-04T08:27:45.558 DEBUG:teuthology.task.kernel:sha1 for client.0 is 786939134d7eee4dc7a805245d3f595929af37d7 2024-03-04T08:27:45.559 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "786939134d7eee4dc7a805245d3f595929af37d7"... 2024-03-04T08:27:45.559 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-03-04T08:27:45.577 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2024-03-04T08:27:45.577 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 786939134d7eee4dc7a805245d3f595929af37d7 2024-03-04T08:27:45.577 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-04T08:27:45.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum upgrade -y linux-firmware 2024-03-04T08:27:47.881 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-04T08:27:49.481 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 4.5 MB/s | 2.0 MB 00:00 2024-03-04T08:27:53.338 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.0 MB 00:03 2024-03-04T08:27:55.389 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-04T08:28:07.190 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 775 kB/s | 6.1 MB 00:08 2024-03-04T08:28:08.590 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 15 kB 00:00 2024-03-04T08:28:10.961 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 20 MB 00:02 2024-03-04T08:28:16.058 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-04T08:28:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-03-04T08:28:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-04T08:28:18.552 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-03-04T08:28:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-04T08:28:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-03-04T08:28:18.552 INFO:teuthology.orchestra.run.smithi046.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-04T08:28:18.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:28:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-03-04T08:28:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-04T08:28:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 1 Package 2024-03-04T08:28:18.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:28:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 375 M 2024-03-04T08:28:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-03-04T08:28:33.258 INFO:teuthology.orchestra.run.smithi046.stdout:linux-firmware-20240219-143.el9.noarch.rpm 25 MB/s | 375 MB 00:14 2024-03-04T08:28:33.259 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:28:33.260 INFO:teuthology.orchestra.run.smithi046.stdout:Total 25 MB/s | 375 MB 00:14 2024-03-04T08:28:33.260 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-03-04T08:28:33.344 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-03-04T08:28:33.345 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-03-04T08:28:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-03-04T08:28:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-03-04T08:28:42.350 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-03-04T08:28:42.571 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-04T08:28:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-04T08:28:43.904 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-04T08:28:43.904 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-04T08:28:44.287 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-04T08:28:44.287 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:28:44.287 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-03-04T08:28:44.287 INFO:teuthology.orchestra.run.smithi046.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-04T08:28:44.287 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:28:44.287 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-03-04T08:28:44.578 INFO:teuthology.task.kernel:Downloading kernel 786939134d7eee4dc7a805245d3f595929af37d7 on client.0... 2024-03-04T08:28:44.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=786939134d7eee4dc7a805245d3f595929af37d7 2024-03-04T08:28:44.724 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/786939134d7eee4dc7a805245d3f595929af37d7/centos/9/flavors/default/x86_64/ 2024-03-04T08:28:44.724 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_g786939134d7e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/786939134d7eee4dc7a805245d3f595929af37d7/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-04T08:28:44.727 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi046.front.sepia.ceph.com to complete... 2024-03-04T08:28:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04 08:28:57 URL:https://3.chacra.ceph.com/r/kernel/testing/786939134d7eee4dc7a805245d3f595929af37d7/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_g786939134d7e-1.x86_64.rpm [336049686/336049686] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-04T08:28:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:FINISHED --2024-03-04 08:28:57-- 2024-03-04T08:28:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:Total wall clock time: 13s 2024-03-04T08:28:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:Downloaded: 1 files, 320M in 12s (26.2 MB/s) 2024-03-04T08:28:57.521 INFO:teuthology.task.kernel:Installing kernel 786939134d7eee4dc7a805245d3f595929af37d7 on client.0... 2024-03-04T08:28:57.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-04T08:28:59.554 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying... ######################################## 2024-03-04T08:28:59.612 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing... ######################################## 2024-03-04T08:28:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:Updating / installing... 2024-03-04T08:29:07.608 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-6.8.0_rc6_g786939134d7e-1 ######################################## 2024-03-04T08:29:23.516 INFO:teuthology.orchestra.run.smithi046.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T08:29:46.729 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-04T08:29:46.730 DEBUG:teuthology.orchestra.run.smithi046:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/System.map 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/config 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86 2024-03-04T08:29:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-04T08:29:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kernel 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kernel/cpu 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kernel/cpu/mce 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kvm 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-04T08:29:46.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/arch/x86/kvm/kvm.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/ansi_cprng.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/anubis.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/arc4.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx/async_pq.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx/async_tx.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx/async_xor.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/async_tx/raid6test.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/authenc.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/authencesn.ko 2024-03-04T08:29:46.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/blake2b_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/blowfish_common.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/blowfish_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/camellia_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/cast5_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/cast6_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/cast_common.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/ccm.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/cmac.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/crc32_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/crypto_engine.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/crypto_user.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/cts.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/des_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/dh_generic.ko 2024-03-04T08:29:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/echainiv.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/essiv.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/fcrypt.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/khazad.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/lz4.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/lz4hc.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/md4.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/michael_mic.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/pcbc.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/pcrypt.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/rmd160.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/seed.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/serpent_generic.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/tcrypt.ko 2024-03-04T08:29:46.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/tea.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/twofish_common.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/twofish_generic.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/vmac.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/wp512.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/xcbc.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/xor.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/crypto/xxhash_generic.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/acpi_pad.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/custom_method.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/ec_sys.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/platform_profile.ko 2024-03-04T08:29:46.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/sbs.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/sbshc.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/acpi/video.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/acard-ahci.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/ahci_platform.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/ata_generic.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/libahci_platform.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_acpi.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_ali.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_amd.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_artop.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_atiixp.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_atp867x.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_cmd640.ko 2024-03-04T08:29:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_cypress.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_efar.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_hpt366.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_it8213.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_it821x.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_jmicron.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_marvell.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_mpiix.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_netcell.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_ninja32.ko 2024-03-04T08:29:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_ns87410.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_ns87415.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_opti.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_optidma.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_piccolo.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_rdc.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_sch.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_serverworks.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_sil680.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_sis.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-04T08:29:46.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_triflex.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pata_via.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/pdc_adma.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_inic162x.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_mv.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_nv.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_promise.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_qstor.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_sil.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_sil24.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_sis.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_svw.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_sx4.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_uli.ko 2024-03-04T08:29:46.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_via.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ata/sata_vsc.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/auxdisplay 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/base 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/base/regmap 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/bcma 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/bcma/bcma.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/aoe 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/aoe/aoe.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/brd.ko 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/drbd 2024-03-04T08:29:46.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/drbd/drbd.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/floppy.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/loop.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/mtip32xx 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/nbd.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/null_blk 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/pktcdvd.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/rbd.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/virtio_blk.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/xen-blkback 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/xen-blkfront.ko 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/zram 2024-03-04T08:29:46.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/block/zram/zram.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hangcheck-timer.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hw_random 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-04T08:29:46.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/lp.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/mwave 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/mwave/mwave.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/ppdev.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tlclk.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm/tpm.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/uv_mmtimer.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/char/virtio_console.ko 2024-03-04T08:29:46.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/ccp 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/intel 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/intel/qat 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-04T08:29:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/padlock-aes.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/padlock-sha.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/virtio 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dca 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dca/dca.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/devfreq 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dma 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dma/dw 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-04T08:29:46.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dma/ioat 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/amd64_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/e752x_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i3000_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i3200_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i5100_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i5400_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i7300_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i7core_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/i82975x_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/ie31200_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/sb_edac.ko 2024-03-04T08:29:46.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/edac/x38_edac.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/firmware 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/firmware/edd.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/gpio 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/gpio/gpio-ich.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-appleir.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-aureal.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-axff.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-dr.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-elecom.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-elo.ko 2024-03-04T08:29:46.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-emsff.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-gaff.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-gt683r.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-gyration.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-holtekff.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-hyperv.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-icade.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-keytouch.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-kye.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-lcpower.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-led.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-lenovo.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-04T08:29:46.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-multitouch.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-ortek.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-penmount.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-petalynx.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-picolcd.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-pl.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-plantronics.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-primax.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-rmi.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-04T08:29:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-roccat.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-saitek.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-samsung.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-sjoy.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-sony.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-speedlink.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-steelseries.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-sunplus.ko 2024-03-04T08:29:46.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-tivo.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-tmff.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-topseed.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-twinhan.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-uclogic.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-waltop.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-wiimote.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-xinmo.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-zpff.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/hid-zydacron.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/uhid.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hid/wacom.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hv 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hv/hv_balloon.ko 2024-03-04T08:29:46.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hv/hv_utils.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hv/hv_vmbus.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/abituguru.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/abituguru3.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ad7414.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ad7418.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adc128d818.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adm1025.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adm1026.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adm1029.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adm1031.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adm9240.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ads7828.ko 2024-03-04T08:29:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adt7410.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adt7411.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adt7462.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adt7470.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adt7475.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/adt7x10.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/amc6821.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/applesmc.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/asb100.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/asc7621.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/atxp1.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/coretemp.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/dme1737.ko 2024-03-04T08:29:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ds1621.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ds620.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/emc1403.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/emc6w201.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/f71805f.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/f71882fg.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/f75375s.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/fschmd.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/g760a.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/g762.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/gl518sm.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/gl520sm.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-04T08:29:46.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ibmaem.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ibmpex.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ina209.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ina2xx.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/it87.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/k10temp.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/k8temp.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm63.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm73.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm75.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm77.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm78.ko 2024-03-04T08:29:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm80.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm83.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm85.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm87.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm90.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm92.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm93.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm95234.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm95241.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/lm95245.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc2945.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc4151.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc4215.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc4222.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc4245.ko 2024-03-04T08:29:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc4260.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/ltc4261.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max16065.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max1619.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max1668.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max197.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max6639.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max6650.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/max6697.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/mcp3021.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/nct6683.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/nct6775.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/nct7802.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pc87360.ko 2024-03-04T08:29:46.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pc87427.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pcf8591.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-04T08:29:46.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/powr1220.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/sch5627.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/sch5636.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/sht15.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/sht21.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/shtc1.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/sis5595.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/thmc50.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/tmp102.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/tmp103.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/tmp401.ko 2024-03-04T08:29:46.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/tmp421.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/via686a.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/vt1211.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/vt8231.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83627hf.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83781d.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83791d.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83792d.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83793.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83795.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c 2024-03-04T08:29:46.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/algos 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-04T08:29:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/i2c-dev.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/i2c-mux.ko 2024-03-04T08:29:46.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/i2c/i2c-stub.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/cxgb4 2024-03-04T08:29:46.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/mlx4 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/mlx5 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/mthca 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/ipoib 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/iser 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/isert 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/srp 2024-03-04T08:29:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/srpt 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/gameport 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/gameport/gameport.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/joydev.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/keyboard 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-04T08:29:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/appletouch.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/sermouse.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/rmi4 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/serio 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-04T08:29:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/serio/serio_raw.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/input/sparse-keymap.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/leds-blinkm.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/leds-lm3530.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/leds-lp3944.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/leds-ss4200.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-04T08:29:46.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/bcache 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/bcache/bcache.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-bio-prison.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-cache-smq.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-cache.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-crypt.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-delay.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-flakey.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-log-userspace.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-multipath.ko 2024-03-04T08:29:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-queue-length.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-raid.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-round-robin.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-service-time.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-switch.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-thin-pool.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/dm-verity.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/persistent-data 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/raid0.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/raid1.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/raid10.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/md/raid456.ko 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message 2024-03-04T08:29:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptbase.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptctl.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptfc.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptlan.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptsas.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/message/fusion/mptspi.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/lpc_ich.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/lpc_sch.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/mfd-core.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/sm501.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/viperboard.ko 2024-03-04T08:29:46.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/vx855.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/mfd/wl1273-core.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/altera-stapl 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/apds9802als.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/apds990x.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/bh1770glc.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/cb710 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/cb710/cb710.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/eeprom 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/eeprom/at24.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/enclosure.ko 2024-03-04T08:29:46.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/hpilo.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/isl29003.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/isl29020.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/lis3lv02d 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/mei 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/mei/mei-me.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/mei/mei.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/sgi-gru 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-04T08:29:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/sgi-xp 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/tifm_core.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/tsl2550.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/vmw_balloon.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/vmw_vmci 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/bonding 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/bonding/bonding.ko 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa/b53 2024-03-04T08:29:46.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/dummy.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/eql.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/3com 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/8390 2024-03-04T08:29:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/adaptec 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/agere 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/alteon 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/altera 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/amd 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-04T08:29:46.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/alx 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-04T08:29:46.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/brocade 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/brocade/bna 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-04T08:29:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/cisco 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/cisco/enic 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-04T08:29:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dlink 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/dnet.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/emulex 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/emulex/benet 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/e1000 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-04T08:29:46.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/i40e 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/iavf 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/igb 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-04T08:29:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/jme.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/marvell 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/micrel 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-04T08:29:46.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/myricom 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/natsemi 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/neterion 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/nvidia 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/packetengines 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/qlogic 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-04T08:29:46.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/rdc 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/realtek 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/rocker 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sfc 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-04T08:29:46.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/silan 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sis 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/smsc 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/stmicro 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sun 2024-03-04T08:29:46.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/tehuti 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/ti 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/via 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-04T08:29:46.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/wiznet 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/xircom 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/geneve.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/hyperv 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ieee802154 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ifb.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ipvlan 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/macvlan.ko 2024-03-04T08:29:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/macvtap.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/mdio 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/mdio.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/mii.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/net_failover.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/netconsole.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/nlmon.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/pcs 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/amd.ko 2024-03-04T08:29:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/broadcom.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/cicada.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/davicom.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/dp83640.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/et1011c.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/icplus.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/lxt.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/marvell.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/micrel.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/national.ko 2024-03-04T08:29:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/phylink.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/qsemi.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/realtek.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/smsc.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/phy/vitesse.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/pppoe.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/pppox.ko 2024-03-04T08:29:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/ppp/pptp.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/slip 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/slip/slhc.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/slip/slip.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/sungem_phy.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/tap.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team/team.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team/team_mode_random.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/tun.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/veth.ko 2024-03-04T08:29:46.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/virtio_net.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/vmxnet3 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/vxlan 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/xen-netback 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/net/xen-netfront.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ntb 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ntb/ntb.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/nvme 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/nvme/host 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/nvme/host/nvme.ko 2024-03-04T08:29:46.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/parport 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/parport/parport.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/parport/parport_cs.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/parport/parport_pc.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/parport/parport_serial.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pci 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pci/hotplug 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pci/pcie 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pci/xen-pcifront.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pcmcia 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pcmcia/i82092.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pcmcia/pd6729.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-04T08:29:46.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pinctrl 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pinctrl/intel 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-04T08:29:46.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/hdaps.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/intel 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/platform/x86/wmi.ko 2024-03-04T08:29:46.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/powercap 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pps 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pps/clients 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/pps/pps_core.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ptp 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ptp/ptp.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-04T08:29:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-04T08:29:46.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-04T08:29:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/3w-sas.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/BusLogic.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/a100u2w.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/aacraid 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/advansys.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/aic7xxx 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/am53c974.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/arcmsr 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/atp870u.ko 2024-03-04T08:29:46.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/be2iscsi 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/bfa 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/bnx2fc 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/bnx2i 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/ch.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/csiostor 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/cxgbi 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-04T08:29:46.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/dc395x.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/device_handler 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/dmx3191d.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/esas2r 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/esp_scsi.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/fcoe 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-04T08:29:46.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/fnic 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/hpsa.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/hptiop.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/initio.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/ipr.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/ips.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/isci 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/isci/isci.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/libfc 2024-03-04T08:29:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/libiscsi.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/libsas 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/lpfc 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/megaraid 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/megaraid.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/mpt3sas 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/mvsas 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-04T08:29:46.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/mvumi.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/pm8001 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/pmcraid.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/qla1280.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/qla2xxx 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/qla4xxx 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/raid_class.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/scsi_debug.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-04T08:29:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/ses.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/st.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/stex.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/sym53c8xx_2 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/scsi/wd719x.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ssb 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ssb/ssb.ko 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/iscsi 2024-03-04T08:29:46.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/loopback 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/target_core_file.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/target_core_iblock.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/target_core_mod.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/target_core_pscsi.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/target_core_user.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/tcm_fc 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-04T08:29:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-04T08:29:46.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/ipwireless 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/n_gsm.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/n_hdlc.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/nozomi.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/serial 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/serial/8250 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/serial/jsm 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ufs 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ufs/core 2024-03-04T08:29:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ufs/host 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/uio 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/uio/uio.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/uio/uio_aec.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/uio/uio_cif.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/uio/uio_sercos3.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/class 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/class/usblp.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/class/usbtmc.ko 2024-03-04T08:29:46.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/host 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/image 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/image/mdc800.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/image/microtek.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/adutux.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/emi26.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/emi62.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/ezusb.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/idmouse.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/ldusb.ko 2024-03-04T08:29:46.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/sisusbvga 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/usb3503.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/usblcd.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/uss720.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/misc/yurex.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/phy 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/aircable.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ark3116.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-04T08:29:46.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ch341.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/cp210x.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/empeg.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/io_ti.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ipaq.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ipw.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-04T08:29:46.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/keyspan.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/mos7720.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/mos7840.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/navman.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/omninet.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/opticon.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/option.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/oti6858.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/pl2303.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/qcaux.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/qcserial.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/quatech2.ko 2024-03-04T08:29:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/sierra.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ssu100.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/visor.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/uas.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-04T08:29:46.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/usbip 2024-03-04T08:29:46.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vfio 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vfio/pci 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vfio/vfio.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vhost 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vhost/vhost.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vhost/vhost_net.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/video 2024-03-04T08:29:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/video/backlight 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/video/backlight/lcd.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio_pci.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/virtio/virtio_ring.ko 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/masters 2024-03-04T08:29:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/masters/ds2482.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/masters/ds2490.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/w1/wire.ko 2024-03-04T08:29:46.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/hpwdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/i6300esb.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/ibmasr.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/machzwd.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/nv_tco.ko 2024-03-04T08:29:46.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/softdog.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/via_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-evtchn.ko 2024-03-04T08:29:46.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-gntdev.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-pciback 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xen-privcmd.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xenfs 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/9p 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/9p/9p.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/affs 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/affs/affs.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/befs 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/befs/befs.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/binfmt_misc.ko 2024-03-04T08:29:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/btrfs 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/btrfs/btrfs.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/cachefiles 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/cachefiles/cachefiles.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ceph 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ceph/ceph.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/coda 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/coda/coda.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/cramfs 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/cramfs/cramfs.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/dlm 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/dlm/dlm.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ecryptfs 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/f2fs 2024-03-04T08:29:46.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/f2fs/f2fs.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fat 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fat/fat.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fat/msdos.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fat/vfat.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fuse 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fuse/cuse.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/fuse/fuse.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/gfs2 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/gfs2/gfs2.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/hfs 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/hfs/hfs.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/hfsplus 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/hfsplus/hfsplus.ko 2024-03-04T08:29:46.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/isofs 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/isofs/isofs.ko 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/jfs 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/jfs/jfs.ko 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/lockd 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/lockd/lockd.ko 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/minix 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/minix/minix.ko 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/netfs 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/netfs/netfs.ko 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/blocklayout 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/filelayout 2024-03-04T08:29:46.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/flexfilelayout 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/nfs.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/nfsv3.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs/nfsv4.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs_common 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs_common/grace.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfsd 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nfsd/nfsd.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nilfs2 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nilfs2/nilfs2.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-celtic.ko 2024-03-04T08:29:46.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-centeuro.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-croatian.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-cyrillic.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-gaelic.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-greek.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-iceland.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-inuit.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-roman.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-romanian.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/mac-turkish.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp1250.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp1251.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp1255.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp737.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp775.ko 2024-03-04T08:29:46.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp850.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp852.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp855.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp857.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp860.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp861.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp862.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp863.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp864.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp865.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp866.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp869.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp874.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp932.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp936.ko 2024-03-04T08:29:46.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp949.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_cp950.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_euc-jp.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_koi8-r.ko 2024-03-04T08:29:46.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_koi8-u.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/nls/nls_utf8.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/cluster 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/dlm 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/dlmfs 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/ocfs2.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-04T08:29:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/overlayfs 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/overlayfs/overlay.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/pstore 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/pstore/ramoops.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/reiserfs 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/reiserfs/reiserfs.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/romfs 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/romfs/romfs.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/smb 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/smb/client 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/smb/client/cifs.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/smb/common 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/smb/common/cifs_md4.ko 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/squashfs 2024-03-04T08:29:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/squashfs/squashfs.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/sysv 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/sysv/sysv.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/udf 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/udf/udf.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ufs 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/ufs/ufs.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/xfs 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/fs/xfs/xfs.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/kernel 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/kernel/rcu 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/kernel/rcu/rcutorture.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/kernel/torture.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/kernel/trace 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-04T08:29:46.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/asn1_encoder.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/crc-itu-t.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/crc8.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/crypto 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/crypto/libarc4.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/crypto/libdes.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/libcrc32c.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/lru_cache.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/lz4 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/lz4/lz4_compress.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/math 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/math/cordic.ko 2024-03-04T08:29:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/raid6 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/raid6/raid6_pq.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/reed_solomon 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/ts_bm.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/ts_fsm.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/ts_kmp.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/zstd 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/lib/zstd/zstd_compress.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/mm 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/mm/hwpoison-inject.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/6lowpan.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_dest.ko 2024-03-04T08:29:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_hop.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_routing.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/6lowpan/nhc_udp.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/802 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/802/garp.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/802/mrp.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/802/p8022.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/802/psnap.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/802/stp.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/8021q 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/8021q/8021q.ko 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/9p 2024-03-04T08:29:46.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/9p/9pnet.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/9p/9pnet_fd.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/9p/9pnet_rdma.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/9p/9pnet_virtio.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/batman-adv 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/batman-adv/batman-adv.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/br_netfilter.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/bridge.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-04T08:29:46.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-04T08:29:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ceph 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ceph/libceph.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/core 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/core/failover.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/core/pktgen.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dccp 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dccp/dccp.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dccp/dccp_diag.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dccp/dccp_ipv4.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dccp/dccp_ipv6.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dns_resolver 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-04T08:29:46.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dsa 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dsa/dsa_core.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dsa/tag_brcm.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dsa/tag_dsa.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dsa/tag_none.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/dsa/tag_trailer.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ieee802154 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ieee802154/6lowpan 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ieee802154/ieee802154.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/ah4.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/esp4.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/fou.ko 2024-03-04T08:29:46.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/gre.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/inet_diag.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/ip_gre.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/ip_tunnel.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/ip_vti.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/ipcomp.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/ipip.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-04T08:29:46.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_bic.ko 2024-03-04T08:29:46.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_diag.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_htcp.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_hybla.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_illinois.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_lp.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_scalable.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_vegas.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_veno.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_westwood.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tcp_yeah.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/tunnel4.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/udp_diag.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/udp_tunnel.ko 2024-03-04T08:29:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/ah6.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/esp6.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/fou6.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/ip6_vti.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/ipcomp6.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-04T08:29:46.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-04T08:29:46.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/sit.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/tunnel6.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/key 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/key/af_key.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_core.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_eth.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_ip.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-04T08:29:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/llc 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/llc/llc.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/mac802154 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/mac802154/mac802154.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/mpls 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/mpls/mpls_gso.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-04T08:29:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-04T08:29:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conncount.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-04T08:29:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_flow_table.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_nat.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-04T08:29:46.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nf_tables.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nfnetlink.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_compat.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_ct.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-04T08:29:46.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_fib.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_hash.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_limit.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_log.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_masq.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_nat.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_numgen.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_queue.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_quota.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_redir.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_reject.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_socket.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/nft_tunnel.ko 2024-03-04T08:29:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_CT.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_DSCP.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_HL.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_HMARK.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_LED.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_LOG.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-04T08:29:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_TEE.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_TRACE.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_addrtype.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_bpf.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_cgroup.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_cluster.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_comment.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_connbytes.ko 2024-03-04T08:29:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_connlabel.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_connlimit.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_connmark.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_conntrack.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_cpu.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_dccp.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_devgroup.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_dscp.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_ecn.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_esp.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_helper.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_hl.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_iprange.ko 2024-03-04T08:29:46.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_ipvs.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_l2tp.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_length.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_limit.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_mac.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_mark.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_multiport.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_nat.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_nfacct.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_osf.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_owner.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_physdev.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_pkttype.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_policy.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_quota.ko 2024-03-04T08:29:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_rateest.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_realm.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_recent.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_sctp.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_set.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_socket.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_state.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_statistic.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_string.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_time.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netfilter/xt_u32.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netlink 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/netlink/netlink_diag.ko 2024-03-04T08:29:46.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/nsh 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/nsh/nsh.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/openvswitch 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/openvswitch/openvswitch.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/openvswitch/vport-geneve.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/openvswitch/vport-gre.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/packet 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/packet/af_packet_diag.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/rds 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/rds/rds.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/rds/rds_rdma.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/rds/rds_tcp.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_csum.ko 2024-03-04T08:29:46.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_gact.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_mirred.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_nat.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_pedit.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_police.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_simple.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_skbedit.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/act_vlan.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/cls_basic.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/cls_bpf.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/cls_flow.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/cls_fw.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/cls_route.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/cls_u32.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/em_cmp.ko 2024-03-04T08:29:46.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/em_ipset.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/em_meta.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/em_nbyte.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/em_text.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/em_u32.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_choke.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_codel.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_drr.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_fq.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_gred.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_hfsc.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_hhf.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_htb.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_ingress.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_mqprio.ko 2024-03-04T08:29:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_multiq.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_netem.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_pie.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_plug.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_prio.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_qfq.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_red.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_sfb.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_sfq.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_tbf.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sched/sch_teql.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sctp 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sctp/sctp.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sctp/sctp_diag.ko 2024-03-04T08:29:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc/auth_gss 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc/sunrpc.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc/xprtrdma 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/tipc 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/tipc/diag.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/tipc/tipc.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/unix 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/unix/unix_diag.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/vmw_vsock 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-04T08:29:46.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/vmw_vsock/vsock.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/xfrm 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/security 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/security/keys 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/security/keys/encrypted-keys 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/security/keys/trusted-keys 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/virt 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/virt/lib 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/kernel/virt/lib/irqbypass.ko 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.alias 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.alias.bin 2024-03-04T08:29:46.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.builtin 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.builtin.alias.bin 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.builtin.bin 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.builtin.modinfo 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.dep 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.dep.bin 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.devname 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.order 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.softdep 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.symbols 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/modules.symbols.bin 2024-03-04T08:29:46.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc6-g786939134d7e/vmlinuz 2024-03-04T08:29:46.942 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-g786939134d7e 2024-03-04T08:29:46.943 DEBUG:teuthology.orchestra.run.smithi046:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:postinstall scriptlet (using /bin/sh): 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: /usr/bin/kernel-install add 6.8.0-rc6-g786939134d7e /lib/modules/6.8.0-rc6-g786939134d7e/vmlinuz 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:for file in vmlinuz System.map config; do 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-g786939134d7e/${file}" "/boot/${file}-6.8.0-rc6-g786939134d7e"; then 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: cp "/lib/modules/6.8.0-rc6-g786939134d7e/${file}" "/boot/${file}-6.8.0-rc6-g786939134d7e" 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: fi 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:done 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-04T08:29:46.968 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:new-kernel-pkg --remove 6.8.0-rc6-g786939134d7e --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-g786939134d7e.img 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-install remove 6.8.0-rc6-g786939134d7e 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-g786939134d7e 2024-03-04T08:29:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-03-04T08:29:46.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-03-04T08:29:47.051 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-03-04T08:29:47.051 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-03-04T08:29:47.052 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:29:47.053 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T08:29:47.054 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T08:29:47.054 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 6.8.0-rc6-g786939134d7e 2024-03-04T08:29:47.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T08:29:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-03-04T08:29:49.374 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[27811]) leaked on vgs invocation. Parent PID 14889: grub2-probe 2024-03-04T08:29:49.374 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[35881]) leaked on vgs invocation. Parent PID 14889: grub2-probe 2024-03-04T08:29:49.420 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[27811]) leaked on vgs invocation. Parent PID 14889: grub2-probe 2024-03-04T08:29:49.420 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[35881]) leaked on vgs invocation. Parent PID 14889: grub2-probe 2024-03-04T08:29:49.684 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T08:29:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-03-04T08:29:49.700 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-03-04T08:29:49.716 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.B6bRNjwIUY 2024-03-04T08:29:49.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B6bRNjwIUY 2024-03-04T08:29:49.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.B6bRNjwIUY 2024-03-04T08:29:49.940 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.B6bRNjwIUY is 6KB 2024-03-04T08:29:49.990 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.B6bRNjwIUY 2024-03-04T08:29:50.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T08:29:50.085 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T08:29:50.085 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T08:29:50.086 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T08:29:50.086 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-g786939134d7e.conf 2024-03-04T08:29:50.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-g786939134d7e 2024-03-04T08:29:50.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-03-04T08:30:20.245 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-04T08:30:20.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:30:20.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:30:38.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-04T08:30:47.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:30:47.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:30:50.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-04T08:31:02.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:31:02.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:31:21.148 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-04T08:31:36.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:31:36.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:31:39.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-04T08:31:57.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:31:57.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:31:57.833 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-03-04T08:31:58.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:31:58.553 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc6-g786939134d7e"... 2024-03-04T08:31:58.553 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-03-04T08:31:58.638 INFO:teuthology.orchestra.run.smithi046.stdout:6.8.0-rc6-g786939134d7e 2024-03-04T08:31:58.639 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-g786939134d7e vs 6.8.0-rc6-g786939134d7e 2024-03-04T08:31:58.639 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T08:31:58.639 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T08:31:59.642 DEBUG:teuthology.parallel:result is None 2024-03-04T08:31:59.643 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-04T08:31:59.652 INFO:teuthology.task.internal:Creating test directory... 2024-03-04T08:31:59.652 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:31:59.667 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:31:59.749 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-04T08:31:59.756 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-04T08:31:59.827 INFO:teuthology.task.internal:Creating archive directory... 2024-03-04T08:31:59.827 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:31:59.838 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:31:59.926 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-04T08:31:59.933 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-04T08:31:59.933 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:31:59.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:31:59.950 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:31:59.962 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:32:00.049 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:32:00.068 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:32:00.150 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:32:00.216 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:32:00.220 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-04T08:32:00.231 INFO:teuthology.task.internal:Configuring sudo... 2024-03-04T08:32:00.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:32:00.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:32:00.296 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-04T08:32:00.306 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-04T08:32:00.306 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:32:00.312 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:32:00.346 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:32:00.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:32:00.565 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:32:00.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:32:00.709 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:32:00.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:32:00.778 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:32:00.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:32:00.881 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:32:00.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:32:01.010 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:32:01.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:32:01.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-03-04T08:32:01.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-03-04T08:32:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:32:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:32:01.522 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-04T08:32:01.530 INFO:teuthology.task.internal:Starting timer... 2024-03-04T08:32:01.530 INFO:teuthology.run_tasks:Running task pcp... 2024-03-04T08:32:01.539 INFO:teuthology.run_tasks:Running task selinux... 2024-03-04T08:32:01.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-03-04T08:32:01.659 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-03-04T08:32:01.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-03-04T08:32:01.719 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-03-04T08:32:01.721 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-04T08:32:01.721 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-03-04T08:32:01.770 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-03-04T08:32:01.770 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-03-04T08:32:01.793 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-03-04T08:32:01.793 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-03-04T08:32:01.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:32:01.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:32:01.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:32:01.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:32:01.907 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-04T08:32:01.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:32:02.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:32:02.169 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-04T08:32:02.179 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-04T08:32:02.184 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-04T08:32:02.317 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-04T08:32:02.333 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-04T08:32:02.334 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-04T08:38:21.593 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-03-04T08:38:21.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:38:21.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:38:21.737 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-03-04T08:38:21.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-04T08:38:21.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-04T08:38:21.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:38:21.975 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-03-04T08:38:22.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-04T08:38:22.044 INFO:teuthology.run_tasks:Running task clock... 2024-03-04T08:38:22.055 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-04T08:38:22.055 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T08:38:22.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T08:38:22.063 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T08:38:22.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T08:38:22.115 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T08:38:22.131 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T08:38:22.157 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T08:38:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-03-04T08:38:22.174 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-03-04T08:38:22.190 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T08:38:22.206 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T08:38:22.212 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T08:38:22.250 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-03-04T08:38:22.254 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T08:38:22.254 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-04T08:38:22.254 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.254 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.254 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.254 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.300 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-03-04T08:38:22.344 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-03-04T08:38:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T08:38:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T08:38:22.589 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-03-04T08:38:22.597 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T08:38:22.598 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-03-04T08:38:22.598 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.598 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.598 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.598 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:38:22.599 INFO:teuthology.run_tasks:Running task install... 2024-03-04T08:38:22.607 DEBUG:teuthology.task.install:project ceph 2024-03-04T08:38:22.608 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}} 2024-03-04T08:38:22.608 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'} 2024-03-04T08:38:22.608 INFO:teuthology.task.install:Using flavor: default 2024-03-04T08:38:22.614 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-03-04T08:38:22.614 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-04T08:38:22.614 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T08:38:22.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:38:22.620 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T08:38:22.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:38:22.925 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T08:38:22.926 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T08:38:22.931 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T08:38:22.931 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T08:38:23.200 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T08:38:23.200 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:38:23.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T08:38:23.274 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T08:38:23.274 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:38:23.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T08:38:23.306 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T08:38:23.306 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T08:38:23.307 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T08:38:23.307 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T08:38:23.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T08:38:23.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T08:38:23.459 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T08:38:23.527 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-03-04T08:38:23.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-03-04T08:38:23.592 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T08:38:23.686 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-03-04T08:38:23.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-03-04T08:38:23.764 INFO:teuthology.orchestra.run.smithi073.stdout:74 files removed 2024-03-04T08:38:23.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T08:38:24.064 INFO:teuthology.orchestra.run.smithi046.stdout:74 files removed 2024-03-04T08:38:24.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T08:38:24.862 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 106 kB/s | 83 kB 00:00 2024-03-04T08:38:25.442 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 100 kB/s | 83 kB 00:00 2024-03-04T08:38:25.571 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 15 kB/s | 10 kB 00:00 2024-03-04T08:38:26.271 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-03-04T08:38:26.475 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 11 kB/s | 10 kB 00:00 2024-03-04T08:38:26.909 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-04T08:38:27.435 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-03-04T08:38:28.308 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2024-03-04T08:38:28.313 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 8.4 MB/s | 6.7 MB 00:00 2024-03-04T08:38:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-04T08:38:31.915 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.0 MB 00:03 2024-03-04T08:38:39.558 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 901 kB/s | 8.0 MB 00:09 2024-03-04T08:38:54.172 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 927 kB/s | 19 MB 00:21 2024-03-04T08:38:58.381 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.1 MB 00:00 2024-03-04T08:38:59.982 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2024-03-04T08:39:01.302 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-03-04T08:39:04.441 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 832 kB/s | 19 MB 00:23 2024-03-04T08:39:06.184 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-03-04T08:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T08:39:08.717 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T08:39:08.718 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T08:39:08.719 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T08:39:08.721 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T08:39:08.724 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T08:39:08.725 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T08:39:08.809 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout:==================================================================================================== 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout:==================================================================================================== 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 68 M 2024-03-04T08:39:08.833 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 436 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.0 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.4 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 52 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T08:39:08.834 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 M 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 289 M 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 176 M 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 675 M 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T08:39:08.835 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.4 M 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 109 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 M 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 52 M 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T08:39:08.836 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 615 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 770 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.1 M 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 337 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 516 k 2024-03-04T08:39:08.837 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 52 M 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.3 M 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T08:39:08.838 INFO:teuthology.orchestra.run.smithi073.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:39:08.839 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 23 M 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T08:39:08.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T08:39:08.841 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T08:39:08.842 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T08:39:08.843 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T08:39:08.844 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T08:39:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T08:39:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T08:39:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T08:39:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout:==================================================================================================== 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout:Install 172 Packages 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 26 Packages 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:39:08.849 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 G 2024-03-04T08:39:08.850 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-03-04T08:39:09.335 INFO:teuthology.orchestra.run.smithi073.stdout:(1/198): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-03-04T08:39:11.027 INFO:teuthology.orchestra.run.smithi073.stdout:(2/198): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 2.8 MB/s | 5.3 MB 00:01 2024-03-04T08:39:12.660 INFO:teuthology.orchestra.run.smithi073.stdout:(3/198): ceph-common-19.0.0-1739.g1bc250c7.el9. 6.1 MB/s | 20 MB 00:03 2024-03-04T08:39:15.435 INFO:teuthology.orchestra.run.smithi073.stdout:(4/198): ceph-debuginfo-19.0.0-1739.g1bc250c7.e 8.3 MB/s | 23 MB 00:02 2024-03-04T08:39:15.652 INFO:teuthology.orchestra.run.smithi073.stdout:(5/198): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 4.0 MB/s | 888 kB 00:00 2024-03-04T08:39:16.402 INFO:teuthology.orchestra.run.smithi073.stdout:(6/198): ceph-fuse-debuginfo-19.0.0-1739.g1bc25 8.0 MB/s | 6.0 MB 00:00 2024-03-04T08:39:16.510 INFO:teuthology.orchestra.run.smithi073.stdout:(7/198): ceph-immutable-object-cache-19.0.0-173 1.3 MB/s | 145 kB 00:00 2024-03-04T08:39:16.808 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 748 kB/s | 6.1 MB 00:08 2024-03-04T08:39:17.103 INFO:teuthology.orchestra.run.smithi073.stdout:(8/198): ceph-base-debuginfo-19.0.0-1739.g1bc25 8.5 MB/s | 68 MB 00:08 2024-03-04T08:39:17.144 INFO:teuthology.orchestra.run.smithi073.stdout:(9/198): ceph-immutable-object-cache-debuginfo- 2.3 MB/s | 1.4 MB 00:00 2024-03-04T08:39:17.445 INFO:teuthology.orchestra.run.smithi073.stdout:(10/198): ceph-mds-19.0.0-1739.g1bc250c7.el9.x8 6.8 MB/s | 2.3 MB 00:00 2024-03-04T08:39:17.678 INFO:teuthology.orchestra.run.smithi073.stdout:(11/198): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x8 6.4 MB/s | 1.5 MB 00:00 2024-03-04T08:39:19.767 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 9.3 kB/s | 15 kB 00:01 2024-03-04T08:39:20.437 INFO:teuthology.orchestra.run.smithi073.stdout:(12/198): ceph-mgr-debuginfo-19.0.0-1739.g1bc25 7.3 MB/s | 20 MB 00:02 2024-03-04T08:39:21.120 INFO:teuthology.orchestra.run.smithi073.stdout:(13/198): ceph-mon-19.0.0-1739.g1bc250c7.el9.x8 6.9 MB/s | 4.7 MB 00:00 2024-03-04T08:39:21.227 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2024-03-04T08:39:24.562 INFO:teuthology.orchestra.run.smithi073.stdout:(14/198): ceph-mds-debuginfo-19.0.0-1739.g1bc25 7.0 MB/s | 52 MB 00:07 2024-03-04T08:39:27.127 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-04T08:39:27.854 INFO:teuthology.orchestra.run.smithi073.stdout:(15/198): ceph-osd-19.0.0-1739.g1bc250c7.el9.x8 5.1 MB/s | 17 MB 00:03 2024-03-04T08:39:29.987 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:39:29.989 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:39:30.038 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T08:39:30.039 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T08:39:30.040 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T08:39:30.042 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T08:39:30.044 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T08:39:30.047 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T08:39:30.048 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T08:39:30.146 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-03-04T08:39:30.273 INFO:teuthology.orchestra.run.smithi046.stdout:==================================================================================================== 2024-03-04T08:39:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-03-04T08:39:30.273 INFO:teuthology.orchestra.run.smithi046.stdout:==================================================================================================== 2024-03-04T08:39:30.273 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-03-04T08:39:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 68 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 436 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.0 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.4 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 52 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T08:39:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 289 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 176 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 675 M 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T08:39:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.4 M 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 109 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 M 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 52 M 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T08:39:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 615 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 770 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.1 M 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 337 k 2024-03-04T08:39:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 516 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 52 M 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.3 M 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T08:39:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:39:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-debuginfo x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 23 M 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T08:39:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T08:39:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T08:39:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T08:39:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T08:39:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T08:39:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T08:39:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T08:39:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T08:39:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T08:39:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:39:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T08:39:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T08:39:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T08:39:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T08:39:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T08:39:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T08:39:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T08:39:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T08:39:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T08:39:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T08:39:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T08:39:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T08:39:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T08:39:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T08:39:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T08:39:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T08:39:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T08:39:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T08:39:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T08:39:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T08:39:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T08:39:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T08:39:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T08:39:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T08:39:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T08:39:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T08:39:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T08:39:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T08:39:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T08:39:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T08:39:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T08:39:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T08:39:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T08:39:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T08:39:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T08:39:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T08:39:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T08:39:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T08:39:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T08:39:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T08:39:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T08:39:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T08:39:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T08:39:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T08:39:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T08:39:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T08:39:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T08:39:30.294 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-03-04T08:39:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T08:39:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:39:30.295 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-03-04T08:39:30.295 INFO:teuthology.orchestra.run.smithi046.stdout:==================================================================================================== 2024-03-04T08:39:30.295 INFO:teuthology.orchestra.run.smithi046.stdout:Install 172 Packages 2024-03-04T08:39:30.295 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 26 Packages 2024-03-04T08:39:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:39:30.297 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.2 G 2024-03-04T08:39:30.297 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-03-04T08:39:31.270 INFO:teuthology.orchestra.run.smithi046.stdout:(1/198): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-03-04T08:39:32.104 INFO:teuthology.orchestra.run.smithi046.stdout:(2/198): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 4.7 MB/s | 5.3 MB 00:01 2024-03-04T08:39:36.670 INFO:teuthology.orchestra.run.smithi073.stdout:(16/198): ceph-mon-debuginfo-19.0.0-1739.g1bc25 6.4 MB/s | 99 MB 00:15 2024-03-04T08:39:38.103 INFO:teuthology.orchestra.run.smithi046.stdout:(3/198): ceph-common-19.0.0-1739.g1bc250c7.el9. 3.0 MB/s | 20 MB 00:06 2024-03-04T08:39:39.328 INFO:teuthology.orchestra.run.smithi073.stdout:(17/198): ceph-radosgw-19.0.0-1739.g1bc250c7.el 3.7 MB/s | 9.8 MB 00:02 2024-03-04T08:39:39.429 INFO:teuthology.orchestra.run.smithi046.stdout:(4/198): ceph-base-debuginfo-19.0.0-1739.g1bc25 8.1 MB/s | 68 MB 00:08 2024-03-04T08:39:40.146 INFO:teuthology.orchestra.run.smithi046.stdout:(5/198): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.2 MB/s | 888 kB 00:00 2024-03-04T08:39:43.613 INFO:teuthology.orchestra.run.smithi046.stdout:(6/198): ceph-fuse-debuginfo-19.0.0-1739.g1bc25 1.7 MB/s | 6.0 MB 00:03 2024-03-04T08:39:43.788 INFO:teuthology.orchestra.run.smithi046.stdout:(7/198): ceph-immutable-object-cache-19.0.0-173 832 kB/s | 145 kB 00:00 2024-03-04T08:39:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:(8/198): ceph-immutable-object-cache-debuginfo- 1.6 MB/s | 1.4 MB 00:00 2024-03-04T08:39:46.846 INFO:teuthology.orchestra.run.smithi046.stdout:(9/198): ceph-mds-19.0.0-1739.g1bc250c7.el9.x86 1.1 MB/s | 2.3 MB 00:02 2024-03-04T08:39:49.863 INFO:teuthology.orchestra.run.smithi046.stdout:(10/198): ceph-debuginfo-19.0.0-1739.g1bc250c7. 2.0 MB/s | 23 MB 00:11 2024-03-04T08:39:50.913 INFO:teuthology.orchestra.run.smithi046.stdout:(11/198): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x8 1.4 MB/s | 1.5 MB 00:01 2024-03-04T08:39:58.421 INFO:teuthology.orchestra.run.smithi046.stdout:(12/198): ceph-mgr-debuginfo-19.0.0-1739.g1bc25 2.7 MB/s | 20 MB 00:07 2024-03-04T08:39:59.930 INFO:teuthology.orchestra.run.smithi046.stdout:(13/198): ceph-mon-19.0.0-1739.g1bc250c7.el9.x8 3.1 MB/s | 4.7 MB 00:01 2024-03-04T08:40:11.354 INFO:teuthology.orchestra.run.smithi046.stdout:(14/198): ceph-mds-debuginfo-19.0.0-1739.g1bc25 2.1 MB/s | 52 MB 00:24 2024-03-04T08:40:14.296 INFO:teuthology.orchestra.run.smithi046.stdout:(15/198): ceph-osd-19.0.0-1739.g1bc250c7.el9.x8 5.7 MB/s | 17 MB 00:02 2024-03-04T08:40:20.587 INFO:teuthology.orchestra.run.smithi046.stdout:(16/198): ceph-mon-debuginfo-19.0.0-1739.g1bc25 4.8 MB/s | 99 MB 00:20 2024-03-04T08:40:22.771 INFO:teuthology.orchestra.run.smithi046.stdout:(17/198): ceph-radosgw-19.0.0-1739.g1bc250c7.el 4.5 MB/s | 9.8 MB 00:02 2024-03-04T08:41:08.826 INFO:teuthology.orchestra.run.smithi046.stdout:(18/198): ceph-common-debuginfo-19.0.0-1739.g1b 4.5 MB/s | 436 MB 01:36 2024-03-04T08:41:08.979 INFO:teuthology.orchestra.run.smithi046.stdout:(19/198): ceph-selinux-19.0.0-1739.g1bc250c7.el 169 kB/s | 25 kB 00:00 2024-03-04T08:41:18.959 INFO:teuthology.orchestra.run.smithi073.stdout:(18/198): ceph-radosgw-debuginfo-19.0.0-1739.g1 1.8 MB/s | 176 MB 01:39 2024-03-04T08:41:19.075 INFO:teuthology.orchestra.run.smithi073.stdout:(19/198): ceph-selinux-19.0.0-1739.g1bc250c7.el 216 kB/s | 25 kB 00:00 2024-03-04T08:41:19.122 INFO:teuthology.orchestra.run.smithi046.stdout:(20/198): ceph-radosgw-debuginfo-19.0.0-1739.g1 3.1 MB/s | 176 MB 00:56 2024-03-04T08:41:20.766 INFO:teuthology.orchestra.run.smithi046.stdout:(21/198): ceph-test-19.0.0-1739.g1bc250c7.el9.x 4.0 MB/s | 47 MB 00:11 2024-03-04T08:41:20.933 INFO:teuthology.orchestra.run.smithi046.stdout:(22/198): cephfs-mirror-19.0.0-1739.g1bc250c7.e 1.3 MB/s | 220 kB 00:00 2024-03-04T08:41:21.000 INFO:teuthology.orchestra.run.smithi046.stdout:(23/198): cephfs-shell-19.0.0-1739.g1bc250c7.el 411 kB/s | 27 kB 00:00 2024-03-04T08:41:21.084 INFO:teuthology.orchestra.run.smithi046.stdout:(24/198): libcephfs-devel-19.0.0-1739.g1bc250c7 377 kB/s | 31 kB 00:00 2024-03-04T08:41:21.309 INFO:teuthology.orchestra.run.smithi046.stdout:(25/198): libcephfs2-19.0.0-1739.g1bc250c7.el9. 3.3 MB/s | 747 kB 00:00 2024-03-04T08:41:22.326 INFO:teuthology.orchestra.run.smithi046.stdout:(26/198): libcephfs2-debuginfo-19.0.0-1739.g1bc 5.3 MB/s | 5.4 MB 00:01 2024-03-04T08:41:22.385 INFO:teuthology.orchestra.run.smithi046.stdout:(27/198): libcephsqlite-19.0.0-1739.g1bc250c7.e 2.8 MB/s | 163 kB 00:00 2024-03-04T08:41:22.451 INFO:teuthology.orchestra.run.smithi046.stdout:(28/198): librados-devel-19.0.0-1739.g1bc250c7. 1.9 MB/s | 127 kB 00:00 2024-03-04T08:41:22.535 INFO:teuthology.orchestra.run.smithi046.stdout:(29/198): librados-devel-debuginfo-19.0.0-1739. 1.3 MB/s | 109 kB 00:00 2024-03-04T08:41:29.408 INFO:teuthology.orchestra.run.smithi073.stdout:(20/198): ceph-common-debuginfo-19.0.0-1739.g1b 3.2 MB/s | 436 MB 02:18 2024-03-04T08:41:31.241 INFO:teuthology.orchestra.run.smithi073.stdout:(21/198): ceph-osd-debuginfo-19.0.0-1739.g1bc25 2.3 MB/s | 289 MB 02:03 2024-03-04T08:41:31.708 INFO:teuthology.orchestra.run.smithi073.stdout:(22/198): cephfs-mirror-19.0.0-1739.g1bc250c7.e 473 kB/s | 220 kB 00:00 2024-03-04T08:41:31.817 INFO:teuthology.orchestra.run.smithi073.stdout:(23/198): cephfs-shell-19.0.0-1739.g1bc250c7.el 250 kB/s | 27 kB 00:00 2024-03-04T08:41:31.925 INFO:teuthology.orchestra.run.smithi073.stdout:(24/198): libcephfs-devel-19.0.0-1739.g1bc250c7 289 kB/s | 31 kB 00:00 2024-03-04T08:41:32.309 INFO:teuthology.orchestra.run.smithi073.stdout:(25/198): libcephfs2-19.0.0-1739.g1bc250c7.el9. 1.9 MB/s | 747 kB 00:00 2024-03-04T08:41:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:(30/198): librados2-debuginfo-19.0.0-1739.g1bc2 4.0 MB/s | 45 MB 00:11 2024-03-04T08:41:33.976 INFO:teuthology.orchestra.run.smithi046.stdout:(31/198): libradosstriper1-19.0.0-1739.g1bc250c 2.2 MB/s | 501 kB 00:00 2024-03-04T08:41:34.825 INFO:teuthology.orchestra.run.smithi073.stdout:(26/198): libcephfs2-debuginfo-19.0.0-1739.g1bc 2.1 MB/s | 5.4 MB 00:02 2024-03-04T08:41:34.942 INFO:teuthology.orchestra.run.smithi073.stdout:(27/198): libcephsqlite-19.0.0-1739.g1bc250c7.e 1.4 MB/s | 163 kB 00:00 2024-03-04T08:41:35.068 INFO:teuthology.orchestra.run.smithi073.stdout:(28/198): librados-devel-19.0.0-1739.g1bc250c7. 1.0 MB/s | 127 kB 00:00 2024-03-04T08:41:35.171 INFO:teuthology.orchestra.run.smithi073.stdout:(29/198): librados-devel-debuginfo-19.0.0-1739. 1.0 MB/s | 109 kB 00:00 2024-03-04T08:41:38.213 INFO:teuthology.orchestra.run.smithi073.stdout:(30/198): ceph-test-19.0.0-1739.g1bc250c7.el9.x 2.5 MB/s | 47 MB 00:19 2024-03-04T08:41:38.588 INFO:teuthology.orchestra.run.smithi073.stdout:(31/198): libradosstriper1-19.0.0-1739.g1bc250c 1.3 MB/s | 501 kB 00:00 2024-03-04T08:41:42.926 INFO:teuthology.orchestra.run.smithi046.stdout:(32/198): ceph-osd-debuginfo-19.0.0-1739.g1bc25 3.3 MB/s | 289 MB 01:28 2024-03-04T08:41:44.067 INFO:teuthology.orchestra.run.smithi046.stdout:(33/198): librgw2-19.0.0-1739.g1bc250c7.el9.x86 4.5 MB/s | 5.1 MB 00:01 2024-03-04T08:41:44.176 INFO:teuthology.orchestra.run.smithi046.stdout:(34/198): python3-ceph-argparse-19.0.0-1739.g1b 421 kB/s | 45 kB 00:00 2024-03-04T08:41:44.276 INFO:teuthology.orchestra.run.smithi046.stdout:(35/198): python3-ceph-common-19.0.0-1739.g1bc2 1.3 MB/s | 131 kB 00:00 2024-03-04T08:41:44.393 INFO:teuthology.orchestra.run.smithi046.stdout:(36/198): python3-cephfs-19.0.0-1739.g1bc250c7. 1.4 MB/s | 162 kB 00:00 2024-03-04T08:41:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:(37/198): python3-cephfs-debuginfo-19.0.0-1739. 1.4 MB/s | 615 kB 00:00 2024-03-04T08:41:44.928 INFO:teuthology.orchestra.run.smithi046.stdout:(38/198): python3-rados-19.0.0-1739.g1bc250c7.e 2.9 MB/s | 321 kB 00:00 2024-03-04T08:41:45.260 INFO:teuthology.orchestra.run.smithi046.stdout:(39/198): python3-rados-debuginfo-19.0.0-1739.g 2.3 MB/s | 770 kB 00:00 2024-03-04T08:41:45.377 INFO:teuthology.orchestra.run.smithi046.stdout:(40/198): python3-rbd-19.0.0-1739.g1bc250c7.el9 2.5 MB/s | 298 kB 00:00 2024-03-04T08:41:45.953 INFO:teuthology.orchestra.run.smithi046.stdout:(41/198): python3-rbd-debuginfo-19.0.0-1739.g1b 2.0 MB/s | 1.1 MB 00:00 2024-03-04T08:41:46.028 INFO:teuthology.orchestra.run.smithi046.stdout:(42/198): python3-rgw-19.0.0-1739.g1bc250c7.el9 1.3 MB/s | 99 kB 00:00 2024-03-04T08:41:46.187 INFO:teuthology.orchestra.run.smithi046.stdout:(43/198): python3-rgw-debuginfo-19.0.0-1739.g1b 2.1 MB/s | 337 kB 00:00 2024-03-04T08:41:46.278 INFO:teuthology.orchestra.run.smithi046.stdout:(44/198): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 942 kB/s | 85 kB 00:00 2024-03-04T08:41:46.462 INFO:teuthology.orchestra.run.smithi046.stdout:(45/198): rbd-fuse-debuginfo-19.0.0-1739.g1bc25 2.8 MB/s | 516 kB 00:00 2024-03-04T08:41:47.262 INFO:teuthology.orchestra.run.smithi046.stdout:(46/198): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 3.9 MB/s | 3.1 MB 00:00 2024-03-04T08:41:48.408 INFO:teuthology.orchestra.run.smithi046.stdout:(47/198): librbd1-debuginfo-19.0.0-1739.g1bc250 3.6 MB/s | 52 MB 00:14 2024-03-04T08:41:48.729 INFO:teuthology.orchestra.run.smithi046.stdout:(48/198): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 527 kB/s | 171 kB 00:00 2024-03-04T08:41:49.121 INFO:teuthology.orchestra.run.smithi073.stdout:(32/198): librados2-debuginfo-19.0.0-1739.g1bc2 3.2 MB/s | 45 MB 00:13 2024-03-04T08:41:51.255 INFO:teuthology.orchestra.run.smithi046.stdout:(49/198): rbd-nbd-debuginfo-19.0.0-1739.g1bc250 519 kB/s | 1.3 MB 00:02 2024-03-04T08:41:51.414 INFO:teuthology.orchestra.run.smithi046.stdout:(50/198): ceph-grafana-dashboards-19.0.0-1739.g 200 kB/s | 31 kB 00:00 2024-03-04T08:41:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:(51/198): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 833 kB/s | 138 kB 00:00 2024-03-04T08:41:51.595 INFO:teuthology.orchestra.run.smithi073.stdout:(33/198): librgw2-19.0.0-1739.g1bc250c7.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-03-04T08:41:51.712 INFO:teuthology.orchestra.run.smithi073.stdout:(34/198): python3-ceph-argparse-19.0.0-1739.g1b 388 kB/s | 45 kB 00:00 2024-03-04T08:41:52.004 INFO:teuthology.orchestra.run.smithi073.stdout:(35/198): python3-ceph-common-19.0.0-1739.g1bc2 450 kB/s | 131 kB 00:00 2024-03-04T08:41:52.039 INFO:teuthology.orchestra.run.smithi046.stdout:(52/198): ceph-mgr-dashboard-19.0.0-1739.g1bc25 3.9 MB/s | 1.8 MB 00:00 2024-03-04T08:41:52.096 INFO:teuthology.orchestra.run.smithi073.stdout:(36/198): python3-cephfs-19.0.0-1739.g1bc250c7. 1.7 MB/s | 162 kB 00:00 2024-03-04T08:41:52.672 INFO:teuthology.orchestra.run.smithi073.stdout:(37/198): librbd1-debuginfo-19.0.0-1739.g1bc250 3.7 MB/s | 52 MB 00:14 2024-03-04T08:41:52.708 INFO:teuthology.orchestra.run.smithi073.stdout:(38/198): python3-cephfs-debuginfo-19.0.0-1739. 1.0 MB/s | 615 kB 00:00 2024-03-04T08:41:52.855 INFO:teuthology.orchestra.run.smithi073.stdout:(39/198): python3-rados-19.0.0-1739.g1bc250c7.e 1.7 MB/s | 321 kB 00:00 2024-03-04T08:41:53.031 INFO:teuthology.orchestra.run.smithi073.stdout:(40/198): python3-rbd-19.0.0-1739.g1bc250c7.el9 1.7 MB/s | 298 kB 00:00 2024-03-04T08:41:53.056 INFO:teuthology.orchestra.run.smithi073.stdout:(41/198): python3-rados-debuginfo-19.0.0-1739.g 2.1 MB/s | 770 kB 00:00 2024-03-04T08:41:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:(42/198): python3-rgw-19.0.0-1739.g1bc250c7.el9 851 kB/s | 99 kB 00:00 2024-03-04T08:41:53.373 INFO:teuthology.orchestra.run.smithi073.stdout:(43/198): python3-rgw-debuginfo-19.0.0-1739.g1b 1.6 MB/s | 337 kB 00:00 2024-03-04T08:41:53.407 INFO:teuthology.orchestra.run.smithi073.stdout:(44/198): python3-rbd-debuginfo-19.0.0-1739.g1b 3.0 MB/s | 1.1 MB 00:00 2024-03-04T08:41:53.499 INFO:teuthology.orchestra.run.smithi073.stdout:(45/198): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 680 kB/s | 85 kB 00:00 2024-03-04T08:41:53.608 INFO:teuthology.orchestra.run.smithi073.stdout:(46/198): rbd-fuse-debuginfo-19.0.0-1739.g1bc25 2.5 MB/s | 516 kB 00:00 2024-03-04T08:41:53.655 INFO:teuthology.orchestra.run.smithi046.stdout:(53/198): ceph-mgr-diskprediction-local-19.0.0- 4.6 MB/s | 7.4 MB 00:01 2024-03-04T08:41:53.764 INFO:teuthology.orchestra.run.smithi046.stdout:(54/198): ceph-mgr-modules-core-19.0.0-1739.g1b 2.3 MB/s | 248 kB 00:00 2024-03-04T08:41:53.856 INFO:teuthology.orchestra.run.smithi046.stdout:(55/198): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 544 kB/s | 49 kB 00:00 2024-03-04T08:41:53.957 INFO:teuthology.orchestra.run.smithi046.stdout:(56/198): ceph-prometheus-alerts-19.0.0-1739.g1 155 kB/s | 15 kB 00:00 2024-03-04T08:41:54.065 INFO:teuthology.orchestra.run.smithi046.stdout:(57/198): ceph-volume-19.0.0-1739.g1bc250c7.el9 2.4 MB/s | 264 kB 00:00 2024-03-04T08:41:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:(58/198): cephadm-19.0.0-1739.g1bc250c7.el9.noa 2.3 MB/s | 748 kB 00:00 2024-03-04T08:41:54.482 INFO:teuthology.orchestra.run.smithi046.stdout:(59/198): cephfs-top-19.0.0-1739.g1bc250c7.el9. 201 kB/s | 18 kB 00:00 2024-03-04T08:41:54.558 INFO:teuthology.orchestra.run.smithi073.stdout:(47/198): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 2.9 MB/s | 3.1 MB 00:01 2024-03-04T08:41:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:(48/198): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 2.0 MB/s | 171 kB 00:00 2024-03-04T08:41:54.666 INFO:teuthology.orchestra.run.smithi046.stdout:(60/198): automake-1.16.2-8.el9.noarch.rpm 3.6 MB/s | 662 kB 00:00 2024-03-04T08:41:54.745 INFO:teuthology.orchestra.run.smithi046.stdout:(61/198): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 920 kB 00:00 2024-03-04T08:41:54.783 INFO:teuthology.orchestra.run.smithi046.stdout:(62/198): boost-program-options-1.75.0-8.el9.x8 2.8 MB/s | 106 kB 00:00 2024-03-04T08:41:54.809 INFO:teuthology.orchestra.run.smithi046.stdout:(63/198): elfutils-libelf-devel-0.190-2.el9.x86 857 kB/s | 20 kB 00:00 2024-03-04T08:41:54.850 INFO:teuthology.orchestra.run.smithi046.stdout:(64/198): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2024-03-04T08:41:54.876 INFO:teuthology.orchestra.run.smithi046.stdout:(65/198): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 32 kB 00:00 2024-03-04T08:41:54.993 INFO:teuthology.orchestra.run.smithi046.stdout:(66/198): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-04T08:41:55.026 INFO:teuthology.orchestra.run.smithi046.stdout:(67/198): flexiblas-openblas-openmp-3.0.4-8.el9 529 kB/s | 17 kB 00:00 2024-03-04T08:41:55.060 INFO:teuthology.orchestra.run.smithi046.stdout:(68/198): libaio-devel-0.3.111-13.el9.x86_64.rp 312 kB/s | 10 kB 00:00 2024-03-04T08:41:55.075 INFO:teuthology.orchestra.run.smithi073.stdout:(49/198): rbd-nbd-debuginfo-19.0.0-1739.g1bc250 3.0 MB/s | 1.3 MB 00:00 2024-03-04T08:41:55.102 INFO:teuthology.orchestra.run.smithi046.stdout:(69/198): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-03-04T08:41:55.159 INFO:teuthology.orchestra.run.smithi073.stdout:(50/198): ceph-grafana-dashboards-19.0.0-1739.g 376 kB/s | 31 kB 00:00 2024-03-04T08:41:55.169 INFO:teuthology.orchestra.run.smithi046.stdout:(70/198): librabbitmq-0.11.0-7.el9.x86_64.rpm 671 kB/s | 44 kB 00:00 2024-03-04T08:41:55.227 INFO:teuthology.orchestra.run.smithi046.stdout:(71/198): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-04T08:41:55.251 INFO:teuthology.orchestra.run.smithi073.stdout:(51/198): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 1.5 MB/s | 138 kB 00:00 2024-03-04T08:41:55.278 INFO:teuthology.orchestra.run.smithi046.stdout:(72/198): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-03-04T08:41:55.311 INFO:teuthology.orchestra.run.smithi046.stdout:(73/198): libuuid-devel-2.37.4-18.el9.x86_64.rp 755 kB/s | 24 kB 00:00 2024-03-04T08:41:55.353 INFO:teuthology.orchestra.run.smithi046.stdout:(74/198): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-03-04T08:41:55.404 INFO:teuthology.orchestra.run.smithi046.stdout:(75/198): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-03-04T08:41:55.446 INFO:teuthology.orchestra.run.smithi046.stdout:(76/198): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-03-04T08:41:55.480 INFO:teuthology.orchestra.run.smithi046.stdout:(77/198): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-04T08:41:55.630 INFO:teuthology.orchestra.run.smithi046.stdout:(78/198): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-03-04T08:41:55.755 INFO:teuthology.orchestra.run.smithi046.stdout:(79/198): openssl-devel-3.0.7-27.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-03-04T08:41:55.768 INFO:teuthology.orchestra.run.smithi073.stdout:(52/198): ceph-mgr-dashboard-19.0.0-1739.g1bc25 3.4 MB/s | 1.8 MB 00:00 2024-03-04T08:41:55.831 INFO:teuthology.orchestra.run.smithi046.stdout:(80/198): postgresql-13.11-1.el9.x86_64.rpm 21 MB/s | 1.5 MB 00:00 2024-03-04T08:41:55.889 INFO:teuthology.orchestra.run.smithi046.stdout:(81/198): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2024-03-04T08:41:55.970 INFO:teuthology.orchestra.run.smithi046.stdout:(82/198): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 134 kB 00:00 2024-03-04T08:41:56.133 INFO:teuthology.orchestra.run.smithi046.stdout:(83/198): postgresql-server-13.11-1.el9.x86_64. 35 MB/s | 5.7 MB 00:00 2024-03-04T08:41:56.200 INFO:teuthology.orchestra.run.smithi046.stdout:(84/198): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-03-04T08:41:56.241 INFO:teuthology.orchestra.run.smithi046.stdout:(85/198): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2024-03-04T08:41:56.425 INFO:teuthology.orchestra.run.smithi046.stdout:(86/198): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-03-04T08:41:56.467 INFO:teuthology.orchestra.run.smithi046.stdout:(87/198): python3-jinja2-2.11.3-5.el9.noarch.rp 5.5 MB/s | 227 kB 00:00 2024-03-04T08:41:56.493 INFO:teuthology.orchestra.run.smithi046.stdout:(88/198): python3-jsonpatch-1.21-16.el9.noarch. 1.0 MB/s | 24 kB 00:00 2024-03-04T08:41:56.518 INFO:teuthology.orchestra.run.smithi046.stdout:(89/198): python3-jsonpointer-2.0-4.el9.noarch. 753 kB/s | 18 kB 00:00 2024-03-04T08:41:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:(90/198): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-03-04T08:41:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:(91/198): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 32 kB 00:00 2024-03-04T08:41:56.727 INFO:teuthology.orchestra.run.smithi046.stdout:(92/198): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-03-04T08:41:56.786 INFO:teuthology.orchestra.run.smithi046.stdout:(93/198): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 217 kB 00:00 2024-03-04T08:41:56.828 INFO:teuthology.orchestra.run.smithi046.stdout:(94/198): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-03-04T08:41:56.870 INFO:teuthology.orchestra.run.smithi046.stdout:(95/198): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-03-04T08:41:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:(96/198): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-03-04T08:41:56.945 INFO:teuthology.orchestra.run.smithi046.stdout:(97/198): python3-protobuf-3.14.0-13.el9.noarch 5.7 MB/s | 238 kB 00:00 2024-03-04T08:41:56.987 INFO:teuthology.orchestra.run.smithi046.stdout:(98/198): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-03-04T08:41:57.030 INFO:teuthology.orchestra.run.smithi046.stdout:(99/198): python3-pyasn1-modules-0.4.8-6.el9.no 5.1 MB/s | 211 kB 00:00 2024-03-04T08:41:57.071 INFO:teuthology.orchestra.run.smithi046.stdout:(100/198): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-04T08:41:57.105 INFO:teuthology.orchestra.run.smithi046.stdout:(101/198): python3-requests-oauthlib-1.3.0-12.e 1.3 MB/s | 43 kB 00:00 2024-03-04T08:41:57.480 INFO:teuthology.orchestra.run.smithi046.stdout:(102/198): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-04T08:41:57.522 INFO:teuthology.orchestra.run.smithi046.stdout:(103/198): python3-toml-0.10.2-6.el9.noarch.rpm 961 kB/s | 39 kB 00:00 2024-03-04T08:41:57.559 INFO:teuthology.orchestra.run.smithi073.stdout:(53/198): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-03-04T08:41:57.581 INFO:teuthology.orchestra.run.smithi046.stdout:(104/198): python3-wcwidth-0.2.5-8.el9.noarch.r 716 kB/s | 41 kB 00:00 2024-03-04T08:41:57.623 INFO:teuthology.orchestra.run.smithi046.stdout:(105/198): qatlib-23.11.0-1.el9.x86_64.rpm 5.2 MB/s | 215 kB 00:00 2024-03-04T08:41:57.651 INFO:teuthology.orchestra.run.smithi073.stdout:(54/198): ceph-mgr-modules-core-19.0.0-1739.g1b 2.7 MB/s | 248 kB 00:00 2024-03-04T08:41:57.656 INFO:teuthology.orchestra.run.smithi046.stdout:(106/198): qatlib-service-23.11.0-1.el9.x86_64. 1.0 MB/s | 34 kB 00:00 2024-03-04T08:41:57.690 INFO:teuthology.orchestra.run.smithi046.stdout:(107/198): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-03-04T08:41:57.732 INFO:teuthology.orchestra.run.smithi046.stdout:(108/198): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2024-03-04T08:41:57.743 INFO:teuthology.orchestra.run.smithi073.stdout:(55/198): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 539 kB/s | 49 kB 00:00 2024-03-04T08:41:57.766 INFO:teuthology.orchestra.run.smithi046.stdout:(109/198): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-03-04T08:41:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:(110/198): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.1 MB/s | 87 kB 00:00 2024-03-04T08:41:57.835 INFO:teuthology.orchestra.run.smithi073.stdout:(56/198): ceph-prometheus-alerts-19.0.0-1739.g1 167 kB/s | 15 kB 00:00 2024-03-04T08:41:57.841 INFO:teuthology.orchestra.run.smithi046.stdout:(111/198): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-03-04T08:41:57.875 INFO:teuthology.orchestra.run.smithi046.stdout:(112/198): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-04T08:41:57.917 INFO:teuthology.orchestra.run.smithi046.stdout:(113/198): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-03-04T08:41:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:(57/198): ceph-volume-19.0.0-1739.g1bc250c7.el9 2.8 MB/s | 264 kB 00:00 2024-03-04T08:41:57.984 INFO:teuthology.orchestra.run.smithi046.stdout:(114/198): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2024-03-04T08:41:58.051 INFO:teuthology.orchestra.run.smithi046.stdout:(115/198): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-03-04T08:41:58.093 INFO:teuthology.orchestra.run.smithi046.stdout:(116/198): libquadmath-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 194 kB 00:00 2024-03-04T08:41:58.135 INFO:teuthology.orchestra.run.smithi046.stdout:(117/198): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-03-04T08:41:58.177 INFO:teuthology.orchestra.run.smithi046.stdout:(118/198): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.8 MB/s | 241 kB 00:00 2024-03-04T08:41:58.252 INFO:teuthology.orchestra.run.smithi046.stdout:(119/198): python3-cryptography-36.0.1-4.el9.x8 15 MB/s | 1.1 MB 00:00 2024-03-04T08:41:58.294 INFO:teuthology.orchestra.run.smithi046.stdout:(120/198): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 103 kB 00:00 2024-03-04T08:41:58.336 INFO:teuthology.orchestra.run.smithi046.stdout:(121/198): python3-pycparser-2.20-6.el9.noarch. 3.0 MB/s | 124 kB 00:00 2024-03-04T08:41:58.395 INFO:teuthology.orchestra.run.smithi046.stdout:(122/198): python3-requests-2.25.1-8.el9.noarch 1.9 MB/s | 113 kB 00:00 2024-03-04T08:41:58.440 INFO:teuthology.orchestra.run.smithi046.stdout:(123/198): python3-urllib3-1.26.5-5.el9.noarch. 4.5 MB/s | 187 kB 00:00 2024-03-04T08:41:58.486 INFO:teuthology.orchestra.run.smithi073.stdout:(58/198): cephadm-19.0.0-1739.g1bc250c7.el9.noa 1.3 MB/s | 748 kB 00:00 2024-03-04T08:41:58.579 INFO:teuthology.orchestra.run.smithi046.stdout:(124/198): python3-devel-3.9.17-2.el9.x86_64.rp 1.7 MB/s | 245 kB 00:00 2024-03-04T08:41:58.594 INFO:teuthology.orchestra.run.smithi073.stdout:(59/198): cephfs-top-19.0.0-1739.g1bc250c7.el9. 168 kB/s | 18 kB 00:00 2024-03-04T08:41:58.654 INFO:teuthology.orchestra.run.smithi046.stdout:(125/198): lua-devel-5.4.4-4.el9.x86_64.rpm 302 kB/s | 22 kB 00:00 2024-03-04T08:41:58.728 INFO:teuthology.orchestra.run.smithi073.stdout:(60/198): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2024-03-04T08:41:58.787 INFO:teuthology.orchestra.run.smithi073.stdout:(61/198): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-03-04T08:41:58.828 INFO:teuthology.orchestra.run.smithi073.stdout:(62/198): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-03-04T08:41:58.862 INFO:teuthology.orchestra.run.smithi073.stdout:(63/198): elfutils-libelf-devel-0.190-2.el9.x86 611 kB/s | 20 kB 00:00 2024-03-04T08:41:58.904 INFO:teuthology.orchestra.run.smithi073.stdout:(64/198): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-04T08:41:58.938 INFO:teuthology.orchestra.run.smithi073.stdout:(65/198): flexiblas-3.0.4-8.el9.x86_64.rpm 949 kB/s | 32 kB 00:00 2024-03-04T08:41:59.046 INFO:teuthology.orchestra.run.smithi073.stdout:(66/198): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-04T08:41:59.088 INFO:teuthology.orchestra.run.smithi073.stdout:(67/198): flexiblas-openblas-openmp-3.0.4-8.el9 408 kB/s | 17 kB 00:00 2024-03-04T08:41:59.122 INFO:teuthology.orchestra.run.smithi073.stdout:(68/198): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-03-04T08:41:59.164 INFO:teuthology.orchestra.run.smithi073.stdout:(69/198): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-04T08:41:59.198 INFO:teuthology.orchestra.run.smithi073.stdout:(70/198): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-04T08:41:59.248 INFO:teuthology.orchestra.run.smithi073.stdout:(71/198): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-04T08:41:59.290 INFO:teuthology.orchestra.run.smithi073.stdout:(72/198): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-03-04T08:41:59.305 INFO:teuthology.orchestra.run.smithi046.stdout:(126/198): rbd-mirror-debuginfo-19.0.0-1739.g1b 4.3 MB/s | 52 MB 00:12 2024-03-04T08:41:59.324 INFO:teuthology.orchestra.run.smithi073.stdout:(73/198): libuuid-devel-2.37.4-18.el9.x86_64.rp 727 kB/s | 24 kB 00:00 2024-03-04T08:41:59.355 INFO:teuthology.orchestra.run.smithi046.stdout:(127/198): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-03-04T08:41:59.358 INFO:teuthology.orchestra.run.smithi073.stdout:(74/198): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-04T08:41:59.399 INFO:teuthology.orchestra.run.smithi073.stdout:(75/198): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-04T08:41:59.442 INFO:teuthology.orchestra.run.smithi073.stdout:(76/198): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-03-04T08:41:59.475 INFO:teuthology.orchestra.run.smithi073.stdout:(77/198): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-04T08:41:59.637 INFO:teuthology.orchestra.run.smithi073.stdout:(78/198): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2024-03-04T08:41:59.755 INFO:teuthology.orchestra.run.smithi073.stdout:(79/198): openssl-devel-3.0.7-27.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-03-04T08:41:59.805 INFO:teuthology.orchestra.run.smithi046.stdout:(128/198): gperftools-libs-2.9.1-2.el9.x86_64.r 815 kB/s | 309 kB 00:00 2024-03-04T08:41:59.822 INFO:teuthology.orchestra.run.smithi073.stdout:(80/198): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2024-03-04T08:41:59.847 INFO:teuthology.orchestra.run.smithi046.stdout:(129/198): grpc-data-1.46.7-10.el9.noarch.rpm 481 kB/s | 19 kB 00:00 2024-03-04T08:41:59.872 INFO:teuthology.orchestra.run.smithi073.stdout:(81/198): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2024-03-04T08:41:59.880 INFO:teuthology.orchestra.run.smithi046.stdout:(130/198): abseil-cpp-20211102.0-3.el9.x86_64.r 954 kB/s | 548 kB 00:00 2024-03-04T08:41:59.905 INFO:teuthology.orchestra.run.smithi073.stdout:(82/198): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2024-03-04T08:41:59.931 INFO:teuthology.orchestra.run.smithi046.stdout:(131/198): libarrow-doc-9.0.0-10.el9.noarch.rpm 528 kB/s | 26 kB 00:00 2024-03-04T08:42:00.031 INFO:teuthology.orchestra.run.smithi046.stdout:(132/198): liboath-2.6.7-2.el9.x86_64.rpm 491 kB/s | 49 kB 00:00 2024-03-04T08:42:00.089 INFO:teuthology.orchestra.run.smithi073.stdout:(83/198): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-03-04T08:42:00.090 INFO:teuthology.orchestra.run.smithi046.stdout:(133/198): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-04T08:42:00.139 INFO:teuthology.orchestra.run.smithi073.stdout:(84/198): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-03-04T08:42:00.156 INFO:teuthology.orchestra.run.smithi046.stdout:(134/198): luarocks-3.9.2-1.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2024-03-04T08:42:00.173 INFO:teuthology.orchestra.run.smithi073.stdout:(85/198): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-03-04T08:42:00.324 INFO:teuthology.orchestra.run.smithi073.stdout:(86/198): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2024-03-04T08:42:00.366 INFO:teuthology.orchestra.run.smithi073.stdout:(87/198): python3-jinja2-2.11.3-5.el9.noarch.rp 5.3 MB/s | 227 kB 00:00 2024-03-04T08:42:00.432 INFO:teuthology.orchestra.run.smithi046.stdout:(135/198): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-03-04T08:42:00.483 INFO:teuthology.orchestra.run.smithi073.stdout:(88/198): python3-jsonpatch-1.21-16.el9.noarch. 209 kB/s | 24 kB 00:00 2024-03-04T08:42:00.516 INFO:teuthology.orchestra.run.smithi073.stdout:(89/198): python3-jsonpointer-2.0-4.el9.noarch. 546 kB/s | 18 kB 00:00 2024-03-04T08:42:00.550 INFO:teuthology.orchestra.run.smithi073.stdout:(90/198): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2024-03-04T08:42:00.584 INFO:teuthology.orchestra.run.smithi073.stdout:(91/198): python3-markupsafe-1.1.1-12.el9.x86_6 944 kB/s | 32 kB 00:00 2024-03-04T08:42:00.590 INFO:teuthology.orchestra.run.smithi046.stdout:(136/198): python3-asyncssh-2.13.2-4.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-03-04T08:42:00.641 INFO:teuthology.orchestra.run.smithi046.stdout:(137/198): python3-bcrypt-3.2.2-1.el9.x86_64.rp 890 kB/s | 43 kB 00:00 2024-03-04T08:42:00.682 INFO:teuthology.orchestra.run.smithi046.stdout:(138/198): python3-cachetools-4.2.4-1.el9.noarc 792 kB/s | 32 kB 00:00 2024-03-04T08:42:00.709 INFO:teuthology.orchestra.run.smithi073.stdout:(92/198): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-04T08:42:00.724 INFO:teuthology.orchestra.run.smithi046.stdout:(139/198): python3-certifi-2021.10.8-2.el9.noar 369 kB/s | 15 kB 00:00 2024-03-04T08:42:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:(93/198): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-03-04T08:42:00.793 INFO:teuthology.orchestra.run.smithi073.stdout:(94/198): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2024-03-04T08:42:00.825 INFO:teuthology.orchestra.run.smithi046.stdout:(140/198): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-03-04T08:42:00.826 INFO:teuthology.orchestra.run.smithi073.stdout:(95/198): python3-packaging-20.9-5.el9.noarch.r 2.0 MB/s | 69 kB 00:00 2024-03-04T08:42:00.852 INFO:teuthology.orchestra.run.smithi073.stdout:(96/198): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2024-03-04T08:42:00.886 INFO:teuthology.orchestra.run.smithi073.stdout:(97/198): python3-protobuf-3.14.0-13.el9.noarch 6.9 MB/s | 238 kB 00:00 2024-03-04T08:42:00.919 INFO:teuthology.orchestra.run.smithi073.stdout:(98/198): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-03-04T08:42:00.942 INFO:teuthology.orchestra.run.smithi046.stdout:(141/198): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-04T08:42:00.952 INFO:teuthology.orchestra.run.smithi073.stdout:(99/198): python3-pyasn1-modules-0.4.8-6.el9.no 6.1 MB/s | 211 kB 00:00 2024-03-04T08:42:00.978 INFO:teuthology.orchestra.run.smithi073.stdout:(100/198): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2024-03-04T08:42:01.012 INFO:teuthology.orchestra.run.smithi073.stdout:(101/198): python3-requests-oauthlib-1.3.0-12.e 1.2 MB/s | 43 kB 00:00 2024-03-04T08:42:01.042 INFO:teuthology.orchestra.run.smithi046.stdout:(142/198): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-03-04T08:42:01.092 INFO:teuthology.orchestra.run.smithi046.stdout:(143/198): python3-colorama-0.4.4-12.el9.noarch 718 kB/s | 35 kB 00:00 2024-03-04T08:42:01.226 INFO:teuthology.orchestra.run.smithi046.stdout:(144/198): python3-google-auth-2.28.0-1.el9.noa 1.5 MB/s | 203 kB 00:00 2024-03-04T08:42:01.362 INFO:teuthology.orchestra.run.smithi073.stdout:(102/198): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-04T08:42:01.396 INFO:teuthology.orchestra.run.smithi073.stdout:(103/198): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-04T08:42:01.401 INFO:teuthology.orchestra.run.smithi046.stdout:(145/198): libarrow-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-03-04T08:42:01.429 INFO:teuthology.orchestra.run.smithi073.stdout:(104/198): python3-wcwidth-0.2.5-8.el9.noarch.r 1.2 MB/s | 41 kB 00:00 2024-03-04T08:42:01.463 INFO:teuthology.orchestra.run.smithi073.stdout:(105/198): qatlib-23.11.0-1.el9.x86_64.rpm 6.3 MB/s | 215 kB 00:00 2024-03-04T08:42:01.485 INFO:teuthology.orchestra.run.smithi046.stdout:(146/198): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-04T08:42:01.496 INFO:teuthology.orchestra.run.smithi073.stdout:(106/198): qatlib-service-23.11.0-1.el9.x86_64. 1.0 MB/s | 34 kB 00:00 2024-03-04T08:42:01.527 INFO:teuthology.orchestra.run.smithi046.stdout:(147/198): python3-jaraco-8.2.1-3.el9.noarch.rp 264 kB/s | 11 kB 00:00 2024-03-04T08:42:01.530 INFO:teuthology.orchestra.run.smithi073.stdout:(107/198): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-03-04T08:42:01.569 INFO:teuthology.orchestra.run.smithi046.stdout:(148/198): python3-jaraco-classes-3.2.1-5.el9.n 435 kB/s | 18 kB 00:00 2024-03-04T08:42:01.572 INFO:teuthology.orchestra.run.smithi073.stdout:(108/198): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-03-04T08:42:01.606 INFO:teuthology.orchestra.run.smithi073.stdout:(109/198): uuid-1.6.2-55.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-03-04T08:42:01.627 INFO:teuthology.orchestra.run.smithi046.stdout:(149/198): python3-jaraco-collections-3.0.0-8.e 404 kB/s | 23 kB 00:00 2024-03-04T08:42:01.639 INFO:teuthology.orchestra.run.smithi073.stdout:(110/198): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.5 MB/s | 87 kB 00:00 2024-03-04T08:42:01.669 INFO:teuthology.orchestra.run.smithi046.stdout:(150/198): python3-jaraco-functools-3.5.0-2.el9 476 kB/s | 19 kB 00:00 2024-03-04T08:42:01.673 INFO:teuthology.orchestra.run.smithi073.stdout:(111/198): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-04T08:42:01.707 INFO:teuthology.orchestra.run.smithi073.stdout:(112/198): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-04T08:42:01.711 INFO:teuthology.orchestra.run.smithi046.stdout:(151/198): python3-jaraco-text-3.2.0-6.el9.noar 484 kB/s | 20 kB 00:00 2024-03-04T08:42:01.741 INFO:teuthology.orchestra.run.smithi073.stdout:(113/198): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-03-04T08:42:01.782 INFO:teuthology.orchestra.run.smithi073.stdout:(114/198): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-03-04T08:42:01.833 INFO:teuthology.orchestra.run.smithi073.stdout:(115/198): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T08:42:01.887 INFO:teuthology.orchestra.run.smithi046.stdout:(152/198): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-03-04T08:42:01.937 INFO:teuthology.orchestra.run.smithi046.stdout:(153/198): python3-logutils-0.3.5-21.el9.noarch 946 kB/s | 46 kB 00:00 2024-03-04T08:42:02.017 INFO:teuthology.orchestra.run.smithi046.stdout:(154/198): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-03-04T08:42:02.062 INFO:teuthology.orchestra.run.smithi046.stdout:(155/198): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-03-04T08:42:02.154 INFO:teuthology.orchestra.run.smithi046.stdout:(156/198): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-03-04T08:42:02.205 INFO:teuthology.orchestra.run.smithi046.stdout:(157/198): python3-portend-3.1.0-2.el9.noarch.r 333 kB/s | 16 kB 00:00 2024-03-04T08:42:02.247 INFO:teuthology.orchestra.run.smithi046.stdout:(158/198): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-03-04T08:42:02.292 INFO:teuthology.orchestra.run.smithi073.stdout:(116/198): rbd-mirror-debuginfo-19.0.0-1739.g1b 5.9 MB/s | 52 MB 00:08 2024-03-04T08:42:02.305 INFO:teuthology.orchestra.run.smithi046.stdout:(159/198): python3-pyOpenSSL-21.0.0-1.el9.noarc 906 kB/s | 90 kB 00:00 2024-03-04T08:42:02.317 INFO:teuthology.orchestra.run.smithi073.stdout:(117/198): libquadmath-11.4.1-3.el9.x86_64.rpm 401 kB/s | 194 kB 00:00 2024-03-04T08:42:02.330 INFO:teuthology.orchestra.run.smithi046.stdout:(160/198): python3-pyperclip-1.8.2-2.el9.noarch 341 kB/s | 28 kB 00:00 2024-03-04T08:42:02.342 INFO:teuthology.orchestra.run.smithi073.stdout:(118/198): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-04T08:42:02.368 INFO:teuthology.orchestra.run.smithi073.stdout:(119/198): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T08:42:02.372 INFO:teuthology.orchestra.run.smithi046.stdout:(161/198): python3-repoze-lru-0.7-16.el9.noarch 467 kB/s | 31 kB 00:00 2024-03-04T08:42:02.409 INFO:teuthology.orchestra.run.smithi073.stdout:(120/198): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2024-03-04T08:42:02.435 INFO:teuthology.orchestra.run.smithi073.stdout:(121/198): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-03-04T08:42:02.439 INFO:teuthology.orchestra.run.smithi046.stdout:(162/198): python3-rsa-4.9-2.el9.noarch.rpm 898 kB/s | 59 kB 00:00 2024-03-04T08:42:02.460 INFO:teuthology.orchestra.run.smithi073.stdout:(122/198): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-03-04T08:42:02.485 INFO:teuthology.orchestra.run.smithi073.stdout:(123/198): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-03-04T08:42:02.498 INFO:teuthology.orchestra.run.smithi046.stdout:(163/198): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-03-04T08:42:02.510 INFO:teuthology.orchestra.run.smithi073.stdout:(124/198): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-04T08:42:02.523 INFO:teuthology.orchestra.run.smithi046.stdout:(164/198): python3-tempora-5.0.0-2.el9.noarch.r 434 kB/s | 36 kB 00:00 2024-03-04T08:42:02.565 INFO:teuthology.orchestra.run.smithi046.stdout:(165/198): python3-typing-extensions-4.4.0-2.el 768 kB/s | 51 kB 00:00 2024-03-04T08:42:02.652 INFO:teuthology.orchestra.run.smithi073.stdout:(125/198): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-03-04T08:42:02.657 INFO:teuthology.orchestra.run.smithi046.stdout:(166/198): python3-websocket-client-1.2.3-2.el9 990 kB/s | 90 kB 00:00 2024-03-04T08:42:02.691 INFO:teuthology.orchestra.run.smithi046.stdout:(167/198): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-03-04T08:42:02.758 INFO:teuthology.orchestra.run.smithi046.stdout:(168/198): python3-zc-lockfile-2.0-10.el9.noarc 303 kB/s | 20 kB 00:00 2024-03-04T08:42:02.908 INFO:teuthology.orchestra.run.smithi046.stdout:(169/198): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-03-04T08:42:02.942 INFO:teuthology.orchestra.run.smithi046.stdout:(170/198): python3-werkzeug-2.0.3-3.el9.1.noarc 1.5 MB/s | 427 kB 00:00 2024-03-04T08:42:02.953 INFO:teuthology.orchestra.run.smithi073.stdout:(126/198): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-03-04T08:42:03.384 INFO:teuthology.orchestra.run.smithi046.stdout:(171/198): thrift-0.15.0-2.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-03-04T08:42:03.470 INFO:teuthology.orchestra.run.smithi073.stdout:(127/198): python3-devel-3.9.17-2.el9.x86_64.rp 249 kB/s | 245 kB 00:00 2024-03-04T08:42:03.537 INFO:teuthology.orchestra.run.smithi073.stdout:(128/198): abseil-cpp-20211102.0-3.el9.x86_64.r 940 kB/s | 548 kB 00:00 2024-03-04T08:42:03.796 INFO:teuthology.orchestra.run.smithi073.stdout:(129/198): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-03-04T08:42:03.979 INFO:teuthology.orchestra.run.smithi073.stdout:(130/198): gperftools-libs-2.9.1-2.el9.x86_64.r 607 kB/s | 309 kB 00:00 2024-03-04T08:42:04.246 INFO:teuthology.orchestra.run.smithi073.stdout:(131/198): libarrow-doc-9.0.0-10.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-03-04T08:42:04.376 INFO:teuthology.orchestra.run.smithi046.stdout:(172/198): librados2-19.0.0-1739.g1bc250c7.el9. 2.4 MB/s | 3.4 MB 00:01 2024-03-04T08:42:04.434 INFO:teuthology.orchestra.run.smithi046.stdout:(173/198): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 68 kB 00:00 2024-03-04T08:42:04.543 INFO:teuthology.orchestra.run.smithi046.stdout:(174/198): NetworkManager-1.46.0-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-03-04T08:42:04.635 INFO:teuthology.orchestra.run.smithi046.stdout:(175/198): NetworkManager-libnm-1.46.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-03-04T08:42:04.727 INFO:teuthology.orchestra.run.smithi046.stdout:(176/198): librbd1-19.0.0-1739.g1bc250c7.el9.x8 2.3 MB/s | 3.1 MB 00:01 2024-03-04T08:42:04.752 INFO:teuthology.orchestra.run.smithi046.stdout:(177/198): NetworkManager-team-1.46.0-1.el9.x86 356 kB/s | 41 kB 00:00 2024-03-04T08:42:04.785 INFO:teuthology.orchestra.run.smithi046.stdout:(178/198): NetworkManager-tui-1.46.0-1.el9.x86_ 4.2 MB/s | 247 kB 00:00 2024-03-04T08:42:04.836 INFO:teuthology.orchestra.run.smithi046.stdout:(179/198): acl-2.3.1-4.el9.x86_64.rpm 829 kB/s | 69 kB 00:00 2024-03-04T08:42:04.838 INFO:teuthology.orchestra.run.smithi073.stdout:(132/198): liboath-2.6.7-2.el9.x86_64.rpm 82 kB/s | 49 kB 00:00 2024-03-04T08:42:04.861 INFO:teuthology.orchestra.run.smithi046.stdout:(180/198): elfutils-debuginfod-client-0.190-2.e 472 kB/s | 35 kB 00:00 2024-03-04T08:42:04.895 INFO:teuthology.orchestra.run.smithi046.stdout:(181/198): elfutils-libelf-0.190-2.el9.x86_64.r 3.3 MB/s | 191 kB 00:00 2024-03-04T08:42:04.928 INFO:teuthology.orchestra.run.smithi046.stdout:(182/198): elfutils-libs-0.190-2.el9.x86_64.rpm 3.9 MB/s | 254 kB 00:00 2024-03-04T08:42:04.970 INFO:teuthology.orchestra.run.smithi046.stdout:(183/198): iproute-6.7.0-2.el9.x86_64.rpm 11 MB/s | 802 kB 00:00 2024-03-04T08:42:05.004 INFO:teuthology.orchestra.run.smithi046.stdout:(184/198): iproute-tc-6.7.0-2.el9.x86_64.rpm 6.3 MB/s | 433 kB 00:00 2024-03-04T08:42:05.029 INFO:teuthology.orchestra.run.smithi046.stdout:(185/198): libacl-2.3.1-4.el9.x86_64.rpm 408 kB/s | 22 kB 00:00 2024-03-04T08:42:05.063 INFO:teuthology.orchestra.run.smithi046.stdout:(186/198): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-03-04T08:42:05.097 INFO:teuthology.orchestra.run.smithi046.stdout:(187/198): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 154 kB 00:00 2024-03-04T08:42:05.105 INFO:teuthology.orchestra.run.smithi073.stdout:(133/198): libarrow-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-03-04T08:42:05.122 INFO:teuthology.orchestra.run.smithi046.stdout:(188/198): libmount-2.37.4-18.el9.x86_64.rpm 2.4 MB/s | 135 kB 00:00 2024-03-04T08:42:05.172 INFO:teuthology.orchestra.run.smithi046.stdout:(189/198): libsmartcols-2.37.4-18.el9.x86_64.rp 859 kB/s | 63 kB 00:00 2024-03-04T08:42:05.223 INFO:teuthology.orchestra.run.smithi046.stdout:(190/198): libuuid-2.37.4-18.el9.x86_64.rpm 277 kB/s | 28 kB 00:00 2024-03-04T08:42:05.273 INFO:teuthology.orchestra.run.smithi046.stdout:(191/198): openssl-3.0.7-27.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-03-04T08:42:05.356 INFO:teuthology.orchestra.run.smithi046.stdout:(192/198): openssl-libs-3.0.7-27.el9.x86_64.rpm 18 MB/s | 2.2 MB 00:00 2024-03-04T08:42:05.372 INFO:teuthology.orchestra.run.smithi073.stdout:(134/198): libunwind-1.6.2-1.el9.x86_64.rpm 126 kB/s | 67 kB 00:00 2024-03-04T08:42:05.440 INFO:teuthology.orchestra.run.smithi046.stdout:(193/198): util-linux-2.37.4-18.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-03-04T08:42:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:(194/198): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 438 kB 00:00 2024-03-04T08:42:05.499 INFO:teuthology.orchestra.run.smithi046.stdout:(195/198): util-linux-user-2.37.4-18.el9.x86_64 558 kB/s | 30 kB 00:00 2024-03-04T08:42:05.531 INFO:teuthology.orchestra.run.smithi073.stdout:(135/198): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-03-04T08:42:05.532 INFO:teuthology.orchestra.run.smithi046.stdout:(196/198): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2024-03-04T08:42:05.583 INFO:teuthology.orchestra.run.smithi046.stdout:(197/198): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-04T08:42:06.039 INFO:teuthology.orchestra.run.smithi073.stdout:(136/198): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-03-04T08:42:06.148 INFO:teuthology.orchestra.run.smithi073.stdout:(137/198): python3-asyncssh-2.13.2-4.el9.noarch 888 kB/s | 548 kB 00:00 2024-03-04T08:42:06.381 INFO:teuthology.orchestra.run.smithi073.stdout:(138/198): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-03-04T08:42:06.415 INFO:teuthology.orchestra.run.smithi073.stdout:(139/198): python3-cachetools-4.2.4-1.el9.noarc 121 kB/s | 32 kB 00:00 2024-03-04T08:42:06.648 INFO:teuthology.orchestra.run.smithi073.stdout:(140/198): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-03-04T08:42:06.840 INFO:teuthology.orchestra.run.smithi073.stdout:(141/198): python3-cheroot-8.6.0-4.el9.noarch.r 404 kB/s | 172 kB 00:00 2024-03-04T08:42:07.166 INFO:teuthology.orchestra.run.smithi073.stdout:(142/198): python3-cherrypy-18.6.1-2.el9.noarch 693 kB/s | 358 kB 00:00 2024-03-04T08:42:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:(143/198): python3-cmd2-2.4.2-2.el9.noarch.rpm 596 kB/s | 303 kB 00:00 2024-03-04T08:42:07.433 INFO:teuthology.orchestra.run.smithi073.stdout:(144/198): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-03-04T08:42:07.775 INFO:teuthology.orchestra.run.smithi073.stdout:(145/198): python3-google-auth-2.28.0-1.el9.noa 476 kB/s | 203 kB 00:00 2024-03-04T08:42:08.208 INFO:teuthology.orchestra.run.smithi073.stdout:(146/198): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-03-04T08:42:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:(147/198): python3-grpcio-tools-1.46.7-10.el9.x 315 kB/s | 144 kB 00:00 2024-03-04T08:42:08.401 INFO:teuthology.orchestra.run.smithi073.stdout:(148/198): python3-jaraco-8.2.1-3.el9.noarch.rp 56 kB/s | 11 kB 00:00 2024-03-04T08:42:08.501 INFO:teuthology.orchestra.run.smithi073.stdout:(149/198): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-03-04T08:42:08.685 INFO:teuthology.orchestra.run.smithi073.stdout:(150/198): python3-jaraco-collections-3.0.0-8.e 82 kB/s | 23 kB 00:00 2024-03-04T08:42:08.768 INFO:teuthology.orchestra.run.smithi073.stdout:(151/198): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-03-04T08:42:08.952 INFO:teuthology.orchestra.run.smithi073.stdout:(152/198): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-03-04T08:42:09.302 INFO:teuthology.orchestra.run.smithi073.stdout:(153/198): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-03-04T08:42:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:(154/198): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-03-04T08:42:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:(155/198): python3-more-itertools-8.12.0-2.el9. 231 kB/s | 79 kB 00:00 2024-03-04T08:42:09.803 INFO:teuthology.orchestra.run.smithi073.stdout:(156/198): python3-natsort-7.1.1-5.el9.noarch.r 165 kB/s | 58 kB 00:00 2024-03-04T08:42:10.070 INFO:teuthology.orchestra.run.smithi073.stdout:(157/198): python3-portend-3.1.0-2.el9.noarch.r 61 kB/s | 16 kB 00:00 2024-03-04T08:42:10.162 INFO:teuthology.orchestra.run.smithi073.stdout:(158/198): python3-pecan-1.4.2-3.el9.noarch.rpm 526 kB/s | 272 kB 00:00 2024-03-04T08:42:10.429 INFO:teuthology.orchestra.run.smithi073.stdout:(159/198): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-03-04T08:42:10.454 INFO:teuthology.orchestra.run.smithi073.stdout:(160/198): python3-pyperclip-1.8.2-2.el9.noarch 97 kB/s | 28 kB 00:00 2024-03-04T08:42:10.696 INFO:teuthology.orchestra.run.smithi073.stdout:(161/198): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-03-04T08:42:10.972 INFO:teuthology.orchestra.run.smithi073.stdout:(162/198): python3-routes-2.5.1-5.el9.noarch.rp 365 kB/s | 188 kB 00:00 2024-03-04T08:42:11.038 INFO:teuthology.orchestra.run.smithi073.stdout:(163/198): python3-rsa-4.9-2.el9.noarch.rpm 173 kB/s | 59 kB 00:00 2024-03-04T08:42:11.255 INFO:teuthology.orchestra.run.smithi073.stdout:(164/198): python3-tempora-5.0.0-2.el9.noarch.r 126 kB/s | 36 kB 00:00 2024-03-04T08:42:11.381 INFO:teuthology.orchestra.run.smithi073.stdout:(165/198): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-03-04T08:42:11.731 INFO:teuthology.orchestra.run.smithi073.stdout:(166/198): python3-websocket-client-1.2.3-2.el9 256 kB/s | 90 kB 00:00 2024-03-04T08:42:11.756 INFO:teuthology.orchestra.run.smithi073.stdout:(167/198): python3-webob-1.8.7-6.el9.noarch.rpm 459 kB/s | 230 kB 00:00 2024-03-04T08:42:12.023 INFO:teuthology.orchestra.run.smithi073.stdout:(168/198): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-03-04T08:42:12.324 INFO:teuthology.orchestra.run.smithi073.stdout:(169/198): python3-werkzeug-2.0.3-3.el9.1.noarc 721 kB/s | 427 kB 00:00 2024-03-04T08:42:12.449 INFO:teuthology.orchestra.run.smithi073.stdout:(170/198): re2-20211101-3.el9.x86_64.rpm 450 kB/s | 192 kB 00:00 2024-03-04T08:42:13.016 INFO:teuthology.orchestra.run.smithi073.stdout:(171/198): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-03-04T08:42:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:(172/198): librbd1-19.0.0-1739.g1bc250c7.el9.x8 3.2 MB/s | 3.1 MB 00:00 2024-03-04T08:42:14.033 INFO:teuthology.orchestra.run.smithi073.stdout:(173/198): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-03-04T08:42:14.108 INFO:teuthology.orchestra.run.smithi073.stdout:(174/198): NetworkManager-1.46.0-1.el9.x86_64.r 30 MB/s | 2.3 MB 00:00 2024-03-04T08:42:14.175 INFO:teuthology.orchestra.run.smithi073.stdout:(175/198): NetworkManager-libnm-1.46.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-03-04T08:42:14.209 INFO:teuthology.orchestra.run.smithi073.stdout:(176/198): NetworkManager-team-1.46.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-04T08:42:14.251 INFO:teuthology.orchestra.run.smithi073.stdout:(177/198): NetworkManager-tui-1.46.0-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-04T08:42:14.284 INFO:teuthology.orchestra.run.smithi073.stdout:(178/198): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-03-04T08:42:14.318 INFO:teuthology.orchestra.run.smithi073.stdout:(179/198): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 35 kB 00:00 2024-03-04T08:42:14.360 INFO:teuthology.orchestra.run.smithi073.stdout:(180/198): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-03-04T08:42:14.402 INFO:teuthology.orchestra.run.smithi073.stdout:(181/198): elfutils-libs-0.190-2.el9.x86_64.rpm 5.9 MB/s | 254 kB 00:00 2024-03-04T08:42:14.452 INFO:teuthology.orchestra.run.smithi073.stdout:(182/198): iproute-6.7.0-2.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T08:42:14.494 INFO:teuthology.orchestra.run.smithi073.stdout:(183/198): iproute-tc-6.7.0-2.el9.x86_64.rpm 10 MB/s | 433 kB 00:00 2024-03-04T08:42:14.528 INFO:teuthology.orchestra.run.smithi073.stdout:(184/198): libacl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 22 kB 00:00 2024-03-04T08:42:14.561 INFO:teuthology.orchestra.run.smithi073.stdout:(185/198): libblkid-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 107 kB 00:00 2024-03-04T08:42:14.595 INFO:teuthology.orchestra.run.smithi073.stdout:(186/198): libfdisk-2.37.4-18.el9.x86_64.rpm 4.5 MB/s | 154 kB 00:00 2024-03-04T08:42:14.654 INFO:teuthology.orchestra.run.smithi073.stdout:(187/198): librados2-19.0.0-1739.g1bc250c7.el9. 1.5 MB/s | 3.4 MB 00:02 2024-03-04T08:42:14.679 INFO:teuthology.orchestra.run.smithi073.stdout:(188/198): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 135 kB 00:00 2024-03-04T08:42:14.705 INFO:teuthology.orchestra.run.smithi073.stdout:(189/198): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-03-04T08:42:14.730 INFO:teuthology.orchestra.run.smithi073.stdout:(190/198): libuuid-2.37.4-18.el9.x86_64.rpm 550 kB/s | 28 kB 00:00 2024-03-04T08:42:14.763 INFO:teuthology.orchestra.run.smithi073.stdout:(191/198): openssl-3.0.7-27.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2024-03-04T08:42:14.814 INFO:teuthology.orchestra.run.smithi073.stdout:(192/198): openssl-libs-3.0.7-27.el9.x86_64.rpm 26 MB/s | 2.2 MB 00:00 2024-03-04T08:42:14.856 INFO:teuthology.orchestra.run.smithi073.stdout:(193/198): util-linux-2.37.4-18.el9.x86_64.rpm 24 MB/s | 2.2 MB 00:00 2024-03-04T08:42:14.881 INFO:teuthology.orchestra.run.smithi073.stdout:(194/198): util-linux-core-2.37.4-18.el9.x86_64 6.6 MB/s | 438 kB 00:00 2024-03-04T08:42:14.907 INFO:teuthology.orchestra.run.smithi073.stdout:(195/198): util-linux-user-2.37.4-18.el9.x86_64 607 kB/s | 30 kB 00:00 2024-03-04T08:42:14.932 INFO:teuthology.orchestra.run.smithi073.stdout:(196/198): xfsdump-3.1.12-4.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-03-04T08:42:14.965 INFO:teuthology.orchestra.run.smithi073.stdout:(197/198): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-03-04T08:42:30.890 INFO:teuthology.orchestra.run.smithi046.stdout:(198/198): ceph-test-debuginfo-19.0.0-1739.g1bc 9.4 MB/s | 675 MB 01:11 2024-03-04T08:42:30.904 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:42:30.904 INFO:teuthology.orchestra.run.smithi046.stdout:Total 12 MB/s | 2.2 GB 03:00 2024-03-04T08:42:31.037 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-03-04T08:42:31.444 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-03-04T08:42:31.445 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-03-04T08:42:42.905 INFO:teuthology.orchestra.run.smithi073.stdout:(198/198): ceph-test-debuginfo-19.0.0-1739.g1bc 9.2 MB/s | 675 MB 01:13 2024-03-04T08:42:42.909 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:42:42.910 INFO:teuthology.orchestra.run.smithi073.stdout:Total 10 MB/s | 2.2 GB 03:34 2024-03-04T08:42:42.954 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-03-04T08:42:43.235 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-03-04T08:42:43.235 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-03-04T08:42:46.480 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-03-04T08:42:46.480 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-03-04T08:42:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-03-04T08:42:56.705 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-03-04T08:43:07.229 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-03-04T08:43:10.163 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/224 2024-03-04T08:43:10.192 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_6 2/224 2024-03-04T08:43:10.235 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/224 2024-03-04T08:43:10.309 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/224 2024-03-04T08:43:10.388 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/224 2024-03-04T08:43:10.449 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 5/224 2024-03-04T08:43:10.530 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/224 2024-03-04T08:43:10.643 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/224 2024-03-04T08:43:10.730 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 8/224 2024-03-04T08:43:10.775 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 9/224 2024-03-04T08:43:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/224 2024-03-04T08:43:11.295 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 11/224 2024-03-04T08:43:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/224 2024-03-04T08:43:11.488 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/224 2024-03-04T08:43:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/224 2024-03-04T08:43:11.663 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/224 2024-03-04T08:43:11.704 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/224 2024-03-04T08:43:11.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 15/224 2024-03-04T08:43:12.033 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/224 2024-03-04T08:43:12.058 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/224 2024-03-04T08:43:12.213 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/224 2024-03-04T08:43:12.245 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 18/224 2024-03-04T08:43:12.353 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 18/224 2024-03-04T08:43:12.398 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/224 2024-03-04T08:43:12.430 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-03-04T08:43:12.503 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-03-04T08:43:12.851 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/224 2024-03-04T08:43:12.896 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/224 2024-03-04T08:43:12.946 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/224 2024-03-04T08:43:13.297 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/224 2024-03-04T08:43:13.421 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 24/224 2024-03-04T08:43:13.535 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 24/224 2024-03-04T08:43:13.759 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 25/224 2024-03-04T08:43:13.823 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 25/224 2024-03-04T08:43:14.175 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 25/224 2024-03-04T08:43:14.373 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/224 2024-03-04T08:43:14.499 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/224 2024-03-04T08:43:14.538 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/224 2024-03-04T08:43:14.638 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/224 2024-03-04T08:43:14.701 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/224 2024-03-04T08:43:14.749 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/224 2024-03-04T08:43:14.808 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/224 2024-03-04T08:43:14.866 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/224 2024-03-04T08:43:14.982 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/224 2024-03-04T08:43:15.028 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/224 2024-03-04T08:43:15.104 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/224 2024-03-04T08:43:15.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/224 2024-03-04T08:43:15.198 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/224 2024-03-04T08:43:15.323 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/224 2024-03-04T08:43:15.368 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 40/224 2024-03-04T08:43:15.429 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 41/224 2024-03-04T08:43:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 42/224 2024-03-04T08:43:15.627 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/224 2024-03-04T08:43:15.690 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/224 2024-03-04T08:43:15.804 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/224 2024-03-04T08:43:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-03-04T08:43:15.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/224 2024-03-04T08:43:16.057 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/224 2024-03-04T08:43:16.754 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/224 2024-03-04T08:43:16.855 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/224 2024-03-04T08:43:16.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/224 2024-03-04T08:43:17.046 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-03-04T08:43:17.072 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-03-04T08:43:17.167 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/224 2024-03-04T08:43:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 53/224 2024-03-04T08:43:17.305 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/224 2024-03-04T08:43:17.500 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 55/224 2024-03-04T08:43:17.591 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 56/224 2024-03-04T08:43:17.990 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 57/224 2024-03-04T08:43:18.298 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 58/224 2024-03-04T08:43:18.414 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 59/224 2024-03-04T08:43:18.486 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 60/224 2024-03-04T08:43:18.541 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/224 2024-03-04T08:43:18.572 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_6 2/224 2024-03-04T08:43:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/224 2024-03-04T08:43:18.646 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/224 2024-03-04T08:43:18.666 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/224 2024-03-04T08:43:18.709 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 61/224 2024-03-04T08:43:18.724 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 5/224 2024-03-04T08:43:18.762 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/224 2024-03-04T08:43:18.792 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 62/224 2024-03-04T08:43:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/224 2024-03-04T08:43:18.851 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 8/224 2024-03-04T08:43:18.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 63/224 2024-03-04T08:43:18.875 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 9/224 2024-03-04T08:43:18.917 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/224 2024-03-04T08:43:18.977 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/224 2024-03-04T08:43:19.017 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 65/224 2024-03-04T08:43:19.057 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 66/224 2024-03-04T08:43:19.126 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 67/224 2024-03-04T08:43:19.182 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 68/224 2024-03-04T08:43:19.236 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 11/224 2024-03-04T08:43:19.249 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 69/224 2024-03-04T08:43:19.293 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/224 2024-03-04T08:43:19.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 70/224 2024-03-04T08:43:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/224 2024-03-04T08:43:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/224 2024-03-04T08:43:19.532 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 71/224 2024-03-04T08:43:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/224 2024-03-04T08:43:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/224 2024-03-04T08:43:19.587 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 72/224 2024-03-04T08:43:19.626 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 73/224 2024-03-04T08:43:19.683 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 74/224 2024-03-04T08:43:19.724 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 15/224 2024-03-04T08:43:19.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/224 2024-03-04T08:43:19.800 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/224 2024-03-04T08:43:19.830 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 75/224 2024-03-04T08:43:19.866 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 76/224 2024-03-04T08:43:19.904 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/224 2024-03-04T08:43:19.911 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/224 2024-03-04T08:43:19.926 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 18/224 2024-03-04T08:43:19.973 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 78/224 2024-03-04T08:43:19.992 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 18/224 2024-03-04T08:43:20.008 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 79/224 2024-03-04T08:43:20.030 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/224 2024-03-04T08:43:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-03-04T08:43:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-03-04T08:43:20.181 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/224 2024-03-04T08:43:20.210 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/224 2024-03-04T08:43:20.242 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/224 2024-03-04T08:43:20.282 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/224 2024-03-04T08:43:20.358 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 81/224 2024-03-04T08:43:20.377 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/224 2024-03-04T08:43:20.460 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 24/224 2024-03-04T08:43:20.502 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/224 2024-03-04T08:43:20.503 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 24/224 2024-03-04T08:43:20.559 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 83/224 2024-03-04T08:43:20.571 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 25/224 2024-03-04T08:43:20.622 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 84/224 2024-03-04T08:43:20.637 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 25/224 2024-03-04T08:43:20.698 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 85/224 2024-03-04T08:43:20.860 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 25/224 2024-03-04T08:43:20.968 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/224 2024-03-04T08:43:20.973 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 86/224 2024-03-04T08:43:21.029 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 87/224 2024-03-04T08:43:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/224 2024-03-04T08:43:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/224 2024-03-04T08:43:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/224 2024-03-04T08:43:21.206 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 88/224 2024-03-04T08:43:21.232 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/224 2024-03-04T08:43:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 89/224 2024-03-04T08:43:21.262 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/224 2024-03-04T08:43:21.297 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/224 2024-03-04T08:43:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 90/224 2024-03-04T08:43:21.338 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/224 2024-03-04T08:43:21.359 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 91/224 2024-03-04T08:43:21.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/224 2024-03-04T08:43:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 92/224 2024-03-04T08:43:21.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/224 2024-03-04T08:43:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 93/224 2024-03-04T08:43:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/224 2024-03-04T08:43:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/224 2024-03-04T08:43:21.513 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 94/224 2024-03-04T08:43:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/224 2024-03-04T08:43:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/224 2024-03-04T08:43:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/224 2024-03-04T08:43:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 40/224 2024-03-04T08:43:21.671 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 96/224 2024-03-04T08:43:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 41/224 2024-03-04T08:43:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 42/224 2024-03-04T08:43:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/224 2024-03-04T08:43:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 98/224 2024-03-04T08:43:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/224 2024-03-04T08:43:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/224 2024-03-04T08:43:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/224 2024-03-04T08:43:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 99/224 2024-03-04T08:43:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 100/224 2024-03-04T08:43:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 101/224 2024-03-04T08:43:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/224 2024-03-04T08:43:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/224 2024-03-04T08:43:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/224 2024-03-04T08:43:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/224 2024-03-04T08:43:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/224 2024-03-04T08:43:22.447 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/224 2024-03-04T08:43:22.500 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 106/224 2024-03-04T08:43:22.534 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 107/224 2024-03-04T08:43:22.592 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 108/224 2024-03-04T08:43:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/224 2024-03-04T08:43:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/224 2024-03-04T08:43:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/224 2024-03-04T08:43:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/224 2024-03-04T08:43:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-03-04T08:43:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-03-04T08:43:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 110/224 2024-03-04T08:43:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/224 2024-03-04T08:43:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 53/224 2024-03-04T08:43:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/224 2024-03-04T08:43:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 55/224 2024-03-04T08:43:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 56/224 2024-03-04T08:43:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 57/224 2024-03-04T08:43:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 58/224 2024-03-04T08:43:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 59/224 2024-03-04T08:43:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 60/224 2024-03-04T08:43:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 61/224 2024-03-04T08:43:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 62/224 2024-03-04T08:43:23.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 63/224 2024-03-04T08:43:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 111/224 2024-03-04T08:43:23.904 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/224 2024-03-04T08:43:23.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 112/224 2024-03-04T08:43:23.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 113/224 2024-03-04T08:43:23.943 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 65/224 2024-03-04T08:43:23.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 66/224 2024-03-04T08:43:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 114/224 2024-03-04T08:43:24.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 67/224 2024-03-04T08:43:24.062 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 68/224 2024-03-04T08:43:24.106 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 69/224 2024-03-04T08:43:24.147 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 70/224 2024-03-04T08:43:24.152 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 115/224 2024-03-04T08:43:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 116/224 2024-03-04T08:43:24.284 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 71/224 2024-03-04T08:43:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 117/224 2024-03-04T08:43:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 118/224 2024-03-04T08:43:24.512 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 72/224 2024-03-04T08:43:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 119/224 2024-03-04T08:43:24.659 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 73/224 2024-03-04T08:43:24.721 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 74/224 2024-03-04T08:43:24.819 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 75/224 2024-03-04T08:43:24.858 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 76/224 2024-03-04T08:43:24.898 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/224 2024-03-04T08:43:24.924 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 78/224 2024-03-04T08:43:24.949 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 79/224 2024-03-04T08:43:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/224 2024-03-04T08:43:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 81/224 2024-03-04T08:43:25.249 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/224 2024-03-04T08:43:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 83/224 2024-03-04T08:43:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 84/224 2024-03-04T08:43:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 85/224 2024-03-04T08:43:25.448 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 120/224 2024-03-04T08:43:25.579 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 86/224 2024-03-04T08:43:25.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 121/224 2024-03-04T08:43:25.636 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 87/224 2024-03-04T08:43:25.764 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 88/224 2024-03-04T08:43:25.800 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 89/224 2024-03-04T08:43:25.833 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 90/224 2024-03-04T08:43:25.865 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 91/224 2024-03-04T08:43:25.892 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-16.el9.x86_64 92/224 2024-03-04T08:43:25.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 93/224 2024-03-04T08:43:25.951 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 94/224 2024-03-04T08:43:25.985 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/224 2024-03-04T08:43:26.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 96/224 2024-03-04T08:43:26.056 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/224 2024-03-04T08:43:26.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 98/224 2024-03-04T08:43:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 99/224 2024-03-04T08:43:26.204 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 100/224 2024-03-04T08:43:26.238 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 101/224 2024-03-04T08:43:26.279 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/224 2024-03-04T08:43:26.313 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/224 2024-03-04T08:43:26.402 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/224 2024-03-04T08:43:26.492 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/224 2024-03-04T08:43:26.536 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 106/224 2024-03-04T08:43:26.576 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 107/224 2024-03-04T08:43:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 108/224 2024-03-04T08:43:26.720 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/224 2024-03-04T08:43:26.777 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 110/224 2024-03-04T08:43:27.209 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 122/224 2024-03-04T08:43:27.304 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 123/224 2024-03-04T08:43:27.348 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 124/224 2024-03-04T08:43:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 111/224 2024-03-04T08:43:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 112/224 2024-03-04T08:43:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 113/224 2024-03-04T08:43:27.640 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 114/224 2024-03-04T08:43:27.727 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 115/224 2024-03-04T08:43:27.734 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 125/224 2024-03-04T08:43:27.759 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 116/224 2024-03-04T08:43:27.766 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/224 2024-03-04T08:43:27.905 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/224 2024-03-04T08:43:27.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 117/224 2024-03-04T08:43:27.939 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 127/224 2024-03-04T08:43:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 118/224 2024-03-04T08:43:28.014 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 128/224 2024-03-04T08:43:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 119/224 2024-03-04T08:43:28.583 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 129/224 2024-03-04T08:43:28.619 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/224 2024-03-04T08:43:28.701 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 120/224 2024-03-04T08:43:28.720 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/224 2024-03-04T08:43:28.746 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/224 2024-03-04T08:43:28.804 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 121/224 2024-03-04T08:43:30.034 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 122/224 2024-03-04T08:43:30.119 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 123/224 2024-03-04T08:43:30.145 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 124/224 2024-03-04T08:43:30.456 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 125/224 2024-03-04T08:43:30.484 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/224 2024-03-04T08:43:30.556 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/224 2024-03-04T08:43:30.597 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 127/224 2024-03-04T08:43:30.633 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 128/224 2024-03-04T08:43:31.077 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 129/224 2024-03-04T08:43:31.112 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/224 2024-03-04T08:43:31.182 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/224 2024-03-04T08:43:31.205 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/224 2024-03-04T08:43:31.408 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/224 2024-03-04T08:43:31.451 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/224 2024-03-04T08:43:32.103 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/224 2024-03-04T08:43:32.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/224 2024-03-04T08:43:32.299 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/224 2024-03-04T08:43:32.299 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T08:43:32.299 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T08:43:32.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:32.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 134/224 2024-03-04T08:43:33.404 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/224 2024-03-04T08:43:33.444 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/224 2024-03-04T08:43:33.979 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/224 2024-03-04T08:43:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/224 2024-03-04T08:43:34.094 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/224 2024-03-04T08:43:34.095 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T08:43:34.095 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T08:43:34.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:34.123 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 134/224 2024-03-04T08:43:45.404 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 134/224 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-03-04T08:43:45.405 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:45.639 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 135/224 2024-03-04T08:43:45.688 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 135/224 2024-03-04T08:43:45.688 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:45.688 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T08:43:45.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/224 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 134/224 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-03-04T08:43:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/224 2024-03-04T08:43:47.437 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:47.437 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T08:43:47.437 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:43:47.437 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:43:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:47.535 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 135/224 2024-03-04T08:43:47.549 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 135/224 2024-03-04T08:43:47.549 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:47.550 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T08:43:47.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/224 2024-03-04T08:43:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/224 2024-03-04T08:43:47.871 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:47.872 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T08:43:47.872 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:43:47.872 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:43:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:48.308 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 138/224 2024-03-04T08:43:48.388 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 138/224 2024-03-04T08:43:48.389 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:48.389 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T08:43:48.389 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:43:48.389 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:43:48.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:48.531 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 139/224 2024-03-04T08:43:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/224 2024-03-04T08:43:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/224 2024-03-04T08:43:49.081 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:49.081 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T08:43:49.081 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:43:49.081 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:43:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 140/224 2024-03-04T08:43:49.170 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 140/224 2024-03-04T08:43:49.232 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 141/224 2024-03-04T08:43:49.307 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/224 2024-03-04T08:43:49.328 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/224 2024-03-04T08:43:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T08:43:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:43:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:43:49.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:49.342 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 142/224 2024-03-04T08:43:49.382 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 143/224 2024-03-04T08:43:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 143/224 2024-03-04T08:43:49.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 144/224 2024-03-04T08:43:49.774 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 138/224 2024-03-04T08:43:49.796 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 138/224 2024-03-04T08:43:49.797 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:49.797 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T08:43:49.797 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:43:49.797 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:43:49.797 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:49.893 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 139/224 2024-03-04T08:43:50.326 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 140/224 2024-03-04T08:43:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 140/224 2024-03-04T08:43:50.381 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 141/224 2024-03-04T08:43:50.442 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 142/224 2024-03-04T08:43:50.472 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 143/224 2024-03-04T08:43:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 143/224 2024-03-04T08:43:50.732 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 144/224 2024-03-04T08:43:50.920 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 144/224 2024-03-04T08:43:50.958 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 145/224 2024-03-04T08:43:51.111 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 145/224 2024-03-04T08:43:51.288 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 146/224 2024-03-04T08:43:51.349 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 147/224 2024-03-04T08:43:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 147/224 2024-03-04T08:43:51.446 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:51.446 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T08:43:51.447 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:43:51.447 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:43:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:51.502 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 148/224 2024-03-04T08:43:51.544 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 148/224 2024-03-04T08:43:51.644 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 149/224 2024-03-04T08:43:51.703 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 144/224 2024-03-04T08:43:51.732 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 145/224 2024-03-04T08:43:51.833 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 145/224 2024-03-04T08:43:51.996 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 146/224 2024-03-04T08:43:52.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 147/224 2024-03-04T08:43:52.049 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 147/224 2024-03-04T08:43:52.049 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:52.049 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T08:43:52.049 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:43:52.049 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:43:52.049 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:52.093 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 148/224 2024-03-04T08:43:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 148/224 2024-03-04T08:43:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 149/224 2024-03-04T08:43:52.658 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/224 2024-03-04T08:43:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/224 2024-03-04T08:43:52.785 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/224 2024-03-04T08:43:52.786 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:52.786 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T08:43:52.786 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:43:52.786 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:43:52.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:52.847 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 152/224 2024-03-04T08:43:52.946 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 152/224 2024-03-04T08:43:52.946 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:52.946 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T08:43:52.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:53.010 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/224 2024-03-04T08:43:53.031 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/224 2024-03-04T08:43:53.045 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/224 2024-03-04T08:43:53.067 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/224 2024-03-04T08:43:53.068 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:53.068 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T08:43:53.068 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:43:53.068 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:43:53.068 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:53.113 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 152/224 2024-03-04T08:43:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 152/224 2024-03-04T08:43:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T08:43:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:53.137 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/224 2024-03-04T08:43:53.137 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:53.137 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T08:43:53.137 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:43:53.138 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:43:53.138 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:53.188 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/224 2024-03-04T08:43:53.210 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/224 2024-03-04T08:43:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T08:43:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:43:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:43:53.211 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:53.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/224 2024-03-04T08:43:53.536 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/224 2024-03-04T08:43:53.536 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:53.536 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T08:43:53.536 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:43:53.536 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:43:53.536 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:43:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/224 2024-03-04T08:43:53.654 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/224 2024-03-04T08:43:53.654 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:43:53.654 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T08:43:53.654 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:43:53.654 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:43:53.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:43:57.977 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/224 2024-03-04T08:43:58.018 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/224 2024-03-04T08:43:58.048 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 157/224 2024-03-04T08:43:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 158/224 2024-03-04T08:43:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 159/224 2024-03-04T08:43:58.378 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 160/224 2024-03-04T08:43:58.417 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 161/224 2024-03-04T08:43:58.456 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 162/224 2024-03-04T08:43:58.518 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 163/224 2024-03-04T08:43:58.602 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 164/224 2024-03-04T08:43:58.644 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 165/224 2024-03-04T08:43:58.688 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 166/224 2024-03-04T08:43:58.720 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 167/224 2024-03-04T08:43:58.722 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/224 2024-03-04T08:43:58.749 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 168/224 2024-03-04T08:43:58.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/224 2024-03-04T08:43:58.811 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 169/224 2024-03-04T08:43:58.818 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 157/224 2024-03-04T08:43:58.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 158/224 2024-03-04T08:43:58.862 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 170/224 2024-03-04T08:43:58.905 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 171/224 2024-03-04T08:43:59.147 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 159/224 2024-03-04T08:43:59.286 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 160/224 2024-03-04T08:43:59.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 161/224 2024-03-04T08:43:59.429 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 162/224 2024-03-04T08:43:59.432 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-03-04T08:43:59.470 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 172/224 2024-03-04T08:43:59.489 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-03-04T08:43:59.496 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 163/224 2024-03-04T08:43:59.621 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 164/224 2024-03-04T08:43:59.666 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 165/224 2024-03-04T08:43:59.712 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 166/224 2024-03-04T08:43:59.743 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 167/224 2024-03-04T08:43:59.810 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 168/224 2024-03-04T08:43:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 169/224 2024-03-04T08:44:00.002 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 170/224 2024-03-04T08:44:00.050 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 171/224 2024-03-04T08:44:01.038 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-03-04T08:44:01.089 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 172/224 2024-03-04T08:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-03-04T08:44:06.625 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 173/224 2024-03-04T08:44:09.289 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 173/224 2024-03-04T08:44:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 174/224 2024-03-04T08:44:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1739.g1bc250c7.el 175/224 2024-03-04T08:44:49.358 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 176/224 2024-03-04T08:44:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 177/224 2024-03-04T08:44:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 178/224 2024-03-04T08:44:57.056 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 174/224 2024-03-04T08:44:57.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1739.g1bc250c7.el 175/224 2024-03-04T08:44:57.955 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 176/224 2024-03-04T08:45:03.621 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 177/224 2024-03-04T08:45:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 179/224 2024-03-04T08:45:06.421 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 178/224 2024-03-04T08:45:17.632 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 179/224 2024-03-04T08:45:34.226 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 180/224 2024-03-04T08:45:49.553 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 180/224 2024-03-04T08:45:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 181/224 2024-03-04T08:46:08.727 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 181/224 2024-03-04T08:46:59.273 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1739.g1bc250c7.e 182/224 2024-03-04T08:47:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 183/224 2024-03-04T08:47:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1739.g1bc250c7.el9 184/224 2024-03-04T08:47:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1739.g1bc250c7 185/224 2024-03-04T08:47:11.127 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados2-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 186/224 2024-03-04T08:47:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librbd1-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 187/224 2024-03-04T08:47:11.315 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1739.g1bc250c7 188/224 2024-03-04T08:47:11.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1739.g1bc250c7. 189/224 2024-03-04T08:47:11.517 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1739.g1bc250c7.el 190/224 2024-03-04T08:47:11.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1739.g1bc250c7.el 191/224 2024-03-04T08:47:17.166 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 192/224 2024-03-04T08:47:17.314 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1739.g1bc250c7.el9 193/224 2024-03-04T08:47:18.144 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 194/224 2024-03-04T08:47:18.209 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 195/224 2024-03-04T08:47:18.250 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 196/224 2024-03-04T08:47:18.339 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 197/224 2024-03-04T08:47:18.379 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 198/224 2024-03-04T08:47:18.413 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/224 2024-03-04T08:47:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 200/224 2024-03-04T08:47:18.465 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 201/224 2024-03-04T08:47:18.465 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-03-04T08:47:18.549 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-03-04T08:47:18.577 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 203/224 2024-03-04T08:47:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 204/224 2024-03-04T08:47:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 205/224 2024-03-04T08:47:18.675 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 205/224 2024-03-04T08:47:18.710 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 206/224 2024-03-04T08:47:18.753 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 207/224 2024-03-04T08:47:18.777 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 208/224 2024-03-04T08:47:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 209/224 2024-03-04T08:47:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 210/224 2024-03-04T08:47:18.870 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 211/224 2024-03-04T08:47:18.909 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 212/224 2024-03-04T08:47:18.942 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 213/224 2024-03-04T08:47:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 214/224 2024-03-04T08:47:18.992 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 215/224 2024-03-04T08:47:19.018 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 216/224 2024-03-04T08:47:19.043 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 217/224 2024-03-04T08:47:19.049 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-03-04T08:47:19.049 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-03-04T08:47:19.229 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-03-04T08:47:19.229 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-03-04T08:47:19.304 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-03-04T08:47:19.335 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 220/224 2024-03-04T08:47:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 221/224 2024-03-04T08:47:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 222/224 2024-03-04T08:47:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 223/224 2024-03-04T08:47:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-03-04T08:47:27.282 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1739.g1bc250c7.e 182/224 2024-03-04T08:47:27.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 183/224 2024-03-04T08:47:27.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1739.g1bc250c7.el9 184/224 2024-03-04T08:47:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 3/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1739.g1bc250c7.el 5/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_6 6/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 8/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 9/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/224 2024-03-04T08:47:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 12/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 14/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 15/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 16/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 18/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 19/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1739.g1bc250c7.e 20/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 21/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 22/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 23/224 2024-03-04T08:47:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/224 2024-03-04T08:47:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/224 2024-03-04T08:47:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 26/224 2024-03-04T08:47:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/224 2024-03-04T08:47:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1739.g1bc250c7.el9 28/224 2024-03-04T08:47:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/224 2024-03-04T08:47:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 30/224 2024-03-04T08:47:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1739.g1bc250c7 31/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 32/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 33/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 34/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 35/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 36/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 37/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 38/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1739.g1bc250c7 39/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 40/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1739.g1bc250c7. 41/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 42/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1739.g1bc250c7.el 43/224 2024-03-04T08:47:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 44/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1739.g1bc250c7.el 45/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 46/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 47/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 48/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1739.g1bc250c7.el9 49/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 50/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 51/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 52/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 53/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 54/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 55/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 56/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 57/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 58/224 2024-03-04T08:47:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 59/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 60/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 61/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/224 2024-03-04T08:47:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 75/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 81/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/224 2024-03-04T08:47:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 86/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 89/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 97/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 98/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 99/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 100/224 2024-03-04T08:47:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 101/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 102/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 104/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 107/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 108/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 109/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 110/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 112/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 113/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 114/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 115/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-16.el9.x86_64 116/224 2024-03-04T08:47:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 117/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 118/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 119/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 120/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 121/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 122/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 123/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 124/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 125/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 126/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/224 2024-03-04T08:47:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/224 2024-03-04T08:47:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 146/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/224 2024-03-04T08:47:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/224 2024-03-04T08:47:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 173/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 175/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 177/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 178/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 179/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 181/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 183/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 185/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/224 2024-03-04T08:47:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 195/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 196/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 197/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 198/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 199/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 200/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 201/224 2024-03-04T08:47:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 202/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 203/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 204/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 205/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 206/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 207/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 208/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 209/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 210/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 211/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 212/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 213/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 214/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 215/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 216/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 217/224 2024-03-04T08:47:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 218/224 2024-03-04T08:47:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 219/224 2024-03-04T08:47:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 220/224 2024-03-04T08:47:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 221/224 2024-03-04T08:47:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 222/224 2024-03-04T08:47:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 223/224 2024-03-04T08:47:31.951 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 224/224 2024-03-04T08:47:31.951 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T08:47:31.952 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-16.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T08:47:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T08:47:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T08:47:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T08:47:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T08:47:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T08:47:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:47:31.966 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-03-04T08:47:32.619 DEBUG:teuthology.parallel:result is None 2024-03-04T08:47:33.667 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1739.g1bc250c7 185/224 2024-03-04T08:47:41.491 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados2-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 186/224 2024-03-04T08:47:42.415 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librbd1-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 187/224 2024-03-04T08:47:42.530 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1739.g1bc250c7 188/224 2024-03-04T08:47:42.685 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1739.g1bc250c7. 189/224 2024-03-04T08:47:42.755 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1739.g1bc250c7.el 190/224 2024-03-04T08:47:42.840 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1739.g1bc250c7.el 191/224 2024-03-04T08:47:49.156 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 192/224 2024-03-04T08:47:49.329 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1739.g1bc250c7.el9 193/224 2024-03-04T08:47:50.673 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 194/224 2024-03-04T08:47:50.768 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 195/224 2024-03-04T08:47:50.825 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 196/224 2024-03-04T08:47:50.971 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 197/224 2024-03-04T08:47:51.022 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 198/224 2024-03-04T08:47:51.056 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/224 2024-03-04T08:47:51.090 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 200/224 2024-03-04T08:47:51.186 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 201/224 2024-03-04T08:47:51.187 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-03-04T08:47:51.322 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-03-04T08:47:51.380 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 203/224 2024-03-04T08:47:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 204/224 2024-03-04T08:47:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 205/224 2024-03-04T08:47:51.620 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 205/224 2024-03-04T08:47:51.671 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 206/224 2024-03-04T08:47:51.724 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 207/224 2024-03-04T08:47:51.763 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 208/224 2024-03-04T08:47:51.808 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 209/224 2024-03-04T08:47:51.864 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 210/224 2024-03-04T08:47:51.960 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 211/224 2024-03-04T08:47:52.036 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 212/224 2024-03-04T08:47:52.085 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 213/224 2024-03-04T08:47:52.119 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 214/224 2024-03-04T08:47:52.161 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 215/224 2024-03-04T08:47:52.203 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 216/224 2024-03-04T08:47:52.244 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 217/224 2024-03-04T08:47:52.281 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-03-04T08:47:52.281 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-03-04T08:47:54.453 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-03-04T08:47:54.454 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-03-04T08:47:54.584 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-03-04T08:47:54.653 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 220/224 2024-03-04T08:47:54.689 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 221/224 2024-03-04T08:47:54.722 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 222/224 2024-03-04T08:47:54.767 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 223/224 2024-03-04T08:47:54.932 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-03-04T08:47:55.199 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-03-04T08:47:55.199 INFO:teuthology.orchestra.run.smithi046.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-04T08:47:55.199 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/224 2024-03-04T08:48:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/224 2024-03-04T08:48:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 3/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1739.g1bc250c7.el 5/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_6 6/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 8/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 9/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 12/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 14/224 2024-03-04T08:48:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 15/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 16/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 18/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 19/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1739.g1bc250c7.e 20/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 21/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 22/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 23/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 26/224 2024-03-04T08:48:01.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/224 2024-03-04T08:48:01.979 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1739.g1bc250c7.el9 28/224 2024-03-04T08:48:01.979 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/224 2024-03-04T08:48:01.979 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 30/224 2024-03-04T08:48:01.979 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1739.g1bc250c7 31/224 2024-03-04T08:48:01.979 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-debuginfo-2:19.0.0-1739.g1bc250c7.el9. 32/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 33/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 34/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 35/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 36/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 37/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 38/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1739.g1bc250c7 39/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 40/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1739.g1bc250c7. 41/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 42/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1739.g1bc250c7.el 43/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 44/224 2024-03-04T08:48:01.980 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1739.g1bc250c7.el 45/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 46/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x 47/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 48/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1739.g1bc250c7.el9 49/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 50/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x8 51/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 52/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 53/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 54/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 55/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 56/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 57/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 58/224 2024-03-04T08:48:01.981 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 59/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 60/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 61/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/224 2024-03-04T08:48:01.982 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 75/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 81/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 86/224 2024-03-04T08:48:01.983 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 89/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/224 2024-03-04T08:48:01.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 97/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 98/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 99/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 100/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 101/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 102/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 104/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 107/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 108/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 109/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 110/224 2024-03-04T08:48:01.985 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 112/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 113/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 114/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 115/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 116/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 117/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 118/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 119/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 120/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 121/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 122/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 123/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 124/224 2024-03-04T08:48:01.986 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 125/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 126/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/224 2024-03-04T08:48:01.987 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 146/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/224 2024-03-04T08:48:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/224 2024-03-04T08:48:01.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 173/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 175/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 177/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 178/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 179/224 2024-03-04T08:48:01.990 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 181/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 183/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 185/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/224 2024-03-04T08:48:01.991 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 195/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 196/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 197/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 198/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 199/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 200/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 201/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 202/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 203/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 204/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 205/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 206/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 207/224 2024-03-04T08:48:01.992 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 208/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 209/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 210/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 211/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 212/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 213/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 214/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 215/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 216/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 217/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 218/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 219/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 220/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 221/224 2024-03-04T08:48:01.993 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 222/224 2024-03-04T08:48:01.994 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 223/224 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 224/224 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T08:48:04.920 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.921 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.922 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.924 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T08:48:04.925 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T08:48:04.926 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T08:48:04.926 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T08:48:04.926 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T08:48:04.926 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-16.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T08:48:04.927 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T08:48:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T08:48:04.929 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T08:48:04.930 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T08:48:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T08:48:04.932 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.933 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T08:48:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-debuginfo-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T08:48:04.936 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T08:48:04.937 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T08:48:04.937 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:04.937 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-03-04T08:48:06.270 DEBUG:teuthology.parallel:result is None 2024-03-04T08:48:06.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:48:06.488 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T08:48:06.742 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T08:48:06.743 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T08:48:06.743 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T08:48:06.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:48:06.962 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T08:48:06.988 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T08:48:06.988 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T08:48:06.988 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T08:48:06.990 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-04T08:48:06.991 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:06.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T08:48:07.077 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:07.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T08:48:07.111 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-04T08:48:07.112 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:07.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T08:48:07.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T08:48:07.313 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:07.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T08:48:07.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T08:48:07.409 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-04T08:48:07.409 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:07.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T08:48:07.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T08:48:07.604 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:07.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T08:48:07.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T08:48:07.697 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-04T08:48:07.697 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:07.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T08:48:07.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T08:48:07.914 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:07.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T08:48:07.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T08:48:08.007 INFO:teuthology.run_tasks:Running task ceph... 2024-03-04T08:48:08.091 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-04T08:48:08.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-03-04T08:48:08.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-03-04T08:48:08.168 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-04T08:48:08.169 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T08:48:08.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T08:48:08.244 INFO:tasks.ceph:Creating extra log directories... 2024-03-04T08:48:08.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T08:48:08.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T08:48:08.321 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-04T08:48:08.321 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-04T08:48:08.321 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-04T08:48:08.321 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:08.321 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-04T08:48:08.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-04T08:48:08.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-04T08:48:08.651 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:08.651 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-04T08:48:08.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-04T08:48:08.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-04T08:48:08.812 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-04T08:48:08.812 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-04T08:48:08.812 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793', 'branch': 'wip-lusov-qdb', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7580793', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5072, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'sleep_before_teardown': 0, 'subset': '246/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLb7Z7EPVxMPYzF/6rWPNFS9DfiAeqlcl5Y1Q6EkJIe1yFjFj/+sf0mUP/7vvnFxPebkOnRqzY1AxeeEll4KJfE=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrqS1ehcIsnNv6RY6quTF0fMMAA5EcU54XZW/hflhW5HB5E4ECzFDA0eaVoDl9UJDaYVa58vro8uy76Yy5sQ74='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-03-04_07:05:03', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-04T08:48:08.813 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T08:48:08.818 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T08:48:08.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T08:48:08.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T08:48:08.975 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:08.975 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T08:48:09.013 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T08:48:09.013 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-03-04T08:48:09.095 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T08:48:09.095 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 769 Links: 1 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-04 08:47:55.638803567 +0000 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-04 08:37:48.842837990 +0000 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-04 08:37:48.842837990 +0000 2024-03-04T08:48:09.096 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-04 08:37:48.842837990 +0000 2024-03-04T08:48:09.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T08:48:09.206 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-04T08:48:09.206 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-04T08:48:09.206 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000281574 s, 1.8 MB/s 2024-03-04T08:48:09.209 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T08:48:09.250 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 791 Links: 1 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-04 08:47:55.639803556 +0000 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-04 08:37:49.422831593 +0000 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-04 08:37:49.422831593 +0000 2024-03-04T08:48:09.337 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-04 08:37:49.422831593 +0000 2024-03-04T08:48:09.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T08:48:09.469 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-04T08:48:09.470 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-04T08:48:09.470 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000260808 s, 2.0 MB/s 2024-03-04T08:48:09.474 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T08:48:09.527 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-03-04T08:48:09.575 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 807 Links: 1 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-04 08:47:55.640803545 +0000 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-04 08:37:50.001825208 +0000 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-04 08:37:50.001825208 +0000 2024-03-04T08:48:09.576 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-04 08:37:50.001825208 +0000 2024-03-04T08:48:09.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T08:48:09.665 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-04T08:48:09.666 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-04T08:48:09.666 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000267944 s, 1.9 MB/s 2024-03-04T08:48:09.672 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T08:48:09.730 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-03-04T08:48:09.778 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T08:48:09.778 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 827 Links: 1 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-04 08:47:55.641803534 +0000 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-04 08:37:50.584818779 +0000 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-04 08:37:50.584818779 +0000 2024-03-04T08:48:09.779 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-04 08:37:50.584818779 +0000 2024-03-04T08:48:09.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T08:48:09.867 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-04T08:48:09.867 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-04T08:48:09.867 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000243245 s, 2.1 MB/s 2024-03-04T08:48:09.871 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T08:48:09.931 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:09.931 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:09.931 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T08:48:09.949 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T08:48:09.950 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-03-04T08:48:10.007 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T08:48:10.007 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:10.007 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-03-04T08:48:10.007 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:10.007 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:10.007 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-04 08:47:19.805414446 +0000 2024-03-04T08:48:10.008 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-04 08:36:27.215190231 +0000 2024-03-04T08:48:10.008 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-04 08:36:27.215190231 +0000 2024-03-04T08:48:10.008 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-04 08:36:27.215190231 +0000 2024-03-04T08:48:10.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T08:48:10.077 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-04T08:48:10.077 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-04T08:48:10.077 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000196043 s, 2.6 MB/s 2024-03-04T08:48:10.078 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T08:48:10.136 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-04 08:47:19.806414423 +0000 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-04 08:36:27.546182041 +0000 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-04 08:36:27.546182041 +0000 2024-03-04T08:48:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-04 08:36:27.546182041 +0000 2024-03-04T08:48:10.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T08:48:10.260 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-04T08:48:10.260 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-04T08:48:10.260 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000183708 s, 2.8 MB/s 2024-03-04T08:48:10.261 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T08:48:10.318 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-03-04T08:48:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 698 Links: 1 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-04 08:47:19.806414423 +0000 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-04 08:36:27.901173258 +0000 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-04 08:36:27.901173258 +0000 2024-03-04T08:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-04 08:36:27.901173258 +0000 2024-03-04T08:48:10.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T08:48:10.440 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-04T08:48:10.441 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-04T08:48:10.441 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000207236 s, 2.5 MB/s 2024-03-04T08:48:10.443 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T08:48:10.498 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-03-04T08:48:10.553 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 717 Links: 1 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-04 08:47:19.806414423 +0000 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-04 08:36:28.248164672 +0000 2024-03-04T08:48:10.554 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-04 08:36:28.248164672 +0000 2024-03-04T08:48:10.555 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-04 08:36:28.248164672 +0000 2024-03-04T08:48:10.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T08:48:10.620 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-04T08:48:10.624 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-04T08:48:10.624 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000189488 s, 2.7 MB/s 2024-03-04T08:48:10.625 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T08:48:10.681 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:10.681 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T08:48:10.682 INFO:tasks.ceph:Generating config... 2024-03-04T08:48:10.683 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-04T08:48:10.683 INFO:tasks.ceph:[client] debug client = 20 2024-03-04T08:48:10.683 INFO:tasks.ceph:[client] debug ms = 1 2024-03-04T08:48:10.683 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-04T08:48:10.683 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-04T08:48:10.683 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-03-04T08:48:10.683 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-03-04T08:48:10.683 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-04T08:48:10.683 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-03-04T08:48:10.683 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-04T08:48:10.684 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-04T08:48:10.685 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-04T08:48:10.685 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-04T08:48:10.685 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-04T08:48:10.685 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-04T08:48:10.686 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-04T08:48:10.686 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-04T08:48:10.686 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-03-04T08:48:10.686 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-04T08:48:10.686 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-04T08:48:10.686 INFO:tasks.ceph:Setting up mon.a... 2024-03-04T08:48:10.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-04T08:48:10.833 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-03-04T08:48:10.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-04T08:48:10.978 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T08:48:11.076 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.73'), ('mon.c', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]')] 2024-03-04T08:48:11.076 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-04T08:48:11.077 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:11.077 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T08:48:11.132 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.73 --addv c '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:11.289 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:11.289 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid bc679561-c3d1-42a9-8f4c-6c87fdde4dff 2024-03-04T08:48:11.289 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:fsid bc679561-c3d1-42a9-8f4c-6c87fdde4dff 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-03-04T08:48:11.294233+0000 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-03-04T08:48:11.294233+0000 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-03-04T08:48:11.290 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-04T08:48:11.293 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T08:48:11.346 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bc679561-c3d1-42a9-8f4c-6c87fdde4dff... 2024-03-04T08:48:11.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T08:48:11.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T08:48:11.407 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-03-04T08:48:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-03-04T08:48:11.409 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-03-04T08:48:11.410 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: mds beacon grace = 60 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: mds heartbeat grace = 60 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: osd heartbeat grace = 60 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = bc679561-c3d1-42a9-8f4c-6c87fdde4dff 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.411 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.412 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-03-04T08:48:11.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.413 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-03-04T08:48:11.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.413 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-03-04T08:48:11.413 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-03-04T08:48:11.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-03-04T08:48:11.418 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: osd fast shutdown = False 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-03-04T08:48:11.419 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T08:48:11.420 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd crush smoke test = False 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-03-04T08:48:11.421 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-03-04T08:48:11.422 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: mds valgrind exit = True 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-04T08:48:11.423 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-04T08:48:11.424 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.526 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T08:48:11.527 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-03-04T08:48:11.528 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-03-04T08:48:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: mds beacon grace = 60 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: mds heartbeat grace = 60 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on skipped message = False 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: osd heartbeat grace = 60 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = bc679561-c3d1-42a9-8f4c-6c87fdde4dff 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-03-04T08:48:11.530 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.531 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-03-04T08:48:11.532 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: osd fast shutdown = False 2024-03-04T08:48:11.533 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-03-04T08:48:11.534 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T08:48:11.535 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd crush smoke test = False 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-03-04T08:48:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-03-04T08:48:11.537 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-03-04T08:48:11.538 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-03-04T08:48:11.538 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-03-04T08:48:11.538 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-03-04T08:48:11.538 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-03-04T08:48:11.538 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-04T08:48:11.538 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: mds valgrind exit = True 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-03-04T08:48:11.539 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-03-04T08:48:11.575 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-04T08:48:11.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-04T08:48:11.720 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-04T08:48:11.720 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:11.720 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-04T08:48:11.792 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:11.792 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-04T08:48:11.844 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T08:48:11.844 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:11.844 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T08:48:11.844 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T08:48:11.999 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:12.000 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:12.062 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T08:48:12.062 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:12.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T08:48:12.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T08:48:12.112 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:12.112 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:12.171 INFO:tasks.ceph:Setting up mon nodes... 2024-03-04T08:48:12.171 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-04T08:48:12.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T08:48:12.369 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T08:48:12.380 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T08:48:12.466 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T08:48:12.468 INFO:tasks.ceph:Setting up mds nodes... 2024-03-04T08:48:12.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-04T08:48:12.664 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-04T08:48:12.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-04T08:48:12.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-04T08:48:12.971 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-04T08:48:12.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-04T08:48:13.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-04T08:48:13.271 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-04T08:48:13.281 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-04T08:48:13.380 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-04T08:48:13.442 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-04T08:48:13.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-04T08:48:13.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-04T08:48:13.570 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-04T08:48:13.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-04T08:48:13.600 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-03-04T08:48:13.694 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-03-04T08:48:13.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-03-04T08:48:13.722 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-04T08:48:13.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-04T08:48:13.858 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-04T08:48:13.919 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-04T08:48:13.920 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T08:48:13.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-04T08:48:14.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:14.025 INFO:tasks.ceph:role: osd.0 2024-03-04T08:48:14.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T08:48:14.025 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T08:48:14.123 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:14.123 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:14.123 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:14.123 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:14.123 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:14.124 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:14.124 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:14.124 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:14.124 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:14.124 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:14.157 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-04T08:48:14.164 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-04T08:48:14.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-04T08:48:14.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-04T08:48:14.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-04T08:48:14.462 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:14.462 INFO:tasks.ceph:role: osd.1 2024-03-04T08:48:14.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T08:48:14.463 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:14.546 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:14.580 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-04T08:48:14.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-04T08:48:14.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-04T08:48:14.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-04T08:48:14.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-04T08:48:14.857 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:14.857 INFO:tasks.ceph:role: osd.2 2024-03-04T08:48:14.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T08:48:14.857 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T08:48:14.931 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:14.931 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:14.931 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:14.931 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:14.931 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:14.931 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:14.932 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:14.932 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:14.932 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:14.932 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:14.965 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-04T08:48:14.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-04T08:48:14.971 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-04T08:48:15.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-04T08:48:15.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-04T08:48:15.251 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:15.251 INFO:tasks.ceph:role: osd.3 2024-03-04T08:48:15.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T08:48:15.251 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:15.372 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-04T08:48:15.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-04T08:48:15.377 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-04T08:48:15.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-04T08:48:15.549 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:15.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:15.693+0000 7f3f0e0f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-04T08:48:15.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:15.693+0000 7f3f0e0f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-04T08:48:15.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:15.694+0000 7f3f0e0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T08:48:15.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:15.694+0000 7f3f0e0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T08:48:15.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:15.694+0000 7f3f0e0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T08:48:15.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:15.697+0000 7f3f0e0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-04T08:48:18.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T08:48:18.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:19.124+0000 7f322f813640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-04T08:48:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:19.124+0000 7f322f813640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-04T08:48:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:19.124+0000 7f322f813640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T08:48:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:19.125+0000 7f322f813640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T08:48:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:19.125+0000 7f322f813640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T08:48:19.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:19.127+0000 7f322f813640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-04T08:48:22.289 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T08:48:22.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:22.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:22.540+0000 7fa2cc20c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-04T08:48:22.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:22.540+0000 7fa2cc20c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-04T08:48:22.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:22.540+0000 7fa2cc20c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T08:48:22.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:22.540+0000 7fa2cc20c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T08:48:22.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:22.540+0000 7fa2cc20c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T08:48:22.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:22.542+0000 7fa2cc20c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-04T08:48:25.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T08:48:25.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:25.725+0000 7f485fa17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-04T08:48:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:25.726+0000 7f485fa17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-04T08:48:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:25.726+0000 7f485fa17640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T08:48:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:25.726+0000 7f485fa17640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T08:48:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:25.726+0000 7f485fa17640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T08:48:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:25.728+0000 7f485fa17640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-04T08:48:28.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T08:48:28.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-04T08:48:28.786 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:28.787 INFO:tasks.ceph:role: osd.4 2024-03-04T08:48:28.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T08:48:28.787 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:28.864 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-04T08:48:29.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-04T08:48:29.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-04T08:48:29.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-04T08:48:29.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-04T08:48:29.608 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:29.608 INFO:tasks.ceph:role: osd.5 2024-03-04T08:48:29.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T08:48:29.608 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:29.684 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:30.137 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-04T08:48:30.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-04T08:48:30.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-04T08:48:30.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-04T08:48:30.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-04T08:48:30.667 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:30.667 INFO:tasks.ceph:role: osd.6 2024-03-04T08:48:30.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T08:48:30.668 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T08:48:30.750 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:30.750 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:30.751 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:31.270 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-04T08:48:31.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-04T08:48:31.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-04T08:48:31.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-04T08:48:31.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-04T08:48:31.549 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:48:31.549 INFO:tasks.ceph:role: osd.7 2024-03-04T08:48:31.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T08:48:31.549 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T08:48:31.625 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:48:31.626 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:48:32.100 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-04T08:48:32.104 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-04T08:48:32.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-04T08:48:32.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-04T08:48:32.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:32.354+0000 7f4f31e1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-04T08:48:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:32.355+0000 7f4f31e1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-04T08:48:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:32.355+0000 7f4f31e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T08:48:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:32.355+0000 7f4f31e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T08:48:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:32.355+0000 7f4f31e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T08:48:32.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:32.357+0000 7f4f31e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-04T08:48:35.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T08:48:35.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:35.326+0000 7f0b11e66640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-04T08:48:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:35.326+0000 7f0b11e66640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-04T08:48:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:35.326+0000 7f0b11e66640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T08:48:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:35.326+0000 7f0b11e66640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T08:48:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:35.326+0000 7f0b11e66640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T08:48:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:35.327+0000 7f0b11e66640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-04T08:48:38.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T08:48:38.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:38.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:38.284+0000 7fe53c2ae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-04T08:48:38.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:38.285+0000 7fe53c2ae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-04T08:48:38.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:38.285+0000 7fe53c2ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T08:48:38.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:38.285+0000 7fe53c2ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T08:48:38.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:38.285+0000 7fe53c2ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T08:48:38.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:38.285+0000 7fe53c2ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-04T08:48:38.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:48:38.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:48:41.135 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T08:48:41.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:41.261+0000 7fea41620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-04T08:48:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:41.262+0000 7fea41620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-04T08:48:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:41.262+0000 7fea41620640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T08:48:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:41.262+0000 7fea41620640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T08:48:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:41.262+0000 7fea41620640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T08:48:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:48:41.262+0000 7fea41620640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-04T08:48:44.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T08:48:44.150 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-04T08:48:44.151 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-04T08:48:44.256 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.256 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-04T08:48:44.359 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-04T08:48:44.464 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-04T08:48:44.568 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-04T08:48:44.669 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-04T08:48:44.773 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-04T08:48:44.877 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:44.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-04T08:48:44.977 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:44.977 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-04T08:48:45.009 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-04T08:48:45.079 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-04T08:48:45.150 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-03-04T08:48:45.220 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-04T08:48:45.289 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-04T08:48:45.358 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-04T08:48:45.427 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:48:45.427 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-04T08:48:45.494 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:48:45.494 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-04T08:48:45.554 INFO:tasks.ceph:Adding keys to all mons... 2024-03-04T08:48:45.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T08:48:45.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDMiuVlxVVKFhAA6AYxWLISjldJghibr1Rs7Q== 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDMiuVlvYngJxAAPprHZd/P1KWJpot43ooKsQ== 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDMiuVlloUxOhAAzHTGWOIs7711PNPcXRBO8g== 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDNiuVlinV2EBAAHwFkdH17hJMTGqsI3aliIQ== 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDPiuVlXQBgKRAA41DiCwk3MhgNuhMqcm9yKg== 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-03-04T08:48:45.587 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDTiuVlLzh4BxAAOu5e6ESVYZJ2eW2u+368WQ== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDWiuVluqo/IBAAGt8fcX405A4EHJEuDiedGQ== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDZiuVl7uBJKxAAd2/ayHzOLCCe+96IP7wbEg== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDMiuVl5XgOHBAAAqd2eFTvhaOIuugMBzxbfA== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDNiuVlB/mmGhAAurAE5otpEgWVmajeSiotXQ== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDNiuVlDPhOIhAAhnE5tCxJtn/bAB1CUEmU1A== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDNiuVlIgOqKRAAnXNFrdu/pv8Myh5GS5ALeA== 2024-03-04T08:48:45.588 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDgiuVlk480FRAAETT6MF/+O95ld3eqTiweMg== 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDjiuVlliWKExAADJ8O4TmmeL6rfjrRkS8R/A== 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDmiuVlg4QOERAA9GGBqqGxjsoFlUV5nAFhpQ== 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDpiuVl2WSvDxAAqpL5e81Tuo0TIN4RbzdrAA== 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-03-04T08:48:45.589 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDNiuVloRp4MxAAGG0EMlFx9qzKv/TSqrJJ8w== 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDMiuVlxVVKFhAA6AYxWLISjldJghibr1Rs7Q== 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDMiuVlvYngJxAAPprHZd/P1KWJpot43ooKsQ== 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDMiuVlloUxOhAAzHTGWOIs7711PNPcXRBO8g== 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDNiuVlinV2EBAAHwFkdH17hJMTGqsI3aliIQ== 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDPiuVlXQBgKRAA41DiCwk3MhgNuhMqcm9yKg== 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-03-04T08:48:45.650 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDTiuVlLzh4BxAAOu5e6ESVYZJ2eW2u+368WQ== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDWiuVluqo/IBAAGt8fcX405A4EHJEuDiedGQ== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDZiuVl7uBJKxAAd2/ayHzOLCCe+96IP7wbEg== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDMiuVl5XgOHBAAAqd2eFTvhaOIuugMBzxbfA== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDNiuVlB/mmGhAAurAE5otpEgWVmajeSiotXQ== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDNiuVlDPhOIhAAhnE5tCxJtn/bAB1CUEmU1A== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDNiuVlIgOqKRAAnXNFrdu/pv8Myh5GS5ALeA== 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-03-04T08:48:45.651 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDgiuVlk480FRAAETT6MF/+O95ld3eqTiweMg== 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDjiuVlliWKExAADJ8O4TmmeL6rfjrRkS8R/A== 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDmiuVlg4QOERAA9GGBqqGxjsoFlUV5nAFhpQ== 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDpiuVl2WSvDxAAqpL5e81Tuo0TIN4RbzdrAA== 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-03-04T08:48:45.652 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDNiuVloRp4MxAAGG0EMlFx9qzKv/TSqrJJ8w== 2024-03-04T08:48:45.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:48:45.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:48:45.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:45.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:45.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:45.960 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:46.108 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:46.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:46.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:46.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:48:46.864 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:48:47.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:47.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:47.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:47.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:47.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:47.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:48:47.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:47.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:48:48.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:48:48.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:48:48.215 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-04T08:48:48.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-04T08:48:48.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T08:48:48.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-04T08:48:48.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-04T08:48:48.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T08:48:48.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-04T08:48:48.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-04T08:48:48.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T08:48:48.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-04T08:48:48.915 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:48.923 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:48:48.976 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-04T08:48:48.977 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-04T08:48:48.977 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-04T08:48:48.977 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-03-04T08:48:48.984 INFO:tasks.ceph.mon.a:Started 2024-03-04T08:48:48.984 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-04T08:48:48.984 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-04T08:48:48.984 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-03-04T08:48:49.012 INFO:tasks.ceph.mon.b:Started 2024-03-04T08:48:49.012 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-04T08:48:49.012 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-04T08:48:49.012 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-03-04T08:48:49.014 INFO:tasks.ceph.mon.c:Started 2024-03-04T08:48:49.014 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-04T08:48:49.015 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-04T08:48:49.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-03-04T08:48:49.020 INFO:tasks.ceph.mgr.y:Started 2024-03-04T08:48:49.020 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-04T08:48:49.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-03-04T08:48:49.022 INFO:tasks.ceph.mgr.x:Started 2024-03-04T08:48:49.022 INFO:tasks.ceph:Setting crush tunables to default 2024-03-04T08:48:49.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-03-04T08:48:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.208+0000 7f271fe00640 1 Processor -- start 2024-03-04T08:48:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.208+0000 7f271fe00640 1 -- start start 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.209+0000 7f271fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 0x7f271815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 0x7f27180caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271fe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180cc660 con 0x7f27180b28a0 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271fe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cd540 con 0x7f27180cab40 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cbf90 con 0x7f27180cd0d0 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271d400640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 msgr2=0x7f271815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 0x7f271815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271de00640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f27180cb880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271ca00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 msgr2=0x7f27180caf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-04T08:48:49.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.210+0000 7f271ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 0x7f27180caf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:48:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.411+0000 7f271de00640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f27180cb880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.411+0000 7f271d400640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 msgr2=0x7f271815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.411+0000 7f271d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 0x7f271815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:48:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.411+0000 7f271ca00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 msgr2=0x7f27180caf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-04T08:48:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.411+0000 7f271ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 0x7f27180caf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:48:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.812+0000 7f271de00640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f27180cb880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.812+0000 7f271d400640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 msgr2=0x7f271815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.812+0000 7f271ca00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 msgr2=0x7f27180caf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-04T08:48:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.812+0000 7f271d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 0x7f271815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:48:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:49.812+0000 7f271ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 0x7f27180caf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:48:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:50.613+0000 7f271de00640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f27180cb880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:50.613+0000 7f271d400640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 msgr2=0x7f271815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:50.613+0000 7f271d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 0x7f271815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:48:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:50.613+0000 7f271ca00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 msgr2=0x7f27180caf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-04T08:48:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:50.613+0000 7f271ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 0x7f27180caf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 msgr2=0x7f27180caf20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27180cd0d0 0x7f27180caf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 msgr2=0x7f271815a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27180cab40 0x7f271815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f27180cb880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 0x7f26f80097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180b3000 con 0x7f26f8003690 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f2716a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180cd540 con 0x7f26f80072e0 2024-03-04T08:48:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f271d400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8003690 legacy=0x7f26f8005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f271ca00640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-03-04T08:48:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.210+0000 7f271ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:48:52.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.411+0000 7f271d400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8003690 legacy=0x7f26f8005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:52.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.411+0000 7f271ca00640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-03-04T08:48:52.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.411+0000 7f271ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:48:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.812+0000 7f271d400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8003690 legacy=0x7f26f8005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:52.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.812+0000 7f271ca00640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-03-04T08:48:52.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:52.812+0000 7f271ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:48:53.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:53.613+0000 7f271d400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8003690 legacy=0x7f26f8005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:53.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:53.613+0000 7f271ca00640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-03-04T08:48:53.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:53.613+0000 7f271ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.210+0000 7f2716a00640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.210+0000 7f2716a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80072e0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.210+0000 7f2716a00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8003690 legacy=0x7f26f8005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.210+0000 7f271de00640 1 -- reap_dead start 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f2716a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 0x7f26f80097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f2716a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180cc660 con 0x7f27180b28a0 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f2716a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180b3000 con 0x7f26f8006240 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f2716a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cd540 con 0x7f26f800a5a0 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f271d400640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f271ca00640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f271de00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8006240 legacy=0x7f26f8005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:55.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.211+0000 7f271ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:48:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.412+0000 7f271de00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8006240 legacy=0x7f26f8005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.412+0000 7f271d400640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.412+0000 7f271ca00640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.412+0000 7f271ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:48:55.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.813+0000 7f271d400640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:55.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.813+0000 7f271ca00640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:55.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.813+0000 7f271de00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8006240 legacy=0x7f26f8005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:55.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:55.813+0000 7f271ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:48:56.223 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:00:07.094 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T08:48:56.225 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:00:07.097 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T08:48:56.545 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:00:07.416 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T08:48:56.548 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:00:07.419 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T08:48:56.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:56.614+0000 7f271d400640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-03-04T08:48:56.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:56.614+0000 7f271ca00640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-03-04T08:48:56.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:56.614+0000 7f271de00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8006240 legacy=0x7f26f8005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-04T08:48:56.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:56.614+0000 7f271ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:48:57.230 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:08.037 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T08:48:57.567 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:08.375 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T08:48:58.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:58.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f26f800a5a0 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:48:58.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f26f8006240 legacy=0x7f26f8005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:58.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f27180b28a0 legacy=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:48:58.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:48:58.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:48:58.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cd540 con 0x7f26f8006770 2024-03-04T08:48:58.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.211+0000 7f2716a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180cbf90 con 0x7f26f80110d0 2024-03-04T08:48:58.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.212+0000 7f271d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:58.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.213+0000 7f271d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56448/0 (socket says 172.21.15.46:56448) 2024-03-04T08:48:58.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.213+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 learned_addr learned my addr 172.21.15.46:0/3799267073 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:48:58.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.230+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:48:58.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.230+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:58.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.230+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:58.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.230+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:48:58.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.238+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:58.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.259+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-04T08:48:58.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.259+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:58.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.259+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:58.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.259+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:48:58.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.629+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:58.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.630+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:48:58.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.630+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:58.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.630+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:58.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.630+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:48:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.663+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.674+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-04T08:48:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.674+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.674+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:58.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:58.674+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:48:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.141+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.142+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:48:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.142+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.142+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.142+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:48:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.145+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.148+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-04T08:48:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.148+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.148+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.148+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:48:59.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.944+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:59.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.945+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:48:59.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.946+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:59.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.946+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:59.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.946+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:48:59.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.949+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:48:59.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.950+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:48:59.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.950+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:48:59.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.950+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:48:59.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:48:59.950+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.211+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.211+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 msgr2=0x7f26f8006b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006770 0x7f26f8006b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 reap_dead start 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:01.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:01.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cd540 con 0x7f26f8006c10 2024-03-04T08:49:01.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cbf90 con 0x7f26f8006240 2024-03-04T08:49:01.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8005a80 con 0x7f26f80110d0 2024-03-04T08:49:01.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.225+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:01.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.225+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:01.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:01.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:01.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:01.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:49:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-04T08:49:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.226+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.227+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:49:01.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.428+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.428+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.429+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:49:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.831+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.831+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:49:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-04T08:49:01.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:01.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:01.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:01.832+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:49:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.011+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:02.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.077+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-04T08:49:02.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.077+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:02.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.077+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:02.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.077+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:49:02.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.360+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.397+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.397+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.397+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.397+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T08:49:02.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.634+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:02.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.634+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:02.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:02.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:02.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:02.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:49:02.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-04T08:49:02.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271ca00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:02.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:02.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.635+0000 7f271ca00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:49:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.884+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:02.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.900+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:02.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.900+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:02.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.900+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:02.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:02.900+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T08:49:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:03.747+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:03.818+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-04T08:49:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:03.818+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:49:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:03.818+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:49:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:03.818+0000 7f271de00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T08:49:04.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 msgr2=0x7f26f80134c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:49:04.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26f80110d0 0x7f26f80134c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 msgr2=0x7f26f80097a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:49:04.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.73:3300/0 conn(0x7f26f8006240 0x7f26f80097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 msgr2=0x7f26f8009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:49:04.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 --2- 172.21.15.46:0/3799267073 >> v2:172.21.15.46:3300/0 conn(0x7f26f8006c10 0x7f26f8009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f800ac40 con 0x7f26f8005d50 2024-03-04T08:49:04.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.212+0000 7f2716a00640 1 -- 172.21.15.46:0/3799267073 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180cc660 con 0x7f26f800e7c0 2024-03-04T08:49:04.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.306+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106158099 0 0) 0x7f27180cc660 con 0x7f26f800e7c0 2024-03-04T08:49:04.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.306+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2700003520 con 0x7f26f800e7c0 2024-03-04T08:49:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.412+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714278596 0 0) 0x7f26f800ac40 con 0x7f26f8005d50 2024-03-04T08:49:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.412+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27180cc660 con 0x7f26f8005d50 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298216805 0 0) 0x7f2700003520 con 0x7f26f800e7c0 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 >> v1:172.21.15.46:6789/0 conn(0x7f26f8005d50 legacy=0x7f26f800d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180b3000 con 0x7f26f800e7c0 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2826336207 0 0) 0x7f2704003e60 con 0x7f26f800e7c0 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 >> v1:172.21.15.73:6789/0 conn(0x7f26f800e7c0 legacy=0x7f26f8013c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f271de00640 1 -- 172.21.15.46:0/3799267073 reap_dead start 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700003b40 0x7f2700003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700004800 0x7f2700004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 0x7f270000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270000c220 con 0x7f2700004800 2024-03-04T08:49:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270000c3d0 con 0x7f27000053c0 2024-03-04T08:49:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.576+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270000c5d0 con 0x7f2700003b40 2024-03-04T08:49:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.578+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700003b40 0x7f2700003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.589+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 msgr2=0x7f270000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.589+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 0x7f270000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.589+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700004800 msgr2=0x7f2700004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.589+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700004800 0x7f2700004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.589+0000 7f271d400640 1 -- 172.21.15.46:0/3799267073 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700003520 con 0x7f2700003b40 2024-03-04T08:49:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.592+0000 7f271d400640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700003b40 0x7f2700003f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f270c003b10 tx=0x7f2700005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5993ef8e9886671 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:04.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.597+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c03b070 con 0x7f2700003b40 2024-03-04T08:49:04.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.597+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c036410 con 0x7f2700003b40 2024-03-04T08:49:04.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.597+0000 7f2717e00640 1 -- 172.21.15.46:0/3799267073 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0099c0 con 0x7f2700003b40 2024-03-04T08:49:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 -- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700003b40 msgr2=0x7f2700003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700003b40 0x7f2700003f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f270c003b10 tx=0x7f2700005830 comp rx=0 tx=0).stop 2024-03-04T08:49:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 -- 172.21.15.46:0/3799267073 shutdown_connections 2024-03-04T08:49:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 0x7f270000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700004800 0x7f2700004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 --2- 172.21.15.46:0/3799267073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700003b40 0x7f2700003f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.598+0000 7f271fe00640 1 -- 172.21.15.46:0/3799267073 >> 172.21.15.46:0/3799267073 conn(0x7f271808bfa0 msgr2=0x7f271808c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:04.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.599+0000 7f271fe00640 1 -- 172.21.15.46:0/3799267073 shutdown_connections 2024-03-04T08:49:04.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.599+0000 7f271fe00640 1 -- 172.21.15.46:0/3799267073 wait complete. 2024-03-04T08:49:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.604+0000 7f271fe00640 1 Processor -- start 2024-03-04T08:49:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.605+0000 7f271fe00640 1 -- start start 2024-03-04T08:49:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.607+0000 7f271fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700003b40 0x7f271814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.607+0000 7f271fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 0x7f271814ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.607+0000 7f271fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 0x7f271814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.607+0000 7f271fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180cc8d0 con 0x7f2700003b40 2024-03-04T08:49:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.607+0000 7f271fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b35c0 con 0x7f27000053c0 2024-03-04T08:49:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.607+0000 7f271fe00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180ccbb0 con 0x7f2700004800 2024-03-04T08:49:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.608+0000 7f271ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 0x7f271814ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.608+0000 7f271ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 0x7f271814ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55350/0 (socket says 172.21.15.46:55350) 2024-03-04T08:49:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.608+0000 7f271ca00640 1 -- 172.21.15.46:0/3671038840 learned_addr learned my addr 172.21.15.46:0/3671038840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.612+0000 7f271ca00640 1 -- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 msgr2=0x7f271814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.612+0000 7f271ca00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 0x7f271814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.612+0000 7f271ca00640 1 -- 172.21.15.46:0/3671038840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700003b40 msgr2=0x7f271814f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.612+0000 7f271ca00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700003b40 0x7f271814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.612+0000 7f271ca00640 1 -- 172.21.15.46:0/3671038840 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718157cb0 con 0x7f2700004800 2024-03-04T08:49:04.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.616+0000 7f271ca00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 0x7f271814ab10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2704000ea0 tx=0x7f270400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.620+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270401c020 con 0x7f2700004800 2024-03-04T08:49:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.620+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400bc80 con 0x7f2700004800 2024-03-04T08:49:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.620+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704018690 con 0x7f2700004800 2024-03-04T08:49:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.620+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2718154f40 con 0x7f2700004800 2024-03-04T08:49:04.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.620+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27181554c0 con 0x7f2700004800 2024-03-04T08:49:04.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.622+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180680b0 con 0x7f2700004800 2024-03-04T08:49:04.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.625+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f270401f020 con 0x7f2700004800 2024-03-04T08:49:04.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.625+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f270400cc40 con 0x7f2700004800 2024-03-04T08:49:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.804+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2704026030 con 0x7f2700004800 2024-03-04T08:49:04.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:04.905+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f27180cb660 con 0x7f2700004800 2024-03-04T08:49:04.980 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:04.983+0000 7fad4a23a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T08:49:05.033 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.036+0000 7fad4a23a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T08:49:05.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.288+0000 7f2715600640 1 -- 172.21.15.46:0/3671038840 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2704013040 con 0x7f2700004800 2024-03-04T08:49:05.285 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-03-04T08:49:05.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.290+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 msgr2=0x7f271814ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:05.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.290+0000 7f271fe00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 0x7f271814ab10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2704000ea0 tx=0x7f270400ef10 comp rx=0 tx=0).stop 2024-03-04T08:49:05.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 shutdown_connections 2024-03-04T08:49:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27000053c0 0x7f271814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2700004800 0x7f271814ab10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 --2- 172.21.15.46:0/3671038840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2700003b40 0x7f271814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 >> 172.21.15.46:0/3671038840 conn(0x7f271808bfa0 msgr2=0x7f27180c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 shutdown_connections 2024-03-04T08:49:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:05.291+0000 7f271fe00640 1 -- 172.21.15.46:0/3671038840 wait complete. 2024-03-04T08:49:05.313 INFO:tasks.ceph:check_enable_crimson: False 2024-03-04T08:49:05.313 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-04T08:49:05.313 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:49:05.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-04T08:49:05.402 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:49:05.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-04T08:49:05.404 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:05.408+0000 7f7d4b020040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T08:49:05.476 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:05.479+0000 7f7d4b020040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T08:49:05.495 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:49:05.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-04T08:49:05.544 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.548+0000 7fad4a23a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T08:49:05.587 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:49:05.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-04T08:49:05.599 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.602+0000 7fad4a23a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T08:49:05.645 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.648+0000 7fad4a23a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T08:49:05.672 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:49:05.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-04T08:49:05.700 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:49:05.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-04T08:49:05.700 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.703+0000 7fad4a23a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T08:49:05.743 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.747+0000 7fad4a23a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T08:49:05.767 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:49:05.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-04T08:49:05.833 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-04T08:49:05.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-04T08:49:05.865 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.869+0000 7fad4a23a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T08:49:05.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new c2ab089f-ff10-45c7-bf37-a14a618a6742 0 2024-03-04T08:49:05.959 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:05.962+0000 7fad4a23a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T08:49:06.008 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.011+0000 7fad4a23a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T08:49:06.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 Processor -- start 2024-03-04T08:49:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 -- start start 2024-03-04T08:49:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1998154750 0x7f19980cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 0x7f19980ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19980ca6d0 con 0x7f19980ce650 2024-03-04T08:49:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19980ca990 con 0x7f1998154750 2024-03-04T08:49:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.038+0000 7f199d4b5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980cac70 con 0x7f1998154b30 2024-03-04T08:49:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.039+0000 7f19967fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 0x7f19980ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.039+0000 7f1996ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1998154750 0x7f19980cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.039+0000 7f19967fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 0x7f19980ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47774/0 (socket says 172.21.15.73:47774) 2024-03-04T08:49:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.039+0000 7f19967fc640 1 -- 172.21.15.73:0/1505232275 learned_addr learned my addr 172.21.15.73:0/1505232275 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.041+0000 7f19967fc640 1 -- 172.21.15.73:0/1505232275 >> v2:172.21.15.73:3300/0 conn(0x7f1998154750 msgr2=0x7f19980cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.041+0000 7f19967fc640 1 --2- 172.21.15.73:0/1505232275 >> v2:172.21.15.73:3300/0 conn(0x7f1998154750 0x7f19980cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.041+0000 7f19967fc640 1 -- 172.21.15.73:0/1505232275 >> v1:172.21.15.46:6789/0 conn(0x7f19980ce650 legacy=0x7f19980cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.041+0000 7f19967fc640 1 -- 172.21.15.73:0/1505232275 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199815a900 con 0x7f1998154b30 2024-03-04T08:49:06.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.043+0000 7f19967fc640 1 --2- 172.21.15.73:0/1505232275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 0x7f19980ce110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f198c009870 tx=0x7f198c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c2144eae7ea5dc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:06.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.047+0000 7f1995ffb640 1 -- 172.21.15.73:0/1505232275 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c034070 con 0x7f1998154b30 2024-03-04T08:49:06.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.047+0000 7f1995ffb640 1 -- 172.21.15.73:0/1505232275 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c030840 con 0x7f1998154b30 2024-03-04T08:49:06.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.047+0000 7f1995ffb640 1 -- 172.21.15.73:0/1505232275 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c030c10 con 0x7f1998154b30 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 -- 172.21.15.73:0/1505232275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 msgr2=0x7f19980ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 --2- 172.21.15.73:0/1505232275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 0x7f19980ce110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f198c009870 tx=0x7f198c02b980 comp rx=0 tx=0).stop 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 -- 172.21.15.73:0/1505232275 shutdown_connections 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 --2- 172.21.15.73:0/1505232275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1998154b30 0x7f19980ce110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 --2- 172.21.15.73:0/1505232275 >> v2:172.21.15.73:3300/0 conn(0x7f1998154750 0x7f19980cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 -- 172.21.15.73:0/1505232275 >> 172.21.15.73:0/1505232275 conn(0x7f1998066c40 msgr2=0x7f1998067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 -- 172.21.15.73:0/1505232275 shutdown_connections 2024-03-04T08:49:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.048+0000 7f199d4b5640 1 -- 172.21.15.73:0/1505232275 wait complete. 2024-03-04T08:49:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.049+0000 7f199d4b5640 1 Processor -- start 2024-03-04T08:49:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.049+0000 7f199d4b5640 1 -- start start 2024-03-04T08:49:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f199d4b5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 0x7f1998155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f199d4b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1998154750 0x7f19981575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f199d4b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1998157b30 0x7f19980c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f199d4b5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199815a5b0 con 0x7f1998157b30 2024-03-04T08:49:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f199d4b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199815aec0 con 0x7f1998154750 2024-03-04T08:49:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f199d4b5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199815b3e0 con 0x7f19980ce650 2024-03-04T08:49:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.050+0000 7f1996ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 0x7f1998155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.051+0000 7f19967fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1998154750 0x7f19981575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.051+0000 7f1996ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 0x7f1998155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47780/0 (socket says 172.21.15.73:47780) 2024-03-04T08:49:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.051+0000 7f1996ffd640 1 -- 172.21.15.73:0/2621189931 learned_addr learned my addr 172.21.15.73:0/2621189931 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.054+0000 7f1996ffd640 1 -- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1998154750 msgr2=0x7f19981575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.054+0000 7f1996ffd640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1998154750 0x7f19981575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.054+0000 7f1996ffd640 1 -- 172.21.15.73:0/2621189931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1998157b30 msgr2=0x7f19980c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.054+0000 7f1996ffd640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1998157b30 0x7f19980c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.054+0000 7f1996ffd640 1 -- 172.21.15.73:0/2621189931 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998155cf0 con 0x7f19980ce650 2024-03-04T08:49:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.056+0000 7f1996ffd640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 0x7f1998155190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f198800e9b0 tx=0x7f198800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.060+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988017070 con 0x7f19980ce650 2024-03-04T08:49:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.060+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198800c9a0 con 0x7f19980ce650 2024-03-04T08:49:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.060+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198800cd90 con 0x7f19980ce650 2024-03-04T08:49:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.060+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1998155fd0 con 0x7f19980ce650 2024-03-04T08:49:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.060+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1998156590 con 0x7f19980ce650 2024-03-04T08:49:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.061+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19980ca290 con 0x7f19980ce650 2024-03-04T08:49:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.063+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f198801a070 con 0x7f19980ce650 2024-03-04T08:49:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.063+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1988013470 con 0x7f19980ce650 2024-03-04T08:49:06.070 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.073+0000 7fad4a23a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T08:49:06.118 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.122+0000 7fad4a23a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T08:49:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.161+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f19980ca290 con 0x7f19980ce650 2024-03-04T08:49:06.197 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.200+0000 7f7d4b020040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T08:49:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.233+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c2ab089f-ff10-45c7-bf37-a14a618a6742", "id": 0} v 0) v1 -- 0x7f19980680b0 con 0x7f19980ce650 2024-03-04T08:49:06.269 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.272+0000 7f7d4b020040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T08:49:06.328 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.332+0000 7f7d4b020040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T08:49:06.398 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.401+0000 7f7d4b020040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T08:49:06.453 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.457+0000 7f7d4b020040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T08:49:06.506 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.509+0000 7fad4a23a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T08:49:06.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.547+0000 7f197f7fe640 1 -- 172.21.15.73:0/2621189931 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2ab089f-ff10-45c7-bf37-a14a618a6742", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1988013670 con 0x7f19980ce650 2024-03-04T08:49:06.544 INFO:teuthology.orchestra.run.smithi073.stdout:0 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 msgr2=0x7f1998155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 0x7f1998155190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f198800e9b0 tx=0x7f198800ee70 comp rx=0 tx=0).stop 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 shutdown_connections 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1998154750 0x7f19981575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1998157b30 0x7f19980c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 --2- 172.21.15.73:0/2621189931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19980ce650 0x7f1998155190 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 >> 172.21.15.73:0/2621189931 conn(0x7f1998066c40 msgr2=0x7f19980cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 shutdown_connections 2024-03-04T08:49:06.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.548+0000 7f199d4b5640 1 -- 172.21.15.73:0/2621189931 wait complete. 2024-03-04T08:49:06.559 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 87d5bf27-09b9-4567-bd8f-f9094895fcbd 1 2024-03-04T08:49:06.595 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.598+0000 7f7d4b020040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T08:49:06.652 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.655+0000 7fad4a23a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T08:49:06.680 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.683+0000 7f7d4b020040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T08:49:06.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.704+0000 7f0364325640 1 Processor -- start 2024-03-04T08:49:06.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.704+0000 7f0364325640 1 -- start start 2024-03-04T08:49:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.705+0000 7f0364325640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f035c06e5f0 0x7f035c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.705+0000 7f0364325640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.705+0000 7f0364325640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c0c1f00 con 0x7f035c06e9d0 2024-03-04T08:49:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.705+0000 7f0364325640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035c1580b0 con 0x7f035c06e5f0 2024-03-04T08:49:06.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.705+0000 7f0364325640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c157530 con 0x7f035c06f780 2024-03-04T08:49:06.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.706+0000 7f03620c1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f035c06e5f0 0x7f035c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.706+0000 7f03628c2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.706+0000 7f03628c2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c15b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47788/0 (socket says 172.21.15.73:47788) 2024-03-04T08:49:06.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.706+0000 7f03628c2640 1 -- 172.21.15.73:0/3595803541 learned_addr learned my addr 172.21.15.73:0/3595803541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:06.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.708+0000 7f03628c2640 1 -- 172.21.15.73:0/3595803541 >> v2:172.21.15.73:3300/0 conn(0x7f035c06e5f0 msgr2=0x7f035c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:06.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.708+0000 7f03628c2640 1 --2- 172.21.15.73:0/3595803541 >> v2:172.21.15.73:3300/0 conn(0x7f035c06e5f0 0x7f035c15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.708+0000 7f03628c2640 1 -- 172.21.15.73:0/3595803541 >> v1:172.21.15.46:6789/0 conn(0x7f035c06e9d0 legacy=0x7f035c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.708+0000 7f03628c2640 1 -- 172.21.15.73:0/3595803541 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c157810 con 0x7f035c06f780 2024-03-04T08:49:06.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.710+0000 7f03628c2640 1 --2- 172.21.15.73:0/3595803541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c15b250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0354009e50 tx=0x7f035402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9182f0c413a72b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:06.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.713+0000 7f03610bf640 1 -- 172.21.15.73:0/3595803541 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035402cb90 con 0x7f035c06f780 2024-03-04T08:49:06.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f03610bf640 1 -- 172.21.15.73:0/3595803541 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035402cd30 con 0x7f035c06f780 2024-03-04T08:49:06.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f03610bf640 1 -- 172.21.15.73:0/3595803541 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354034610 con 0x7f035c06f780 2024-03-04T08:49:06.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 -- 172.21.15.73:0/3595803541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 msgr2=0x7f035c15b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 --2- 172.21.15.73:0/3595803541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c15b250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0354009e50 tx=0x7f035402bff0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 -- 172.21.15.73:0/3595803541 shutdown_connections 2024-03-04T08:49:06.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 --2- 172.21.15.73:0/3595803541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c15b250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 --2- 172.21.15.73:0/3595803541 >> v2:172.21.15.73:3300/0 conn(0x7f035c06e5f0 0x7f035c15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 -- 172.21.15.73:0/3595803541 >> 172.21.15.73:0/3595803541 conn(0x7f035c072df0 msgr2=0x7f035c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 -- 172.21.15.73:0/3595803541 shutdown_connections 2024-03-04T08:49:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.714+0000 7f0364325640 1 -- 172.21.15.73:0/3595803541 wait complete. 2024-03-04T08:49:06.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.716+0000 7f0364325640 1 Processor -- start 2024-03-04T08:49:06.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.716+0000 7f0364325640 1 -- start start 2024-03-04T08:49:06.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.717+0000 7f0364325640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035c06e5f0 0x7f035c0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.717+0000 7f0364325640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f035c06e9d0 0x7f035c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.717+0000 7f0364325640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:06.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.717+0000 7f0364325640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c15a7f0 con 0x7f035c06e9d0 2024-03-04T08:49:06.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.717+0000 7f0364325640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c157dd0 con 0x7f035c06e5f0 2024-03-04T08:49:06.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.717+0000 7f0364325640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c157160 con 0x7f035c06f780 2024-03-04T08:49:06.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.718+0000 7f03628c2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.718+0000 7f03620c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035c06e5f0 0x7f035c0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.718+0000 7f03628c2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c14f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47794/0 (socket says 172.21.15.73:47794) 2024-03-04T08:49:06.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.718+0000 7f03628c2640 1 -- 172.21.15.73:0/2332371468 learned_addr learned my addr 172.21.15.73:0/2332371468 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:06.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.719+0000 7f03618c0640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f035c06e9d0 0x7f035c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:06.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.722+0000 7f03628c2640 1 -- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035c06e5f0 msgr2=0x7f035c0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.722+0000 7f03628c2640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035c06e5f0 0x7f035c0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.722+0000 7f03628c2640 1 -- 172.21.15.73:0/2332371468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f035c06e9d0 msgr2=0x7f035c0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:06.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.722+0000 7f03628c2640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f035c06e9d0 0x7f035c0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:06.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.722+0000 7f03628c2640 1 -- 172.21.15.73:0/2332371468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0cb880 con 0x7f035c06f780 2024-03-04T08:49:06.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.724+0000 7f03628c2640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c14f780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0354036040 tx=0x7f0354004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:06.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.727+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354043020 con 0x7f035c06f780 2024-03-04T08:49:06.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.727+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035403e450 con 0x7f035c06f780 2024-03-04T08:49:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.727+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c1f02f0 con 0x7f035c06f780 2024-03-04T08:49:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.727+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354009510 con 0x7f035c06f780 2024-03-04T08:49:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.728+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c1f05b0 con 0x7f035c06f780 2024-03-04T08:49:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.728+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c074df0 con 0x7f035c06f780 2024-03-04T08:49:06.738 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.740+0000 7f7d4b020040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T08:49:06.787 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.790+0000 7fad4a23a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T08:49:06.802 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.805+0000 7f7d4b020040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T08:49:06.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.830+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0354046020 con 0x7f035c06f780 2024-03-04T08:49:06.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.830+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f03540517e0 con 0x7f035c06f780 2024-03-04T08:49:06.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.830+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f035404d030 con 0x7f035c06f780 2024-03-04T08:49:06.834 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.837+0000 7fad4a23a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T08:49:06.860 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:06.864+0000 7f7d4b020040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T08:49:06.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:06.903+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "87d5bf27-09b9-4567-bd8f-f9094895fcbd", "id": 1} v 0) v1 -- 0x7f035c06ee50 con 0x7f035c06f780 2024-03-04T08:49:06.950 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:06.954+0000 7fad4a23a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:49:07.047 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:07.051+0000 7fad4a23a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T08:49:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.189+0000 7f0352ffd640 1 -- 172.21.15.73:0/2332371468 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87d5bf27-09b9-4567-bd8f-f9094895fcbd", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f035402cba0 con 0x7f035c06f780 2024-03-04T08:49:07.187 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 msgr2=0x7f035c14f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c14f780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0354036040 tx=0x7f0354004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 shutdown_connections 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f035c06f780 0x7f035c14f780 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f035c06e9d0 0x7f035c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 --2- 172.21.15.73:0/2332371468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035c06e5f0 0x7f035c0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 >> 172.21.15.73:0/2332371468 conn(0x7f035c072df0 msgr2=0x7f035c14a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:07.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 shutdown_connections 2024-03-04T08:49:07.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.191+0000 7f0364325640 1 -- 172.21.15.73:0/2332371468 wait complete. 2024-03-04T08:49:07.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 24e4fc66-fd09-4374-be1e-42984152425f 2 2024-03-04T08:49:07.207 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:07.211+0000 7fad4a23a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:49:07.253 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:07.256+0000 7fad4a23a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T08:49:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.303+0000 7f2b3fcdf640 1 Processor -- start 2024-03-04T08:49:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.303+0000 7f2b3fcdf640 1 -- start start 2024-03-04T08:49:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.304+0000 7f2b3fcdf640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b38151070 0x7f2b3815af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.304+0000 7f2b3fcdf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b380c7730 0x7f2b3806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3fcdf640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3806b100 con 0x7f2b380c7310 2024-03-04T08:49:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3fcdf640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3806bff0 con 0x7f2b380c7730 2024-03-04T08:49:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3fcdf640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3806b3e0 con 0x7f2b38151070 2024-03-04T08:49:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3e27c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b380c7730 0x7f2b3806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3da7b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b38151070 0x7f2b3815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3e27c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b380c7730 0x7f2b3806fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40908/0 (socket says 172.21.15.73:40908) 2024-03-04T08:49:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.305+0000 7f2b3e27c640 1 -- 172.21.15.73:0/1793646024 learned_addr learned my addr 172.21.15.73:0/1793646024 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.308+0000 7f2b3e27c640 1 -- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b38151070 msgr2=0x7f2b3815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.308+0000 7f2b3e27c640 1 --2- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b38151070 0x7f2b3815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.308+0000 7f2b3e27c640 1 -- 172.21.15.73:0/1793646024 >> v1:172.21.15.46:6789/0 conn(0x7f2b380c7310 legacy=0x7f2b3806f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.308+0000 7f2b3e27c640 1 -- 172.21.15.73:0/1793646024 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3806b6c0 con 0x7f2b380c7730 2024-03-04T08:49:07.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.310+0000 7f2b3e27c640 1 --2- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7730 0x7f2b3806fac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009e80 tx=0x7f2b3002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d03ef8326e2712 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.314+0000 7f2b3ca79640 1 -- 172.21.15.73:0/1793646024 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3002cb70 con 0x7f2b380c7730 2024-03-04T08:49:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.314+0000 7f2b3ca79640 1 -- 172.21.15.73:0/1793646024 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3002cd10 con 0x7f2b380c7730 2024-03-04T08:49:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.314+0000 7f2b3ca79640 1 -- 172.21.15.73:0/1793646024 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30034610 con 0x7f2b380c7730 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7730 msgr2=0x7f2b3806fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7730 0x7f2b3806fac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009e80 tx=0x7f2b3002bfd0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1793646024 shutdown_connections 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7730 0x7f2b3806fac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1793646024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b38151070 0x7f2b3815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1793646024 >> 172.21.15.73:0/1793646024 conn(0x7f2b380c8ee0 msgr2=0x7f2b380c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1793646024 shutdown_connections 2024-03-04T08:49:07.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.315+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1793646024 wait complete. 2024-03-04T08:49:07.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.316+0000 7f2b3fcdf640 1 Processor -- start 2024-03-04T08:49:07.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.316+0000 7f2b3fcdf640 1 -- start start 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3fcdf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 0x7f2b381529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3fcdf640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b380c7730 0x7f2b3814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3fcdf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b38151070 0x7f2b3814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3fcdf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3806c480 con 0x7f2b38151070 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3fcdf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3806bc80 con 0x7f2b380c7310 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3fcdf640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3814f360 con 0x7f2b380c7730 2024-03-04T08:49:07.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.317+0000 7f2b3da7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 0x7f2b381529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.318+0000 7f2b3d27a640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b380c7730 0x7f2b3814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.318+0000 7f2b3da7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 0x7f2b381529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40918/0 (socket says 172.21.15.73:40918) 2024-03-04T08:49:07.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.318+0000 7f2b3da7b640 1 -- 172.21.15.73:0/1147358570 learned_addr learned my addr 172.21.15.73:0/1147358570 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:07.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.319+0000 7f2b3e27c640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b38151070 0x7f2b3814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.321+0000 7f2b3da7b640 1 -- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b380c7730 msgr2=0x7f2b3814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.321+0000 7f2b3da7b640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b380c7730 0x7f2b3814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.321+0000 7f2b3da7b640 1 -- 172.21.15.73:0/1147358570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b38151070 msgr2=0x7f2b3814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.321+0000 7f2b3da7b640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b38151070 0x7f2b3814e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.321+0000 7f2b3da7b640 1 -- 172.21.15.73:0/1147358570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3814f600 con 0x7f2b380c7310 2024-03-04T08:49:07.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.323+0000 7f2b3da7b640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 0x7f2b381529a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800e870 tx=0x7f2b2800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:07.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.327+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28017070 con 0x7f2b380c7310 2024-03-04T08:49:07.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.327+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800c940 con 0x7f2b380c7310 2024-03-04T08:49:07.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.327+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800cd30 con 0x7f2b380c7310 2024-03-04T08:49:07.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.327+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b38154720 con 0x7f2b380c7310 2024-03-04T08:49:07.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.327+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38152480 con 0x7f2b380c7310 2024-03-04T08:49:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.328+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b38074df0 con 0x7f2b380c7310 2024-03-04T08:49:07.349 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:07.353+0000 7f7d4b020040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T08:49:07.421 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:07.424+0000 7fad4a23a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T08:49:07.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.504+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2b2801a070 con 0x7f2b380c7310 2024-03-04T08:49:07.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.504+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2b28013470 con 0x7f2b380c7310 2024-03-04T08:49:07.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.504+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2b280136c0 con 0x7f2b380c7310 2024-03-04T08:49:07.518 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:07.522+0000 7f7d4b020040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T08:49:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.613+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24e4fc66-fd09-4374-be1e-42984152425f", "id": 2} v 0) v1 -- 0x7f2b380728f0 con 0x7f2b380c7310 2024-03-04T08:49:07.670 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:07.673+0000 7f7d4b020040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T08:49:07.730 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:07.734+0000 7f7d4b020040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T08:49:07.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.833+0000 7f2b2e7fc640 1 -- 172.21.15.73:0/1147358570 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24e4fc66-fd09-4374-be1e-42984152425f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b28006490 con 0x7f2b380c7310 2024-03-04T08:49:07.830 INFO:teuthology.orchestra.run.smithi073.stdout:2 2024-03-04T08:49:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 msgr2=0x7f2b381529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 0x7f2b381529a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800e870 tx=0x7f2b2800ed30 comp rx=0 tx=0).stop 2024-03-04T08:49:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 shutdown_connections 2024-03-04T08:49:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b38151070 0x7f2b3814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b380c7730 0x7f2b3814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 --2- 172.21.15.73:0/1147358570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b380c7310 0x7f2b381529a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 >> 172.21.15.73:0/1147358570 conn(0x7f2b380c8ee0 msgr2=0x7f2b380c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:07.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 shutdown_connections 2024-03-04T08:49:07.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.834+0000 7f2b3fcdf640 1 -- 172.21.15.73:0/1147358570 wait complete. 2024-03-04T08:49:07.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new e908b111-7c01-4a7a-be0e-6336b4c1dd68 3 2024-03-04T08:49:07.868 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:07.872+0000 7f7d4b020040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:49:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.984+0000 7fcd764df640 1 Processor -- start 2024-03-04T08:49:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.984+0000 7fcd764df640 1 -- start start 2024-03-04T08:49:07.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.985+0000 7fcd764df640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd70151460 0x7fcd7015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.985+0000 7fcd764df640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c83b0 0x7fcd701575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.985+0000 7fcd764df640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7006ee50 con 0x7fcd700c1e90 2024-03-04T08:49:07.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.985+0000 7fcd764df640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7006e570 con 0x7fcd70151460 2024-03-04T08:49:07.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.985+0000 7fcd764df640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7006eaa0 con 0x7fcd700c83b0 2024-03-04T08:49:07.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.986+0000 7fcd6ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd70151460 0x7fcd7015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.986+0000 7fcd74a7c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c83b0 0x7fcd701575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.986+0000 7fcd6ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd70151460 0x7fcd7015b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40928/0 (socket says 172.21.15.73:40928) 2024-03-04T08:49:07.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.986+0000 7fcd6ffff640 1 -- 172.21.15.73:0/2291436422 learned_addr learned my addr 172.21.15.73:0/2291436422 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:07.985 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:07.988+0000 7f7d4b020040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T08:49:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.989+0000 7fcd74a7c640 1 -- 172.21.15.73:0/2291436422 >> v2:172.21.15.73:3300/0 conn(0x7fcd70151460 msgr2=0x7fcd7015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.989+0000 7fcd74a7c640 1 --2- 172.21.15.73:0/2291436422 >> v2:172.21.15.73:3300/0 conn(0x7fcd70151460 0x7fcd7015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.989+0000 7fcd74a7c640 1 -- 172.21.15.73:0/2291436422 >> v1:172.21.15.73:6789/0 conn(0x7fcd700c1e90 legacy=0x7fcd700c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.989+0000 7fcd74a7c640 1 -- 172.21.15.73:0/2291436422 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7006e7c0 con 0x7fcd700c83b0 2024-03-04T08:49:07.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.991+0000 7fcd74a7c640 1 --2- 172.21.15.73:0/2291436422 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c83b0 0x7fcd701575d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009d90 tx=0x7fcd6802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed9c247d95f6f4c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:07.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd6effd640 1 -- 172.21.15.73:0/2291436422 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68039070 con 0x7fcd700c83b0 2024-03-04T08:49:07.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd6effd640 1 -- 172.21.15.73:0/2291436422 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6802cbc0 con 0x7fcd700c83b0 2024-03-04T08:49:07.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd6effd640 1 -- 172.21.15.73:0/2291436422 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68034440 con 0x7fcd700c83b0 2024-03-04T08:49:07.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 -- 172.21.15.73:0/2291436422 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c83b0 msgr2=0x7fcd701575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:07.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 --2- 172.21.15.73:0/2291436422 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c83b0 0x7fcd701575d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009d90 tx=0x7fcd6802be10 comp rx=0 tx=0).stop 2024-03-04T08:49:07.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 -- 172.21.15.73:0/2291436422 shutdown_connections 2024-03-04T08:49:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 --2- 172.21.15.73:0/2291436422 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c83b0 0x7fcd701575d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 --2- 172.21.15.73:0/2291436422 >> v2:172.21.15.73:3300/0 conn(0x7fcd70151460 0x7fcd7015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 -- 172.21.15.73:0/2291436422 >> 172.21.15.73:0/2291436422 conn(0x7fcd70072c70 msgr2=0x7fcd7006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.995+0000 7fcd764df640 1 -- 172.21.15.73:0/2291436422 shutdown_connections 2024-03-04T08:49:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.996+0000 7fcd764df640 1 -- 172.21.15.73:0/2291436422 wait complete. 2024-03-04T08:49:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.997+0000 7fcd764df640 1 Processor -- start 2024-03-04T08:49:07.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.997+0000 7fcd764df640 1 -- start start 2024-03-04T08:49:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.997+0000 7fcd764df640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c1e90 0x7fcd701f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd764df640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd700c83b0 0x7fcd701f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd764df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 0x7fcd7014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd764df640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70151840 con 0x7fcd700c83b0 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd764df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7006f600 con 0x7fcd70151460 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd764df640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700c3d20 con 0x7fcd700c1e90 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd6ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c1e90 0x7fcd701f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.998+0000 7fcd74a7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 0x7fcd7014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.999+0000 7fcd74a7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 0x7fcd7014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40934/0 (socket says 172.21.15.73:40934) 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.999+0000 7fcd74a7c640 1 -- 172.21.15.73:0/1289916749 learned_addr learned my addr 172.21.15.73:0/1289916749 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:07.999+0000 7fcd6f7fe640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd700c83b0 0x7fcd701f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.003+0000 7fcd74a7c640 1 -- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c1e90 msgr2=0x7fcd701f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.003+0000 7fcd74a7c640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c1e90 0x7fcd701f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.003+0000 7fcd74a7c640 1 -- 172.21.15.73:0/1289916749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd700c83b0 msgr2=0x7fcd701f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.003+0000 7fcd74a7c640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd700c83b0 0x7fcd701f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.003+0000 7fcd74a7c640 1 -- 172.21.15.73:0/1289916749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70155be0 con 0x7fcd70151460 2024-03-04T08:49:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.006+0000 7fcd74a7c640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 0x7fcd7014fd80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd6802c420 tx=0x7fcd68004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:08.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.010+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68044020 con 0x7fcd70151460 2024-03-04T08:49:08.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.010+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6803f470 con 0x7fcd70151460 2024-03-04T08:49:08.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.010+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd701f4510 con 0x7fcd70151460 2024-03-04T08:49:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.010+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68039040 con 0x7fcd70151460 2024-03-04T08:49:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.010+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd701f4ad0 con 0x7fcd70151460 2024-03-04T08:49:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.011+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd700682c0 con 0x7fcd70151460 2024-03-04T08:49:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.012+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcd68047020 con 0x7fcd70151460 2024-03-04T08:49:08.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.013+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcd68052430 con 0x7fcd70151460 2024-03-04T08:49:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.114+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcd700682c0 con 0x7fcd70151460 2024-03-04T08:49:08.175 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:08.178+0000 7f7d4b020040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:49:08.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.188+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e908b111-7c01-4a7a-be0e-6336b4c1dd68", "id": 3} v 0) v1 -- 0x7fcd700c7560 con 0x7fcd70151460 2024-03-04T08:49:08.230 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:08.234+0000 7f7d4b020040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T08:49:08.282 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:08.286+0000 7fad4a23a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T08:49:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.390+0000 7fcd6cff9640 1 -- 172.21.15.73:0/1289916749 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e908b111-7c01-4a7a-be0e-6336b4c1dd68", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd700c7560 con 0x7fcd70151460 2024-03-04T08:49:08.387 INFO:teuthology.orchestra.run.smithi073.stdout:3 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 msgr2=0x7fcd7014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 0x7fcd7014fd80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd6802c420 tx=0x7fcd68004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 shutdown_connections 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd70151460 0x7fcd7014fd80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd700c83b0 0x7fcd701f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 --2- 172.21.15.73:0/1289916749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd700c1e90 0x7fcd701f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 >> 172.21.15.73:0/1289916749 conn(0x7fcd70072c70 msgr2=0x7fcd7006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 shutdown_connections 2024-03-04T08:49:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.391+0000 7fcd764df640 1 -- 172.21.15.73:0/1289916749 wait complete. 2024-03-04T08:49:08.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 7cbe4281-110a-4c9f-8521-79e30136452c 4 2024-03-04T08:49:08.422 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:08.426+0000 7f7d4b020040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T08:49:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.501+0000 7f44da13e640 1 Processor -- start 2024-03-04T08:49:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.501+0000 7f44da13e640 1 -- start start 2024-03-04T08:49:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.502+0000 7f44da13e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.502+0000 7f44da13e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44d40c7dd0 0x7f44d40c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.502+0000 7f44da13e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d415a830 con 0x7f44d40c5410 2024-03-04T08:49:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.502+0000 7f44da13e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d415aac0 con 0x7f44d40c7dd0 2024-03-04T08:49:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.502+0000 7f44da13e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d415ada0 con 0x7f44d4154540 2024-03-04T08:49:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.503+0000 7f44d37fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.503+0000 7f44d37fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d415a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47838/0 (socket says 172.21.15.73:47838) 2024-03-04T08:49:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.503+0000 7f44d37fe640 1 -- 172.21.15.73:0/2067039889 learned_addr learned my addr 172.21.15.73:0/2067039889 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.504+0000 7f44d3fff640 1 --2- 172.21.15.73:0/2067039889 >> v2:172.21.15.46:3300/0 conn(0x7f44d40c7dd0 0x7f44d40c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.505+0000 7f44d37fe640 1 -- 172.21.15.73:0/2067039889 >> v2:172.21.15.46:3300/0 conn(0x7f44d40c7dd0 msgr2=0x7f44d40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.505+0000 7f44d37fe640 1 --2- 172.21.15.73:0/2067039889 >> v2:172.21.15.46:3300/0 conn(0x7f44d40c7dd0 0x7f44d40c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.505+0000 7f44d37fe640 1 -- 172.21.15.73:0/2067039889 >> v1:172.21.15.46:6789/0 conn(0x7f44d40c5410 legacy=0x7f44d415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.505+0000 7f44d37fe640 1 -- 172.21.15.73:0/2067039889 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d415b080 con 0x7f44d4154540 2024-03-04T08:49:08.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.507+0000 7f44d37fe640 1 --2- 172.21.15.73:0/2067039889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d415a2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009870 tx=0x7f44c802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1487651b381a147 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44d27fc640 1 -- 172.21.15.73:0/2067039889 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8034070 con 0x7f44d4154540 2024-03-04T08:49:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44d27fc640 1 -- 172.21.15.73:0/2067039889 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8030840 con 0x7f44d4154540 2024-03-04T08:49:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44d27fc640 1 -- 172.21.15.73:0/2067039889 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8030c10 con 0x7f44d4154540 2024-03-04T08:49:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 -- 172.21.15.73:0/2067039889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 msgr2=0x7f44d415a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 --2- 172.21.15.73:0/2067039889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d415a2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009870 tx=0x7f44c802b980 comp rx=0 tx=0).stop 2024-03-04T08:49:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 -- 172.21.15.73:0/2067039889 shutdown_connections 2024-03-04T08:49:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 --2- 172.21.15.73:0/2067039889 >> v2:172.21.15.46:3300/0 conn(0x7f44d40c7dd0 0x7f44d40c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 --2- 172.21.15.73:0/2067039889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d415a2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 -- 172.21.15.73:0/2067039889 >> 172.21.15.73:0/2067039889 conn(0x7f44d4072730 msgr2=0x7f44d4072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 -- 172.21.15.73:0/2067039889 shutdown_connections 2024-03-04T08:49:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.511+0000 7f44da13e640 1 -- 172.21.15.73:0/2067039889 wait complete. 2024-03-04T08:49:08.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.513+0000 7f44da13e640 1 Processor -- start 2024-03-04T08:49:08.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.513+0000 7f44da13e640 1 -- start start 2024-03-04T08:49:08.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44da13e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d40c5410 0x7f44d415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44da13e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44d40c7dd0 0x7f44d406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44da13e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d41f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44da13e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d4154920 con 0x7f44d40c7dd0 2024-03-04T08:49:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44da13e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d415dd60 con 0x7f44d40c5410 2024-03-04T08:49:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44da13e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40c85a0 con 0x7f44d4154540 2024-03-04T08:49:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d41f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.514+0000 7f44d37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d40c5410 0x7f44d415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.515+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d41f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47846/0 (socket says 172.21.15.73:47846) 2024-03-04T08:49:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.515+0000 7f44d3fff640 1 -- 172.21.15.73:0/3783388370 learned_addr learned my addr 172.21.15.73:0/3783388370 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.515+0000 7f44d2ffd640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44d40c7dd0 0x7f44d406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.518+0000 7f44d3fff640 1 -- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d40c5410 msgr2=0x7f44d415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.518+0000 7f44d3fff640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d40c5410 0x7f44d415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.518+0000 7f44d3fff640 1 -- 172.21.15.73:0/3783388370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44d40c7dd0 msgr2=0x7f44d406c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.518+0000 7f44d3fff640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44d40c7dd0 0x7f44d406c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.518+0000 7f44d3fff640 1 -- 172.21.15.73:0/3783388370 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d415c570 con 0x7f44d4154540 2024-03-04T08:49:08.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.520+0000 7f44d3fff640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d41f0070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00cc60 tx=0x7f44cc00a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.524+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc003990 con 0x7f44d4154540 2024-03-04T08:49:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.524+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc003b30 con 0x7f44d4154540 2024-03-04T08:49:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.524+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004020 con 0x7f44d4154540 2024-03-04T08:49:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.524+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d41f0990 con 0x7f44d4154540 2024-03-04T08:49:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.524+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d415b550 con 0x7f44d4154540 2024-03-04T08:49:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.525+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d4074df0 con 0x7f44d4154540 2024-03-04T08:49:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.527+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f44cc004550 con 0x7f44d4154540 2024-03-04T08:49:08.577 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:08.581+0000 7fad4a23a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T08:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.626+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f44cc022bb0 con 0x7f44d4154540 2024-03-04T08:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.626+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f44cc014030 con 0x7f44d4154540 2024-03-04T08:49:08.631 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:08.635+0000 7fad4a23a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T08:49:08.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.699+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7cbe4281-110a-4c9f-8521-79e30136452c", "id": 4} v 0) v1 -- 0x7f44d40cd440 con 0x7f44d4154540 2024-03-04T08:49:08.752 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:08.755+0000 7fad4a23a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T08:49:08.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.822+0000 7f44bbfff640 1 -- 172.21.15.73:0/3783388370 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cbe4281-110a-4c9f-8521-79e30136452c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f44cc022480 con 0x7f44d4154540 2024-03-04T08:49:08.819 INFO:teuthology.orchestra.run.smithi073.stdout:4 2024-03-04T08:49:08.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 msgr2=0x7f44d41f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d41f0070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00cc60 tx=0x7f44cc00a5c0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 shutdown_connections 2024-03-04T08:49:08.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d4154540 0x7f44d41f0070 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44d40c7dd0 0x7f44d406c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 --2- 172.21.15.73:0/3783388370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d40c5410 0x7f44d415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 >> 172.21.15.73:0/3783388370 conn(0x7f44d4072730 msgr2=0x7f44d4158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:08.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 shutdown_connections 2024-03-04T08:49:08.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.823+0000 7f44da13e640 1 -- 172.21.15.73:0/3783388370 wait complete. 2024-03-04T08:49:08.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 41cad540-7ff0-454b-b366-d6e96fa26b1a 5 2024-03-04T08:49:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.933+0000 7f645ce29640 1 Processor -- start 2024-03-04T08:49:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.933+0000 7f645ce29640 1 -- start start 2024-03-04T08:49:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.933+0000 7f645ce29640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6458151350 0x7f64580720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.933+0000 7f645ce29640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64580c7ac0 0x7f6458157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.934+0000 7f645ce29640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64580c8120 con 0x7f645815a700 2024-03-04T08:49:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.934+0000 7f645ce29640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6458158110 con 0x7f64580c7ac0 2024-03-04T08:49:08.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.934+0000 7f645ce29640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6458157110 con 0x7f6458151350 2024-03-04T08:49:08.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.934+0000 7f645659c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6458151350 0x7f64580720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.934+0000 7f6455d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f645815a700 0x7f64580c85b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58780/0 (socket says 172.21.15.73:58780) 2024-03-04T08:49:08.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.934+0000 7f6455d9b640 1 -- 172.21.15.73:0/2780881164 learned_addr learned my addr 172.21.15.73:0/2780881164 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-04T08:49:08.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.937+0000 7f645659c640 1 -- 172.21.15.73:0/2780881164 >> v2:172.21.15.46:3300/0 conn(0x7f64580c7ac0 msgr2=0x7f6458157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:08.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.937+0000 7f645659c640 1 --2- 172.21.15.73:0/2780881164 >> v2:172.21.15.46:3300/0 conn(0x7f64580c7ac0 0x7f6458157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.937+0000 7f645659c640 1 -- 172.21.15.73:0/2780881164 >> v1:172.21.15.73:6789/0 conn(0x7f645815a700 legacy=0x7f64580c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.937+0000 7f645659c640 1 -- 172.21.15.73:0/2780881164 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580c10a0 con 0x7f6458151350 2024-03-04T08:49:08.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.939+0000 7f645659c640 1 --2- 172.21.15.73:0/2780881164 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6458151350 0x7f64580720c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f64500097a0 tx=0x7f645002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17125ec691cf5232 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.942+0000 7f645559a640 1 -- 172.21.15.73:0/2780881164 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450034070 con 0x7f6458151350 2024-03-04T08:49:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.942+0000 7f645559a640 1 -- 172.21.15.73:0/2780881164 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450030610 con 0x7f6458151350 2024-03-04T08:49:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.942+0000 7f645559a640 1 -- 172.21.15.73:0/2780881164 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500309e0 con 0x7f6458151350 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 -- 172.21.15.73:0/2780881164 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6458151350 msgr2=0x7f64580720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 --2- 172.21.15.73:0/2780881164 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6458151350 0x7f64580720c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f64500097a0 tx=0x7f645002b960 comp rx=0 tx=0).stop 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 -- 172.21.15.73:0/2780881164 shutdown_connections 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 --2- 172.21.15.73:0/2780881164 >> v2:172.21.15.46:3300/0 conn(0x7f64580c7ac0 0x7f6458157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 --2- 172.21.15.73:0/2780881164 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6458151350 0x7f64580720c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 -- 172.21.15.73:0/2780881164 >> 172.21.15.73:0/2780881164 conn(0x7f645806aff0 msgr2=0x7f645806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 -- 172.21.15.73:0/2780881164 shutdown_connections 2024-03-04T08:49:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.943+0000 7f645ce29640 1 -- 172.21.15.73:0/2780881164 wait complete. 2024-03-04T08:49:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.944+0000 7f645ce29640 1 Processor -- start 2024-03-04T08:49:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.944+0000 7f645ce29640 1 -- start start 2024-03-04T08:49:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.945+0000 7f645ce29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64580c7ac0 0x7f645814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.945+0000 7f645ce29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6458151350 0x7f6458152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.945+0000 7f645ce29640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 0x7f6458152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.945+0000 7f645ce29640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64580c1660 con 0x7f64580c7ac0 2024-03-04T08:49:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.945+0000 7f645ce29640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64581573d0 con 0x7f6458151350 2024-03-04T08:49:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.945+0000 7f645ce29640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64581576b0 con 0x7f645815a700 2024-03-04T08:49:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.946+0000 7f6455d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6458151350 0x7f6458152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.946+0000 7f6456d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 0x7f6458152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.946+0000 7f6456d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 0x7f6458152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:47852/0 (socket says 172.21.15.73:47852) 2024-03-04T08:49:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.946+0000 7f6456d9d640 1 -- 172.21.15.73:0/2860114344 learned_addr learned my addr 172.21.15.73:0/2860114344 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.949+0000 7f6455d9b640 1 -- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 msgr2=0x7f6458152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.949+0000 7f6455d9b640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 0x7f6458152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.949+0000 7f6455d9b640 1 -- 172.21.15.73:0/2860114344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64580c7ac0 msgr2=0x7f645814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.949+0000 7f6455d9b640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64580c7ac0 0x7f645814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.949+0000 7f6455d9b640 1 -- 172.21.15.73:0/2860114344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64581f4080 con 0x7f6458151350 2024-03-04T08:49:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.949+0000 7f6456d9d640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 0x7f6458152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:49:08.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.951+0000 7f6455d9b640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6458151350 0x7f6458152a10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f644c00cab0 tx=0x7f644c00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:08.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.955+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c017070 con 0x7f6458151350 2024-03-04T08:49:08.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.955+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c00ac30 con 0x7f6458151350 2024-03-04T08:49:08.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.955+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c012400 con 0x7f6458151350 2024-03-04T08:49:08.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.955+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6458151c50 con 0x7f6458151350 2024-03-04T08:49:08.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.955+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6458152210 con 0x7f6458151350 2024-03-04T08:49:08.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.956+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64580680b0 con 0x7f6458151350 2024-03-04T08:49:08.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.958+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f644c01a070 con 0x7f6458151350 2024-03-04T08:49:08.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:08.958+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f644c007610 con 0x7f6458151350 2024-03-04T08:49:08.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:08.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.057+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f644c007860 con 0x7f6458151350 2024-03-04T08:49:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.135+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "41cad540-7ff0-454b-b366-d6e96fa26b1a", "id": 5} v 0) v1 -- 0x7f64580c7130 con 0x7f6458151350 2024-03-04T08:49:09.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.386+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 2) v1 ==== 44915+0+0 (secure 0 0 0) 0x7f644c007070 con 0x7f6458151350 2024-03-04T08:49:09.683 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:09.686+0000 7f7d4b020040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T08:49:09.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.981+0000 7f6446ffd640 1 -- 172.21.15.73:0/2860114344 <== mon.1 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "41cad540-7ff0-454b-b366-d6e96fa26b1a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f644c0243a0 con 0x7f6458151350 2024-03-04T08:49:09.978 INFO:teuthology.orchestra.run.smithi073.stdout:5 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6458151350 msgr2=0x7f6458152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6458151350 0x7f6458152a10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f644c00cab0 tx=0x7f644c00cf70 comp rx=0 tx=0).stop 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 shutdown_connections 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6458151350 0x7f6458152a10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f645815a700 0x7f6458152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 --2- 172.21.15.73:0/2860114344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64580c7ac0 0x7f645814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 >> 172.21.15.73:0/2860114344 conn(0x7f645806aff0 msgr2=0x7f645806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 shutdown_connections 2024-03-04T08:49:09.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:09.982+0000 7f645ce29640 1 -- 172.21.15.73:0/2860114344 wait complete. 2024-03-04T08:49:09.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 547e18d0-b0bf-4c6d-8b07-a10c6de0d499 6 2024-03-04T08:49:10.032 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:10.036+0000 7f7d4b020040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T08:49:10.095 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:10.099+0000 7f7d4b020040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T08:49:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.131+0000 7f9b23c39640 1 Processor -- start 2024-03-04T08:49:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.132+0000 7f9b23c39640 1 -- start start 2024-03-04T08:49:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.132+0000 7f9b23c39640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b1c152310 0x7f9b1c0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.132+0000 7f9b23c39640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c06ff30 con 0x7f9b1c158ae0 2024-03-04T08:49:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.132+0000 7f9b23c39640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0701d0 con 0x7f9b1c151f30 2024-03-04T08:49:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.132+0000 7f9b23c39640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c06ec10 con 0x7f9b1c152310 2024-03-04T08:49:10.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.133+0000 7f9b221d6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b1c152310 0x7f9b1c0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:10.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.134+0000 7f9b221d6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b1c152310 0x7f9b1c0c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41046/0 (socket says 172.21.15.73:41046) 2024-03-04T08:49:10.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.134+0000 7f9b221d6640 1 -- 172.21.15.73:0/1008879438 learned_addr learned my addr 172.21.15.73:0/1008879438 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.136+0000 7f9b221d6640 1 -- 172.21.15.73:0/1008879438 >> v1:172.21.15.73:6789/0 conn(0x7f9b1c151f30 legacy=0x7f9b1c0c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.136+0000 7f9b221d6640 1 -- 172.21.15.73:0/1008879438 >> v1:172.21.15.46:6789/0 conn(0x7f9b1c158ae0 legacy=0x7f9b1c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.136+0000 7f9b221d6640 1 -- 172.21.15.73:0/1008879438 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c158ef0 con 0x7f9b1c152310 2024-03-04T08:49:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.141+0000 7f9b221d6640 1 --2- 172.21.15.73:0/1008879438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c152310 0x7f9b1c0c8c10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009e50 tx=0x7f9b1802c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4751de49026aebdb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.147+0000 7f9b209d3640 1 -- 172.21.15.73:0/1008879438 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1802cbb0 con 0x7f9b1c152310 2024-03-04T08:49:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.147+0000 7f9b209d3640 1 -- 172.21.15.73:0/1008879438 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1802cd50 con 0x7f9b1c152310 2024-03-04T08:49:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.147+0000 7f9b209d3640 1 -- 172.21.15.73:0/1008879438 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18034610 con 0x7f9b1c152310 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 -- 172.21.15.73:0/1008879438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c152310 msgr2=0x7f9b1c0c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 --2- 172.21.15.73:0/1008879438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c152310 0x7f9b1c0c8c10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009e50 tx=0x7f9b1802c010 comp rx=0 tx=0).stop 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 -- 172.21.15.73:0/1008879438 shutdown_connections 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 --2- 172.21.15.73:0/1008879438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c152310 0x7f9b1c0c8c10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 -- 172.21.15.73:0/1008879438 >> 172.21.15.73:0/1008879438 conn(0x7f9b1c071430 msgr2=0x7f9b1c071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 -- 172.21.15.73:0/1008879438 shutdown_connections 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.148+0000 7f9b23c39640 1 -- 172.21.15.73:0/1008879438 wait complete. 2024-03-04T08:49:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.149+0000 7f9b23c39640 1 Processor -- start 2024-03-04T08:49:10.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.149+0000 7f9b23c39640 1 -- start start 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b23c39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b1c151f30 0x7f9b1c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b23c39640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b1c152310 0x7f9b1c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b23c39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 0x7f9b1c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b23c39640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c06f770 con 0x7f9b1c151f30 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b23c39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b3100 con 0x7f9b1c158ae0 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b23c39640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c06ee40 con 0x7f9b1c152310 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b221d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 0x7f9b1c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b211d4640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b1c152310 0x7f9b1c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:10.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b221d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 0x7f9b1c0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41054/0 (socket says 172.21.15.73:41054) 2024-03-04T08:49:10.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.150+0000 7f9b221d6640 1 -- 172.21.15.73:0/632913704 learned_addr learned my addr 172.21.15.73:0/632913704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:10.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.154+0000 7f9b221d6640 1 -- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b1c152310 msgr2=0x7f9b1c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:10.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.154+0000 7f9b221d6640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b1c152310 0x7f9b1c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.154+0000 7f9b221d6640 1 -- 172.21.15.73:0/632913704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b1c151f30 msgr2=0x7f9b1c06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.154+0000 7f9b221d6640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b1c151f30 0x7f9b1c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.154+0000 7f9b221d6640 1 -- 172.21.15.73:0/632913704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c1e2400 con 0x7f9b1c158ae0 2024-03-04T08:49:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.154+0000 7f9b211d4640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b1c152310 0x7f9b1c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:49:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.156+0000 7f9b221d6640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 0x7f9b1c0c6a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009f70 tx=0x7f9b18004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.159+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18043020 con 0x7f9b1c158ae0 2024-03-04T08:49:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.159+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1803e450 con 0x7f9b1c158ae0 2024-03-04T08:49:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.159+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1803e840 con 0x7f9b1c158ae0 2024-03-04T08:49:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.159+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c1e26e0 con 0x7f9b1c158ae0 2024-03-04T08:49:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.159+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c1e2ca0 con 0x7f9b1c158ae0 2024-03-04T08:49:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.160+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0682c0 con 0x7f9b1c158ae0 2024-03-04T08:49:10.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.217+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 2) v1 ==== 44915+0+0 (secure 0 0 0) 0x7f9b18046020 con 0x7f9b1c158ae0 2024-03-04T08:49:10.232 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-04T08:49:10.236+0000 7f7d4b020040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T08:49:10.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.266+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9b1803f5c0 con 0x7f9b1c158ae0 2024-03-04T08:49:10.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.266+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9b1c0682c0 con 0x7f9b1c158ae0 2024-03-04T08:49:10.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:10.339+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "547e18d0-b0bf-4c6d-8b07-a10c6de0d499", "id": 6} v 0) v1 -- 0x7f9b1c074df0 con 0x7f9b1c158ae0 2024-03-04T08:49:11.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.133+0000 7f9b127fc640 1 -- 172.21.15.73:0/632913704 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "547e18d0-b0bf-4c6d-8b07-a10c6de0d499", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b1804d070 con 0x7f9b1c158ae0 2024-03-04T08:49:11.130 INFO:teuthology.orchestra.run.smithi073.stdout:6 2024-03-04T08:49:11.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 msgr2=0x7f9b1c0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:11.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 0x7f9b1c0c6a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009f70 tx=0x7f9b18004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 shutdown_connections 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c158ae0 0x7f9b1c0c6a30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b1c152310 0x7f9b1c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 --2- 172.21.15.73:0/632913704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b1c151f30 0x7f9b1c06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 >> 172.21.15.73:0/632913704 conn(0x7f9b1c071430 msgr2=0x7f9b1c0c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 shutdown_connections 2024-03-04T08:49:11.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.134+0000 7f9b23c39640 1 -- 172.21.15.73:0/632913704 wait complete. 2024-03-04T08:49:11.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 1c113f5b-e4ca-44ef-aedc-298f00621e02 7 2024-03-04T08:49:11.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.244+0000 7f93dab08640 1 Processor -- start 2024-03-04T08:49:11.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.244+0000 7f93dab08640 1 -- start start 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.245+0000 7f93dab08640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93d4154c00 0x7f93d415b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.245+0000 7f93dab08640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93d40cddb0 0x7f93d4066c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.245+0000 7f93dab08640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d406c830 con 0x7f93d4067180 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.245+0000 7f93dab08640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d415b790 con 0x7f93d4154c00 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.245+0000 7f93dab08640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d406cb10 con 0x7f93d40cddb0 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.245+0000 7f93d3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93d40cddb0 0x7f93d4066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.246+0000 7f93d3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93d40cddb0 0x7f93d4066c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41060/0 (socket says 172.21.15.73:41060) 2024-03-04T08:49:11.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.246+0000 7f93d90a5640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f93d4067180 0x7f93d40ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58806/0 (socket says 172.21.15.73:58806) 2024-03-04T08:49:11.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.246+0000 7f93d3fff640 1 -- 172.21.15.73:0/4275902337 learned_addr learned my addr 172.21.15.73:0/4275902337 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:11.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.248+0000 7f93d3fff640 1 -- 172.21.15.73:0/4275902337 >> v2:172.21.15.46:3300/0 conn(0x7f93d4154c00 msgr2=0x7f93d415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:11.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.248+0000 7f93d3fff640 1 --2- 172.21.15.73:0/4275902337 >> v2:172.21.15.46:3300/0 conn(0x7f93d4154c00 0x7f93d415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.248+0000 7f93d3fff640 1 -- 172.21.15.73:0/4275902337 >> v1:172.21.15.73:6789/0 conn(0x7f93d4067180 legacy=0x7f93d40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:11.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.248+0000 7f93d3fff640 1 -- 172.21.15.73:0/4275902337 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d406cdf0 con 0x7f93d40cddb0 2024-03-04T08:49:11.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.252+0000 7f93d3fff640 1 --2- 172.21.15.73:0/4275902337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d40cddb0 0x7f93d4066c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93d408d630 tx=0x7f93c002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19865f33a38f7cde server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:11.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.255+0000 7f93d37fe640 1 -- 172.21.15.73:0/4275902337 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0034070 con 0x7f93d40cddb0 2024-03-04T08:49:11.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.255+0000 7f93d37fe640 1 -- 172.21.15.73:0/4275902337 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0030860 con 0x7f93d40cddb0 2024-03-04T08:49:11.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.255+0000 7f93d37fe640 1 -- 172.21.15.73:0/4275902337 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0030c30 con 0x7f93d40cddb0 2024-03-04T08:49:11.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 -- 172.21.15.73:0/4275902337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d40cddb0 msgr2=0x7f93d4066c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:11.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 --2- 172.21.15.73:0/4275902337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d40cddb0 0x7f93d4066c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93d408d630 tx=0x7f93c002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 -- 172.21.15.73:0/4275902337 shutdown_connections 2024-03-04T08:49:11.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 --2- 172.21.15.73:0/4275902337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d40cddb0 0x7f93d4066c40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 --2- 172.21.15.73:0/4275902337 >> v2:172.21.15.46:3300/0 conn(0x7f93d4154c00 0x7f93d415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 -- 172.21.15.73:0/4275902337 >> 172.21.15.73:0/4275902337 conn(0x7f93d40cfca0 msgr2=0x7f93d40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:11.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 -- 172.21.15.73:0/4275902337 shutdown_connections 2024-03-04T08:49:11.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.256+0000 7f93dab08640 1 -- 172.21.15.73:0/4275902337 wait complete. 2024-03-04T08:49:11.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.258+0000 7f93dab08640 1 Processor -- start 2024-03-04T08:49:11.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.258+0000 7f93dab08640 1 -- start start 2024-03-04T08:49:11.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93dab08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 0x7f93d415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:11.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93dab08640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d40cddb0 0x7f93d41f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93dab08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d4154c00 0x7f93d414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93dab08640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4067680 con 0x7f93d4154c00 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93dab08640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d406d3b0 con 0x7f93d4067180 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93dab08640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d406d8d0 con 0x7f93d40cddb0 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93d88a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 0x7f93d415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93d3fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d40cddb0 0x7f93d41f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93d88a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 0x7f93d415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41062/0 (socket says 172.21.15.73:41062) 2024-03-04T08:49:11.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.259+0000 7f93d88a4640 1 -- 172.21.15.73:0/1480262012 learned_addr learned my addr 172.21.15.73:0/1480262012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-04T08:49:11.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.264+0000 7f93d88a4640 1 -- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d40cddb0 msgr2=0x7f93d41f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:11.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.264+0000 7f93d88a4640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d40cddb0 0x7f93d41f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.264+0000 7f93d88a4640 1 -- 172.21.15.73:0/1480262012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d4154c00 msgr2=0x7f93d414c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:11.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.264+0000 7f93d88a4640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d4154c00 0x7f93d414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:11.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.264+0000 7f93d88a4640 1 -- 172.21.15.73:0/1480262012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d41f0000 con 0x7f93d4067180 2024-03-04T08:49:11.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.266+0000 7f93d88a4640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 0x7f93d415d210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93c800b500 tx=0x7f93c800b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:11.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.270+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8014070 con 0x7f93d4067180 2024-03-04T08:49:11.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.270+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8010870 con 0x7f93d4067180 2024-03-04T08:49:11.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.270+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8010c60 con 0x7f93d4067180 2024-03-04T08:49:11.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.270+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40b1590 con 0x7f93d4067180 2024-03-04T08:49:11.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.270+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d41e67e0 con 0x7f93d4067180 2024-03-04T08:49:11.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.271+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d40680b0 con 0x7f93d4067180 2024-03-04T08:49:11.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.282+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 2) v1 ==== 44915+0+0 (secure 0 0 0) 0x7f93c8017070 con 0x7f93d4067180 2024-03-04T08:49:11.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.283+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f93c8022c20 con 0x7f93d4067180 2024-03-04T08:49:11.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.378+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f93c8017360 con 0x7f93d4067180 2024-03-04T08:49:11.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.461+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c113f5b-e4ca-44ef-aedc-298f00621e02", "id": 7} v 0) v1 -- 0x7f93d41581c0 con 0x7f93d4067180 2024-03-04T08:49:11.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.957+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 3) v1 ==== 89618+0+0 (secure 0 0 0) 0x7f93c80239a0 con 0x7f93d4067180 2024-03-04T08:49:11.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.957+0000 7f93d17fa640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f93b806b870 0x7f93b806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:11.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.957+0000 7f93d3fff640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f93b806b870 0x7f93b806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:11.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:11.958+0000 7f93d3fff640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f93b806b870 0x7f93b806dc60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f93c0036000 tx=0x7f93c0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:12.015 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:12.019+0000 7faceaf1c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-04T08:49:12.047 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T08:49:12.050+0000 7faceaf1c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-04T08:49:12.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.545+0000 7f93d17fa640 1 -- 172.21.15.73:0/1480262012 <== mon.1 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c113f5b-e4ca-44ef-aedc-298f00621e02", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f93c805b500 con 0x7f93d4067180 2024-03-04T08:49:12.542 INFO:teuthology.orchestra.run.smithi073.stdout:7 2024-03-04T08:49:12.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.545+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f93b806b870 msgr2=0x7f93b806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:12.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.545+0000 7f93dab08640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f93b806b870 0x7f93b806dc60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f93c0036000 tx=0x7f93c0008030 comp rx=0 tx=0).stop 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.545+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 msgr2=0x7f93d415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 0x7f93d415d210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93c800b500 tx=0x7f93c800b9c0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 shutdown_connections 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f93b806b870 0x7f93b806dc60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d4154c00 0x7f93d414c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d40cddb0 0x7f93d41f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 --2- 172.21.15.73:0/1480262012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4067180 0x7f93d415d210 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 >> 172.21.15.73:0/1480262012 conn(0x7f93d40cfca0 msgr2=0x7f93d414eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 shutdown_connections 2024-03-04T08:49:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-04T08:49:12.546+0000 7f93dab08640 1 -- 172.21.15.73:0/1480262012 wait complete. 2024-03-04T08:49:12.553 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-04T08:49:12.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-03-04T08:49:12.561 INFO:tasks.ceph.osd.0:Started 2024-03-04T08:49:12.562 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-04T08:49:12.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-03-04T08:49:12.569 INFO:tasks.ceph.osd.1:Started 2024-03-04T08:49:12.569 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-04T08:49:12.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-03-04T08:49:12.574 INFO:tasks.ceph.osd.2:Started 2024-03-04T08:49:12.574 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-04T08:49:12.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-03-04T08:49:12.580 INFO:tasks.ceph.osd.3:Started 2024-03-04T08:49:12.581 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-04T08:49:12.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-03-04T08:49:12.583 INFO:tasks.ceph.osd.4:Started 2024-03-04T08:49:12.583 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-04T08:49:12.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-03-04T08:49:12.585 INFO:tasks.ceph.osd.5:Started 2024-03-04T08:49:12.585 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-04T08:49:12.586 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-03-04T08:49:12.587 INFO:tasks.ceph.osd.6:Started 2024-03-04T08:49:12.588 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-04T08:49:12.588 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-03-04T08:49:12.590 INFO:tasks.ceph.osd.7:Started 2024-03-04T08:49:12.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.826+0000 7fb701600640 1 Processor -- start 2024-03-04T08:49:12.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.826+0000 7fb701600640 1 -- start start 2024-03-04T08:49:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.827+0000 7fb701600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6fc154410 0x7fb6fc15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.827+0000 7fb701600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb6fc15add0 0x7fb6fc0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.828+0000 7fb701600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc0c47b0 0x7fb6fc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.828+0000 7fb701600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc15a400 con 0x7fb6fc15add0 2024-03-04T08:49:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.828+0000 7fb701600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc06dad0 con 0x7fb6fc154410 2024-03-04T08:49:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.828+0000 7fb701600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c3980 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.828+0000 7fb700c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc0c47b0 0x7fb6fc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.828+0000 7fb6fbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6fc154410 0x7fb6fc15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.829+0000 7fb700c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc0c47b0 0x7fb6fc0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48952/0 (socket says 172.21.15.46:48952) 2024-03-04T08:49:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.829+0000 7fb700c00640 1 -- 172.21.15.46:0/232174036 learned_addr learned my addr 172.21.15.46:0/232174036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.829+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/232174036 >> v2:172.21.15.73:3300/0 conn(0x7fb6fc154410 0x7fb6fc15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41142/0 (socket says 172.21.15.46:41142) 2024-03-04T08:49:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.831+0000 7fb6fbe00640 1 -- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc0c47b0 msgr2=0x7fb6fc0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.831+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc0c47b0 0x7fb6fc0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.831+0000 7fb6fbe00640 1 -- 172.21.15.46:0/232174036 >> v2:172.21.15.46:3300/0 conn(0x7fb6fc15add0 msgr2=0x7fb6fc0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.831+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/232174036 >> v2:172.21.15.46:3300/0 conn(0x7fb6fc15add0 0x7fb6fc0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.831+0000 7fb6fbe00640 1 -- 172.21.15.46:0/232174036 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc06ca30 con 0x7fb6fc154410 2024-03-04T08:49:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.833+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 0x7fb6fc15a890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc072d80 tx=0x7fb6ec02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81cb22d677b93b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.848+0000 7fb6faa00640 1 -- 172.21.15.46:0/232174036 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec037070 con 0x7fb6fc154410 2024-03-04T08:49:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.848+0000 7fb6faa00640 1 -- 172.21.15.46:0/232174036 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec030710 con 0x7fb6fc154410 2024-03-04T08:49:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.848+0000 7fb6faa00640 1 -- 172.21.15.46:0/232174036 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec030ae0 con 0x7fb6fc154410 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 -- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 msgr2=0x7fb6fc15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 --2- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 0x7fb6fc15a890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc072d80 tx=0x7fb6ec02b710 comp rx=0 tx=0).stop 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 -- 172.21.15.46:0/232174036 shutdown_connections 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 --2- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc0c47b0 0x7fb6fc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 --2- 172.21.15.46:0/232174036 >> v2:172.21.15.46:3300/0 conn(0x7fb6fc15add0 0x7fb6fc0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 --2- 172.21.15.46:0/232174036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 0x7fb6fc15a890 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 -- 172.21.15.46:0/232174036 >> 172.21.15.46:0/232174036 conn(0x7fb6fc066c40 msgr2=0x7fb6fc067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 -- 172.21.15.46:0/232174036 shutdown_connections 2024-03-04T08:49:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.849+0000 7fb701600640 1 -- 172.21.15.46:0/232174036 wait complete. 2024-03-04T08:49:12.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.852+0000 7fb701600640 1 Processor -- start 2024-03-04T08:49:12.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.852+0000 7fb701600640 1 -- start start 2024-03-04T08:49:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.853+0000 7fb701600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 0x7fb6fc1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.853+0000 7fb701600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 0x7fb6fc0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.853+0000 7fb701600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc15add0 0x7fb6fc1f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.853+0000 7fb701600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c3c20 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.853+0000 7fb701600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc1547f0 con 0x7fb6fc154410 2024-03-04T08:49:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.853+0000 7fb701600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c3f00 con 0x7fb6fc15add0 2024-03-04T08:49:12.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.856+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 0x7fb6fc1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:12.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.856+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 0x7fb6fc1558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59372/0 (socket says 172.21.15.46:59372) 2024-03-04T08:49:12.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.856+0000 7fb6fbe00640 1 -- 172.21.15.46:0/3267387625 learned_addr learned my addr 172.21.15.46:0/3267387625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.860+0000 7fb6fbe00640 1 -- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc15add0 msgr2=0x7fb6fc1f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.860+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc15add0 0x7fb6fc1f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.860+0000 7fb6fbe00640 1 -- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 msgr2=0x7fb6fc0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.860+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 0x7fb6fc0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.860+0000 7fb6fbe00640 1 -- 172.21.15.46:0/3267387625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc15d840 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.862+0000 7fb6fbe00640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 0x7fb6fc1558e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009890 tx=0x7fb6ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:12.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.867+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec040020 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.867+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec032930 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.867+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec037040 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.867+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc15db20 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.867+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc15e0e0 con 0x7fb6fc0c47b0 2024-03-04T08:49:12.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:12.869+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc04f330 con 0x7fb6fc0c47b0 2024-03-04T08:49:13.203 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-03-04T08:49:13.206+0000 7f27e521a640 -1 Falling back to public interface 2024-03-04T08:49:13.218 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-03-04T08:49:13.221+0000 7fb9b580c640 -1 Falling back to public interface 2024-03-04T08:49:13.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.221+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fb6ec043020 con 0x7fb6fc0c47b0 2024-03-04T08:49:13.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.223+0000 7fb6f3e00640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb6dc06b490 0x7fb6dc06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:13.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.224+0000 7fb6fb400640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb6dc06b490 0x7fb6dc06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:13.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.225+0000 7fb6fb400640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb6dc06b490 0x7fb6dc06d950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0c4260 tx=0x7fb6e8006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:13.225 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T08:49:13.228+0000 7f5eb008b640 -1 Falling back to public interface 2024-03-04T08:49:13.225 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-03-04T08:49:13.228+0000 7fbc6e415640 -1 Falling back to public interface 2024-03-04T08:49:13.225 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T08:49:13.229+0000 7f5eaf03a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2024-03-04T08:49:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.269+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb6ec078fe0 con 0x7fb6fc0c47b0 2024-03-04T08:49:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.271+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb6ec04a030 con 0x7fb6fc0c47b0 2024-03-04T08:49:13.293 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-04T08:49:13.296+0000 7f121480c640 -1 Falling back to public interface 2024-03-04T08:49:13.298 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-04T08:49:13.301+0000 7f8bf2c10640 -1 Falling back to public interface 2024-03-04T08:49:13.319 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T08:49:13.322+0000 7f97af6f9640 -1 Falling back to public interface 2024-03-04T08:49:13.320 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-04T08:49:13.323+0000 7f40bc32a640 -1 Falling back to public interface 2024-03-04T08:49:13.321 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T08:49:13.324+0000 7f97ae200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-03-04T08:49:13.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.501+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6fc0c9110 con 0x7fb6fc0c47b0 2024-03-04T08:49:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.586+0000 7fb6f3e00640 1 -- 172.21.15.46:0/3267387625 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb6ec07aa50 con 0x7fb6fc0c47b0 2024-03-04T08:49:13.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:13.584 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:12.331604+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb6dc06b490 msgr2=0x7fb6dc06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb6dc06b490 0x7fb6dc06d950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0c4260 tx=0x7fb6e8006c90 comp rx=0 tx=0).stop 2024-03-04T08:49:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 msgr2=0x7fb6fc1558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 0x7fb6fc1558e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009890 tx=0x7fb6ec0046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 shutdown_connections 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb6dc06b490 0x7fb6dc06d950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6fc154410 0x7fb6fc0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6fc15add0 0x7fb6fc1f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 --2- 172.21.15.46:0/3267387625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6fc0c47b0 0x7fb6fc1558e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 >> 172.21.15.46:0/3267387625 conn(0x7fb6fc066c40 msgr2=0x7fb6fc0ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 shutdown_connections 2024-03-04T08:49:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:13.589+0000 7fb701600640 1 -- 172.21.15.46:0/3267387625 wait complete. 2024-03-04T08:49:13.605 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-04T08:49:13.605 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-04T08:49:14.412 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:14.571 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.574+0000 7fe175e00640 1 Processor -- start 2024-03-04T08:49:14.571 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.574+0000 7fe175e00640 1 -- start start 2024-03-04T08:49:14.573 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.575+0000 7fe175e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe1700cc120 0x7fe17015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:14.573 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.575+0000 7fe175e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17015ee10 con 0x7fe1700723a0 2024-03-04T08:49:14.573 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.575+0000 7fe175e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17015f0d0 con 0x7fe1700cbd40 2024-03-04T08:49:14.573 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.575+0000 7fe175e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe170162d20 con 0x7fe1700cc120 2024-03-04T08:49:14.573 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.576+0000 7fe16ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe1700cbd40 0x7fe170162610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:38874/0 (socket says 172.21.15.46:38874) 2024-03-04T08:49:14.573 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.576+0000 7fe16ea00640 1 -- 172.21.15.46:0/3564694578 learned_addr learned my addr 172.21.15.46:0/3564694578 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:14.574 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.577+0000 7fe167e00640 1 --2- 172.21.15.46:0/3564694578 >> v2:172.21.15.46:3300/0 conn(0x7fe1700cc120 0x7fe17015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:14.576 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.578+0000 7fe16e000640 1 -- 172.21.15.46:0/3564694578 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742394627 0 0) 0x7fe17015f0d0 con 0x7fe1700cbd40 2024-03-04T08:49:14.576 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.579+0000 7fe16e000640 1 -- 172.21.15.46:0/3564694578 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe154003520 con 0x7fe1700cbd40 2024-03-04T08:49:14.578 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.580+0000 7fe167e00640 1 -- 172.21.15.46:0/3564694578 >> v1:172.21.15.73:6789/0 conn(0x7fe1700cbd40 legacy=0x7fe170162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:14.578 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.580+0000 7fe167e00640 1 -- 172.21.15.46:0/3564694578 >> v1:172.21.15.46:6789/0 conn(0x7fe1700723a0 legacy=0x7fe170158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:14.578 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.580+0000 7fe167e00640 1 -- 172.21.15.46:0/3564694578 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17015f3b0 con 0x7fe1700cc120 2024-03-04T08:49:14.582 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.584+0000 7fe167e00640 1 --2- 172.21.15.46:0/3564694578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cc120 0x7fe17015e780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1580097a0 tx=0x7fe15802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e351903c74977a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:14.585 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.588+0000 7fe16e000640 1 -- 172.21.15.46:0/3564694578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15802f810 con 0x7fe1700cc120 2024-03-04T08:49:14.585 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.588+0000 7fe16e000640 1 -- 172.21.15.46:0/3564694578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15802f9b0 con 0x7fe1700cc120 2024-03-04T08:49:14.585 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.588+0000 7fe16e000640 1 -- 172.21.15.46:0/3564694578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15802fd80 con 0x7fe1700cc120 2024-03-04T08:49:14.586 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 -- 172.21.15.46:0/3564694578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cc120 msgr2=0x7fe17015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:14.586 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 --2- 172.21.15.46:0/3564694578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cc120 0x7fe17015e780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1580097a0 tx=0x7fe15802b9f0 comp rx=0 tx=0).stop 2024-03-04T08:49:14.587 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 -- 172.21.15.46:0/3564694578 shutdown_connections 2024-03-04T08:49:14.587 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 --2- 172.21.15.46:0/3564694578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cc120 0x7fe17015e780 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:14.587 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 -- 172.21.15.46:0/3564694578 >> 172.21.15.46:0/3564694578 conn(0x7fe17006b5c0 msgr2=0x7fe17006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:14.587 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 -- 172.21.15.46:0/3564694578 shutdown_connections 2024-03-04T08:49:14.587 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.589+0000 7fe175e00640 1 -- 172.21.15.46:0/3564694578 wait complete. 2024-03-04T08:49:14.588 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.591+0000 7fe175e00640 1 Processor -- start 2024-03-04T08:49:14.589 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.591+0000 7fe175e00640 1 -- start start 2024-03-04T08:49:14.590 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.592+0000 7fe175e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1700723a0 0x7fe1700cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:14.590 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.592+0000 7fe175e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cbd40 0x7fe17014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:14.590 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.592+0000 7fe175e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700cc120 0x7fe17014f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:14.590 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.592+0000 7fe175e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1701620f0 con 0x7fe1700cbd40 2024-03-04T08:49:14.590 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.592+0000 7fe175e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe170161e10 con 0x7fe1700cc120 2024-03-04T08:49:14.590 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.592+0000 7fe175e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700c6e70 con 0x7fe1700723a0 2024-03-04T08:49:14.591 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.593+0000 7fe167e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cbd40 0x7fe17014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:14.591 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.593+0000 7fe16ea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1700723a0 0x7fe1700cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:14.591 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.593+0000 7fe16f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700cc120 0x7fe17014f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:14.591 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.593+0000 7fe167e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cbd40 0x7fe17014f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59382/0 (socket says 172.21.15.46:59382) 2024-03-04T08:49:14.591 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.593+0000 7fe167e00640 1 -- 172.21.15.46:0/4015283405 learned_addr learned my addr 172.21.15.46:0/4015283405 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:14.594 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.597+0000 7fe16ea00640 1 -- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700cc120 msgr2=0x7fe17014f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:14.594 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.597+0000 7fe16ea00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700cc120 0x7fe17014f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:14.594 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.597+0000 7fe16ea00640 1 -- 172.21.15.46:0/4015283405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cbd40 msgr2=0x7fe17014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:14.594 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.597+0000 7fe16ea00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cbd40 0x7fe17014f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:14.594 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.597+0000 7fe16ea00640 1 -- 172.21.15.46:0/4015283405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170161570 con 0x7fe1700723a0 2024-03-04T08:49:14.597 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.600+0000 7fe16ea00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1700723a0 0x7fe1700cb200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c460 tx=0x7fe16000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:14.601 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.603+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160017070 con 0x7fe1700723a0 2024-03-04T08:49:14.601 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.603+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160005ce0 con 0x7fe1700723a0 2024-03-04T08:49:14.601 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.603+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160007270 con 0x7fe1700723a0 2024-03-04T08:49:14.601 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.603+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe170155ce0 con 0x7fe1700723a0 2024-03-04T08:49:14.601 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.604+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe170161af0 con 0x7fe1700723a0 2024-03-04T08:49:14.602 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.605+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17004f330 con 0x7fe1700723a0 2024-03-04T08:49:14.621 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.624+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fe16001a070 con 0x7fe1700723a0 2024-03-04T08:49:14.622 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.625+0000 7fe167400640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe14c06b490 0x7fe14c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:14.622 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.625+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe160088710 con 0x7fe1700723a0 2024-03-04T08:49:14.622 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.625+0000 7fe167e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe14c06b490 0x7fe14c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:14.623 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.626+0000 7fe167e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe14c06b490 0x7fe14c06d950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe17015cfb0 tx=0x7fe158008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:14.865 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:14.868+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe1600580e0 con 0x7fe1700723a0 2024-03-04T08:49:15.079 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.082+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe170072180 con 0x7fe1700723a0 2024-03-04T08:49:15.128 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.131+0000 7fe167400640 1 -- 172.21.15.46:0/4015283405 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe16005c180 con 0x7fe1700723a0 2024-03-04T08:49:15.128 INFO:teuthology.misc.health.smithi046.stdout: 2024-03-04T08:49:15.129 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:12.331604+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:15.131 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe14c06b490 msgr2=0x7fe14c06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:15.131 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe14c06b490 0x7fe14c06d950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe17015cfb0 tx=0x7fe158008030 comp rx=0 tx=0).stop 2024-03-04T08:49:15.131 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1700723a0 msgr2=0x7fe1700cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1700723a0 0x7fe1700cb200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c460 tx=0x7fe16000c920 comp rx=0 tx=0).stop 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 shutdown_connections 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe14c06b490 0x7fe14c06d950 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700cc120 0x7fe17014f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1700cbd40 0x7fe17014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 --2- 172.21.15.46:0/4015283405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1700723a0 0x7fe1700cb200 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.133+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 >> 172.21.15.46:0/4015283405 conn(0x7fe17006b5c0 msgr2=0x7fe17015e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:15.132 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.134+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 shutdown_connections 2024-03-04T08:49:15.133 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:15.134+0000 7fe175e00640 1 -- 172.21.15.46:0/4015283405 wait complete. 2024-03-04T08:49:15.146 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-04T08:49:16.643 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-03-04T08:49:16.647+0000 7f27e521a640 -1 osd.7 0 log_to_monitors true 2024-03-04T08:49:16.704 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-03-04T08:49:16.708+0000 7fbc6e415640 -1 osd.4 0 log_to_monitors true 2024-03-04T08:49:16.736 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T08:49:16.740+0000 7f5eb008b640 -1 osd.5 0 log_to_monitors true 2024-03-04T08:49:16.766 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-03-04T08:49:16.769+0000 7fb9b580c640 -1 osd.6 0 log_to_monitors true 2024-03-04T08:49:16.829 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-04T08:49:16.831+0000 7f121480c640 -1 osd.1 0 log_to_monitors true 2024-03-04T08:49:16.881 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-04T08:49:16.884+0000 7f8bf2c10640 -1 osd.0 0 log_to_monitors true 2024-03-04T08:49:17.153 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T08:49:17.155+0000 7f97af6f9640 -1 osd.2 0 log_to_monitors true 2024-03-04T08:49:17.157 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-04T08:49:17.160+0000 7f40bc32a640 -1 osd.3 0 log_to_monitors true 2024-03-04T08:49:20.118 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-03-04T08:49:20.121+0000 7fbc6ae21640 -1 osd.4 0 waiting for initial osdmap 2024-03-04T08:49:20.141 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-03-04T08:49:20.144+0000 7f27e1b76640 -1 osd.7 0 waiting for initial osdmap 2024-03-04T08:49:20.172 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-03-04T08:49:20.176+0000 7fbc61c1b640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:20.176 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-03-04T08:49:20.180+0000 7f27d8970640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:20.182 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T08:49:20.186+0000 7f5eab7fe640 -1 osd.5 0 waiting for initial osdmap 2024-03-04T08:49:20.226 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T08:49:20.229+0000 7f5ea3e30640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:20.241 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-03-04T08:49:20.244+0000 7fb9b228a640 -1 osd.6 0 waiting for initial osdmap 2024-03-04T08:49:20.256 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-03-04T08:49:20.260+0000 7fb9a9084640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:21.329 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-04T08:49:21.333+0000 7f120e600640 -1 osd.1 0 waiting for initial osdmap 2024-03-04T08:49:21.331 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T08:49:21.335+0000 7f97a9c00640 -1 osd.2 0 waiting for initial osdmap 2024-03-04T08:49:21.344 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-04T08:49:21.348+0000 7f8becc00640 -1 osd.0 0 waiting for initial osdmap 2024-03-04T08:49:21.353 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T08:49:21.357+0000 7f97a0600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:21.353 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-04T08:49:21.357+0000 7f1205000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:21.359 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-04T08:49:21.363+0000 7f8be3600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:21.365 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-04T08:49:21.369+0000 7f40b8600640 -1 osd.3 0 waiting for initial osdmap 2024-03-04T08:49:21.378 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-04T08:49:21.382+0000 7f40ad200640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:49:21.952 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:22.154 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.157+0000 7f303b200640 1 Processor -- start 2024-03-04T08:49:22.154 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.157+0000 7f303b200640 1 -- start start 2024-03-04T08:49:22.155 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.159+0000 7f303b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30340c4c50 0x7f303415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:22.155 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.159+0000 7f303b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f303415e3b0 0x7f30340cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:22.155 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.159+0000 7f303b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340c5130 con 0x7f3034154440 2024-03-04T08:49:22.155 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.159+0000 7f303b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303415d700 con 0x7f303415e3b0 2024-03-04T08:49:22.155 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.159+0000 7f303b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303415a6e0 con 0x7f30340c4c50 2024-03-04T08:49:22.156 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.160+0000 7f3039400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30340c4c50 0x7f303415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:22.156 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.160+0000 7f3039400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30340c4c50 0x7f303415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:53834/0 (socket says 172.21.15.46:53834) 2024-03-04T08:49:22.156 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.160+0000 7f3039400640 1 -- 172.21.15.46:0/2362254534 learned_addr learned my addr 172.21.15.46:0/2362254534 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:22.158 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.162+0000 7f3039400640 1 -- 172.21.15.46:0/2362254534 >> v2:172.21.15.46:3300/0 conn(0x7f303415e3b0 msgr2=0x7f30340cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:22.158 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.162+0000 7f3039400640 1 --2- 172.21.15.46:0/2362254534 >> v2:172.21.15.46:3300/0 conn(0x7f303415e3b0 0x7f30340cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.158 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.162+0000 7f3039400640 1 -- 172.21.15.46:0/2362254534 >> v1:172.21.15.46:6789/0 conn(0x7f3034154440 legacy=0x7f30340cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:22.158 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.162+0000 7f3039400640 1 -- 172.21.15.46:0/2362254534 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303415a9c0 con 0x7f30340c4c50 2024-03-04T08:49:22.160 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.164+0000 7f3039400640 1 --2- 172.21.15.46:0/2362254534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30340c4c50 0x7f303415de70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f30340b25c0 tx=0x7f302402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1612fd639927818e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:22.165 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.169+0000 7f3038a00640 1 -- 172.21.15.46:0/2362254534 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024034070 con 0x7f30340c4c50 2024-03-04T08:49:22.165 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.169+0000 7f3038a00640 1 -- 172.21.15.46:0/2362254534 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024030860 con 0x7f30340c4c50 2024-03-04T08:49:22.165 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.169+0000 7f3038a00640 1 -- 172.21.15.46:0/2362254534 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024030c30 con 0x7f30340c4c50 2024-03-04T08:49:22.166 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 -- 172.21.15.46:0/2362254534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30340c4c50 msgr2=0x7f303415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:22.166 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 --2- 172.21.15.46:0/2362254534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30340c4c50 0x7f303415de70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f30340b25c0 tx=0x7f302402b9a0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.167 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 -- 172.21.15.46:0/2362254534 shutdown_connections 2024-03-04T08:49:22.167 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 --2- 172.21.15.46:0/2362254534 >> v2:172.21.15.46:3300/0 conn(0x7f303415e3b0 0x7f30340cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.167 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 --2- 172.21.15.46:0/2362254534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30340c4c50 0x7f303415de70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.167 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 -- 172.21.15.46:0/2362254534 >> 172.21.15.46:0/2362254534 conn(0x7f30340728a0 msgr2=0x7f3034072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:22.167 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 -- 172.21.15.46:0/2362254534 shutdown_connections 2024-03-04T08:49:22.167 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.170+0000 7f303b200640 1 -- 172.21.15.46:0/2362254534 wait complete. 2024-03-04T08:49:22.168 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.172+0000 7f303b200640 1 Processor -- start 2024-03-04T08:49:22.169 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.173+0000 7f303b200640 1 -- start start 2024-03-04T08:49:22.170 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f303b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c4c50 0x7f30340b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:22.170 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f303b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034154440 0x7f30341466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:22.170 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f303b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303415e3b0 0x7f3034158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:22.170 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f303b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303415d950 con 0x7f30340c4c50 2024-03-04T08:49:22.170 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f303b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303415af80 con 0x7f3034154440 2024-03-04T08:49:22.170 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f303b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3034154820 con 0x7f303415e3b0 2024-03-04T08:49:22.171 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.174+0000 7f3039400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034154440 0x7f30341466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:22.171 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.175+0000 7f303a800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303415e3b0 0x7f3034158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:22.171 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.175+0000 7f3039400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034154440 0x7f30341466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:53850/0 (socket says 172.21.15.46:53850) 2024-03-04T08:49:22.171 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.175+0000 7f3039400640 1 -- 172.21.15.46:0/1580797376 learned_addr learned my addr 172.21.15.46:0/1580797376 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:22.174 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.178+0000 7f303a800640 1 -- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034154440 msgr2=0x7f30341466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:22.175 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.178+0000 7f303a800640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034154440 0x7f30341466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.175 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.178+0000 7f303a800640 1 -- 172.21.15.46:0/1580797376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c4c50 msgr2=0x7f30340b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:22.175 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.178+0000 7f303a800640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c4c50 0x7f30340b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.175 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.178+0000 7f303a800640 1 -- 172.21.15.46:0/1580797376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034146bf0 con 0x7f303415e3b0 2024-03-04T08:49:22.177 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.181+0000 7f303a800640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303415e3b0 0x7f3034158d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f303000be20 tx=0x7f303000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:22.181 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.184+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030019070 con 0x7f303415e3b0 2024-03-04T08:49:22.181 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.184+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3030014440 con 0x7f303415e3b0 2024-03-04T08:49:22.181 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.184+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030014830 con 0x7f303415e3b0 2024-03-04T08:49:22.181 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.185+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340b5a00 con 0x7f303415e3b0 2024-03-04T08:49:22.181 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.185+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340b3f70 con 0x7f303415e3b0 2024-03-04T08:49:22.183 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.186+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3034075760 con 0x7f303415e3b0 2024-03-04T08:49:22.201 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.205+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f303001c070 con 0x7f303415e3b0 2024-03-04T08:49:22.202 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.206+0000 7f302e000640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f301806b490 0x7f301806d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:22.203 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.206+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f3030089ac0 con 0x7f303415e3b0 2024-03-04T08:49:22.203 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.207+0000 7f3039e00640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f301806b490 0x7f301806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:22.203 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.207+0000 7f3039e00640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f301806b490 0x7f301806d950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3028001560 tx=0x7f3028007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:22.446 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.449+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3030023020 con 0x7f303415e3b0 2024-03-04T08:49:22.702 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.706+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30340c9e10 con 0x7f303415e3b0 2024-03-04T08:49:22.847 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.850+0000 7f302e000640 1 -- 172.21.15.46:0/1580797376 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10895 (secure 0 0 0) 0x7f3034146bf0 con 0x7f303415e3b0 2024-03-04T08:49:22.847 INFO:teuthology.misc.health.smithi046.stdout: 2024-03-04T08:49:22.847 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":15,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:22.011478+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f301806b490 msgr2=0x7f301806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f301806b490 0x7f301806d950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3028001560 tx=0x7f3028007990 comp rx=0 tx=0).stop 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303415e3b0 msgr2=0x7f3034158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303415e3b0 0x7f3034158d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f303000be20 tx=0x7f303000bf10 comp rx=0 tx=0).stop 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 shutdown_connections 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f301806b490 0x7f301806d950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034154440 0x7f30341466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.852 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303415e3b0 0x7f3034158d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.853 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 --2- 172.21.15.46:0/1580797376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c4c50 0x7f30340b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:22.853 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.855+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 >> 172.21.15.46:0/1580797376 conn(0x7f30340728a0 msgr2=0x7f30340cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:22.853 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.856+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 shutdown_connections 2024-03-04T08:49:22.853 INFO:teuthology.misc.health.smithi046.stderr:2024-03-04T08:49:22.856+0000 7f303b200640 1 -- 172.21.15.46:0/1580797376 wait complete. 2024-03-04T08:49:22.871 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-04T08:49:22.871 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-04T08:49:22.871 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-04T08:49:22.871 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-04T08:49:22.872 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-03-04T08:49:22.876 INFO:tasks.ceph.mds.a:Started 2024-03-04T08:49:22.876 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-04T08:49:22.877 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-04T08:49:22.877 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-03-04T08:49:22.882 INFO:tasks.ceph.mds.c:Started 2024-03-04T08:49:22.882 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-04T08:49:22.882 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-04T08:49:22.883 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-03-04T08:49:22.887 INFO:tasks.ceph.mds.e:Started 2024-03-04T08:49:22.887 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-04T08:49:22.887 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-04T08:49:22.888 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-03-04T08:49:22.890 INFO:tasks.ceph.mds.b:Started 2024-03-04T08:49:22.890 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-04T08:49:22.890 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-04T08:49:22.890 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-03-04T08:49:22.893 INFO:tasks.ceph.mds.d:Started 2024-03-04T08:49:22.893 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-04T08:49:22.894 INFO:tasks.ceph.mds.f:Restarting daemon 2024-03-04T08:49:22.894 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-03-04T08:49:22.896 INFO:tasks.ceph.mds.f:Started 2024-03-04T08:49:22.897 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-04T08:49:22.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:23.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.101+0000 7fbaab000640 1 Processor -- start 2024-03-04T08:49:23.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.101+0000 7fbaab000640 1 -- start start 2024-03-04T08:49:23.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.103+0000 7fbaab000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:23.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.103+0000 7fbaab000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40c6d10 con 0x7fbaa40c2950 2024-03-04T08:49:23.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.103+0000 7fbaab000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40c6ff0 con 0x7fbaa406dfb0 2024-03-04T08:49:23.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.103+0000 7fbaab000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa406ea90 con 0x7fbaa40c2d30 2024-03-04T08:49:23.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.104+0000 7fbaa9000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:23.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.104+0000 7fbaa3400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbaa406dfb0 0x7fbaa406d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:57570/0 (socket says 172.21.15.46:57570) 2024-03-04T08:49:23.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.104+0000 7fbaa3400640 1 -- 172.21.15.46:0/1430944751 learned_addr learned my addr 172.21.15.46:0/1430944751 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:23.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.107+0000 7fbaa9000640 1 -- 172.21.15.46:0/1430944751 >> v1:172.21.15.73:6789/0 conn(0x7fbaa406dfb0 legacy=0x7fbaa406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.107+0000 7fbaa9000640 1 -- 172.21.15.46:0/1430944751 >> v1:172.21.15.46:6789/0 conn(0x7fbaa40c2950 legacy=0x7fbaa41625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.107+0000 7fbaa9000640 1 -- 172.21.15.46:0/1430944751 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40c72d0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.110+0000 7fbaa9000640 1 --2- 172.21.15.46:0/1430944751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa406e550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009dc0 tx=0x7fba9c02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36554dac5b687465 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.114+0000 7fbaa2a00640 1 -- 172.21.15.46:0/1430944751 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c039070 con 0x7fbaa40c2d30 2024-03-04T08:49:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.114+0000 7fbaa2a00640 1 -- 172.21.15.46:0/1430944751 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c02ccc0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.114+0000 7fbaa2a00640 1 -- 172.21.15.46:0/1430944751 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c034660 con 0x7fbaa40c2d30 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.115+0000 7fbaab000640 1 -- 172.21.15.46:0/1430944751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 msgr2=0x7fbaa406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.115+0000 7fbaab000640 1 --2- 172.21.15.46:0/1430944751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa406e550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009dc0 tx=0x7fba9c02bf10 comp rx=0 tx=0).stop 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.116+0000 7fbaab000640 1 -- 172.21.15.46:0/1430944751 shutdown_connections 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.116+0000 7fbaab000640 1 --2- 172.21.15.46:0/1430944751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa406e550 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.116+0000 7fbaab000640 1 -- 172.21.15.46:0/1430944751 >> 172.21.15.46:0/1430944751 conn(0x7fbaa40c88d0 msgr2=0x7fbaa40c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.116+0000 7fbaab000640 1 -- 172.21.15.46:0/1430944751 shutdown_connections 2024-03-04T08:49:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.116+0000 7fbaab000640 1 -- 172.21.15.46:0/1430944751 wait complete. 2024-03-04T08:49:23.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.118+0000 7fbaab000640 1 Processor -- start 2024-03-04T08:49:23.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.119+0000 7fbaab000640 1 -- start start 2024-03-04T08:49:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.120+0000 7fbaab000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa406dfb0 0x7fbaa41f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.120+0000 7fbaab000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaa40c2950 0x7fbaa41f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.120+0000 7fbaab000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa4150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.120+0000 7fbaab000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4161da0 con 0x7fbaa40c2950 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.120+0000 7fbaab000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4162110 con 0x7fbaa406dfb0 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.120+0000 7fbaab000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4162cb0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.121+0000 7fbaa9000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa4150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.121+0000 7fbaa3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa406dfb0 0x7fbaa41f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.121+0000 7fbaa3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaa40c2950 0x7fbaa41f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.121+0000 7fbaa9000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa4150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:54308/0 (socket says 172.21.15.46:54308) 2024-03-04T08:49:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.121+0000 7fbaa9000640 1 -- 172.21.15.46:0/239306887 learned_addr learned my addr 172.21.15.46:0/239306887 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.125+0000 7fbaa9000640 1 -- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa406dfb0 msgr2=0x7fbaa41f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.125+0000 7fbaa9000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa406dfb0 0x7fbaa41f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.125+0000 7fbaa9000640 1 -- 172.21.15.46:0/239306887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaa40c2950 msgr2=0x7fbaa41f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.125+0000 7fbaa9000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaa40c2950 0x7fbaa41f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.125+0000 7fbaa9000640 1 -- 172.21.15.46:0/239306887 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40c4a20 con 0x7fbaa40c2d30 2024-03-04T08:49:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.128+0000 7fbaa9000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa4150d50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba9c02c520 tx=0x7fba9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:23.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.131+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c044020 con 0x7fbaa40c2d30 2024-03-04T08:49:23.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.131+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa40c4c90 con 0x7fbaa40c2d30 2024-03-04T08:49:23.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.131+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa40c5250 con 0x7fbaa40c2d30 2024-03-04T08:49:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.132+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa40680b0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.133+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c02cba0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.133+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c039040 con 0x7fbaa40c2d30 2024-03-04T08:49:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.419+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fba9c005d10 con 0x7fbaa40c2d30 2024-03-04T08:49:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.420+0000 7fba9be00640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fba8406b440 0x7fba8406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.421+0000 7fbaa3e00640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fba8406b440 0x7fba8406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.422+0000 7fbaa3e00640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fba8406b440 0x7fba8406d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba94001780 tx=0x7fba94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.423+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fba9c079ec0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.441+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fba9c04e030 con 0x7fbaa40c2d30 2024-03-04T08:49:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.734+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa406fde0 con 0x7fbaa40c2d30 2024-03-04T08:49:23.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.843+0000 7fba9be00640 1 -- 172.21.15.46:0/239306887 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10895 (secure 0 0 0) 0x7fba9c07be20 con 0x7fbaa40c2d30 2024-03-04T08:49:23.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:23.840 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:22.011478+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.848+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fba8406b440 msgr2=0x7fba8406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.848+0000 7fbaab000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fba8406b440 0x7fba8406d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba94001780 tx=0x7fba94009040 comp rx=0 tx=0).stop 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.848+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 msgr2=0x7fbaa4150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.848+0000 7fbaab000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa4150d50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba9c02c520 tx=0x7fba9c004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.848+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 shutdown_connections 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fba8406b440 0x7fba8406d900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40c2d30 0x7fbaa4150d50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaa40c2950 0x7fbaa41f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 --2- 172.21.15.46:0/239306887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa406dfb0 0x7fbaa41f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:23.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 >> 172.21.15.46:0/239306887 conn(0x7fbaa40c88d0 msgr2=0x7fbaa4074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:23.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 shutdown_connections 2024-03-04T08:49:23.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:23.849+0000 7fbaab000640 1 -- 172.21.15.46:0/239306887 wait complete. 2024-03-04T08:49:23.877 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-04T08:49:23.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:49:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.094+0000 7fd426400640 1 Processor -- start 2024-03-04T08:49:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.095+0000 7fd426400640 1 -- start start 2024-03-04T08:49:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.096+0000 7fd426400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd42006d4e0 0x7fd42006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.096+0000 7fd426400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4200716f0 0x7fd420151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.096+0000 7fd426400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42015b960 con 0x7fd42006d8c0 2024-03-04T08:49:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.096+0000 7fd426400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42015bc40 con 0x7fd42006d4e0 2024-03-04T08:49:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.096+0000 7fd426400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015bf20 con 0x7fd4200716f0 2024-03-04T08:49:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.097+0000 7fd41ea00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd42006d8c0 0x7fd420158750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60212/0 (socket says 172.21.15.46:60212) 2024-03-04T08:49:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.097+0000 7fd41ea00640 1 -- 172.21.15.46:0/1044528835 learned_addr learned my addr 172.21.15.46:0/1044528835 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.101+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431731899 0 0) 0x7fd42015b960 con 0x7fd42006d8c0 2024-03-04T08:49:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.101+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd404003520 con 0x7fd42006d8c0 2024-03-04T08:49:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.105+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203425454 0 0) 0x7fd404003520 con 0x7fd42006d8c0 2024-03-04T08:49:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.105+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4200716f0 msgr2=0x7fd420151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.105+0000 7fd41e000640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4200716f0 0x7fd420151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.105+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 >> v2:172.21.15.73:3300/0 conn(0x7fd42006d4e0 msgr2=0x7fd42006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.105+0000 7fd41e000640 1 --2- 172.21.15.46:0/1044528835 >> v2:172.21.15.73:3300/0 conn(0x7fd42006d4e0 0x7fd42006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42015c200 con 0x7fd42006d8c0 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2826336207 0 0) 0x7fd40c001670 con 0x7fd42006d8c0 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 >> v1:172.21.15.46:6789/0 conn(0x7fd42006d8c0 legacy=0x7fd420158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4200716f0 0x7fd4040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd404004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd404004e60 0x7fd40400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015bc40 con 0x7fd404004e60 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015bf20 con 0x7fd404004110 2024-03-04T08:49:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.106+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040055e0 con 0x7fd4200716f0 2024-03-04T08:49:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.108+0000 7fd41fe00640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd404004e60 0x7fd40400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.110+0000 7fd41ea00640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd404004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.114+0000 7fd41ea00640 1 -- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4200716f0 msgr2=0x7fd4040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.114+0000 7fd41ea00640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4200716f0 0x7fd4040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.114+0000 7fd41ea00640 1 -- 172.21.15.46:0/1044528835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd404004e60 msgr2=0x7fd40400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.114+0000 7fd41ea00640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd404004e60 0x7fd40400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.114+0000 7fd41ea00640 1 -- 172.21.15.46:0/1044528835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404003520 con 0x7fd404004110 2024-03-04T08:49:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.116+0000 7fd41ea00640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd404004800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00c160 tx=0x7fd404005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e741f56119a55063 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.119+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c007c60 con 0x7fd404004110 2024-03-04T08:49:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c030070 con 0x7fd404004110 2024-03-04T08:49:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd41e000640 1 -- 172.21.15.46:0/1044528835 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c005d30 con 0x7fd404004110 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd426400640 1 -- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 msgr2=0x7fd404004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd426400640 1 --2- 172.21.15.46:0/1044528835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd404004800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00c160 tx=0x7fd404005830 comp rx=0 tx=0).stop 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd41fe00640 1 -- 172.21.15.46:0/1044528835 reap_dead start 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd426400640 1 -- 172.21.15.46:0/1044528835 shutdown_connections 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.120+0000 7fd426400640 1 -- 172.21.15.46:0/1044528835 >> 172.21.15.46:0/1044528835 conn(0x7fd4200c88d0 msgr2=0x7fd4200c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.121+0000 7fd426400640 1 -- 172.21.15.46:0/1044528835 shutdown_connections 2024-03-04T08:49:24.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.121+0000 7fd426400640 1 -- 172.21.15.46:0/1044528835 wait complete. 2024-03-04T08:49:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.123+0000 7fd426400640 1 Processor -- start 2024-03-04T08:49:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.123+0000 7fd426400640 1 -- start start 2024-03-04T08:49:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd426400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd4201527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd426400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4201f0360 0x7fd4200c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd426400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4201f38d0 0x7fd420153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd426400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420158fe0 con 0x7fd4201f38d0 2024-03-04T08:49:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd426400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420158e60 con 0x7fd404004110 2024-03-04T08:49:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd426400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201531b0 con 0x7fd4201f0360 2024-03-04T08:49:24.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.125+0000 7fd41f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd4201527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:24.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.126+0000 7fd41f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd4201527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:53882/0 (socket says 172.21.15.46:53882) 2024-03-04T08:49:24.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.126+0000 7fd41f400640 1 -- 172.21.15.46:0/239937925 learned_addr learned my addr 172.21.15.46:0/239937925 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.131+0000 7fd41f400640 1 -- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4201f0360 msgr2=0x7fd4200c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.131+0000 7fd41f400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4201f0360 0x7fd4200c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.131+0000 7fd41f400640 1 -- 172.21.15.46:0/239937925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4201f38d0 msgr2=0x7fd420153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.131+0000 7fd41f400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4201f38d0 0x7fd420153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.131+0000 7fd41f400640 1 -- 172.21.15.46:0/239937925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4201f07f0 con 0x7fd404004110 2024-03-04T08:49:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.134+0000 7fd41f400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd4201527f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd41000b530 tx=0x7fd41000b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.139+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410014070 con 0x7fd404004110 2024-03-04T08:49:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.139+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410010890 con 0x7fd404004110 2024-03-04T08:49:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.139+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410010c80 con 0x7fd404004110 2024-03-04T08:49:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.140+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4201f0ad0 con 0x7fd404004110 2024-03-04T08:49:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.140+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4201f1090 con 0x7fd404004110 2024-03-04T08:49:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.141+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42015b990 con 0x7fd404004110 2024-03-04T08:49:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.171+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fd410017070 con 0x7fd404004110 2024-03-04T08:49:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.173+0000 7fd417400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd40006b4c0 0x7fd40006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.173+0000 7fd41ea00640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd40006b4c0 0x7fd40006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:24.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.174+0000 7fd41ea00640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd40006b4c0 0x7fd40006d980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd40c034000 tx=0x7fd40c039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:24.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.249+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4846+0+0 (secure 0 0 0) 0x7fd41005ef30 con 0x7fd404004110 2024-03-04T08:49:24.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.430+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd42015b990 con 0x7fd404004110 2024-03-04T08:49:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.696+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4201f1260 con 0x7fd404004110 2024-03-04T08:49:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.709+0000 7fd417400640 1 -- 172.21.15.46:0/239937925 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fd410010e20 con 0x7fd404004110 2024-03-04T08:49:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:24.705 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-04T08:49:24.706 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd40006b4c0 msgr2=0x7fd40006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd40006b4c0 0x7fd40006d980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd40c034000 tx=0x7fd40c039040 comp rx=0 tx=0).stop 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 msgr2=0x7fd4201527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd4201527f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd41000b530 tx=0x7fd41000b9f0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 shutdown_connections 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd40006b4c0 0x7fd40006d980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4201f38d0 0x7fd420153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4201f0360 0x7fd4200c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 --2- 172.21.15.46:0/239937925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd404004110 0x7fd4201527f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 >> 172.21.15.46:0/239937925 conn(0x7fd4200c88d0 msgr2=0x7fd420158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 shutdown_connections 2024-03-04T08:49:24.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:24.711+0000 7fd426400640 1 -- 172.21.15.46:0/239937925 wait complete. 2024-03-04T08:49:26.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:49:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.923+0000 7fc8ce600640 1 Processor -- start 2024-03-04T08:49:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.923+0000 7fc8ce600640 1 -- start start 2024-03-04T08:49:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.924+0000 7fc8ce600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 0x7fc8c80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.924+0000 7fc8ce600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8c80cd000 0x7fc8c80cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.924+0000 7fc8ce600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c815a820 con 0x7fc8c8154580 2024-03-04T08:49:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.924+0000 7fc8ce600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c80cde80 con 0x7fc8c80cd000 2024-03-04T08:49:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.924+0000 7fc8ce600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80cc630 con 0x7fc8c815a320 2024-03-04T08:49:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.926+0000 7fc8c7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 0x7fc8c80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.926+0000 7fc8c7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 0x7fc8c80ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:54340/0 (socket says 172.21.15.46:54340) 2024-03-04T08:49:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.926+0000 7fc8c7e00640 1 -- 172.21.15.46:0/353783420 learned_addr learned my addr 172.21.15.46:0/353783420 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:26.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.927+0000 7fc8cdc00640 1 --2- 172.21.15.46:0/353783420 >> v2:172.21.15.46:3300/0 conn(0x7fc8c80cd000 0x7fc8c80cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:26.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.928+0000 7fc8c7e00640 1 -- 172.21.15.46:0/353783420 >> v2:172.21.15.46:3300/0 conn(0x7fc8c80cd000 msgr2=0x7fc8c80cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:26.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.928+0000 7fc8c7e00640 1 --2- 172.21.15.46:0/353783420 >> v2:172.21.15.46:3300/0 conn(0x7fc8c80cd000 0x7fc8c80cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:26.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.928+0000 7fc8c7e00640 1 -- 172.21.15.46:0/353783420 >> v1:172.21.15.46:6789/0 conn(0x7fc8c8154580 legacy=0x7fc8c815e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:26.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.928+0000 7fc8c7e00640 1 -- 172.21.15.46:0/353783420 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c815aae0 con 0x7fc8c815a320 2024-03-04T08:49:26.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.930+0000 7fc8c7e00640 1 --2- 172.21.15.46:0/353783420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 0x7fc8c80ccac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009870 tx=0x7fc8b402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c5942c45efa04a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:26.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.934+0000 7fc8c7400640 1 -- 172.21.15.46:0/353783420 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4035020 con 0x7fc8c815a320 2024-03-04T08:49:26.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8c7400640 1 -- 172.21.15.46:0/353783420 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4031640 con 0x7fc8c815a320 2024-03-04T08:49:26.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8c7400640 1 -- 172.21.15.46:0/353783420 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b402d040 con 0x7fc8c815a320 2024-03-04T08:49:26.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8ce600640 1 -- 172.21.15.46:0/353783420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 msgr2=0x7fc8c80ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:26.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8ce600640 1 --2- 172.21.15.46:0/353783420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 0x7fc8c80ccac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009870 tx=0x7fc8b402b8f0 comp rx=0 tx=0).stop 2024-03-04T08:49:26.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8ce600640 1 -- 172.21.15.46:0/353783420 shutdown_connections 2024-03-04T08:49:26.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8ce600640 1 --2- 172.21.15.46:0/353783420 >> v2:172.21.15.46:3300/0 conn(0x7fc8c80cd000 0x7fc8c80cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:26.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8ce600640 1 --2- 172.21.15.46:0/353783420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c815a320 0x7fc8c80ccac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:26.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.935+0000 7fc8ce600640 1 -- 172.21.15.46:0/353783420 >> 172.21.15.46:0/353783420 conn(0x7fc8c8067060 msgr2=0x7fc8c8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:26.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.936+0000 7fc8ce600640 1 -- 172.21.15.46:0/353783420 shutdown_connections 2024-03-04T08:49:26.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.936+0000 7fc8ce600640 1 -- 172.21.15.46:0/353783420 wait complete. 2024-03-04T08:49:26.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.937+0000 7fc8ce600640 1 Processor -- start 2024-03-04T08:49:26.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.937+0000 7fc8ce600640 1 -- start start 2024-03-04T08:49:26.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.939+0000 7fc8ce600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c80cd000 0x7fc8c81ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:26.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.939+0000 7fc8ce600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c8154580 0x7fc8c8157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:26.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.939+0000 7fc8ce600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 0x7fc8c81579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:26.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.939+0000 7fc8ce600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8154960 con 0x7fc8c80cd000 2024-03-04T08:49:26.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.939+0000 7fc8ce600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c815b0a0 con 0x7fc8c815a320 2024-03-04T08:49:26.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.939+0000 7fc8ce600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8154ae0 con 0x7fc8c8154580 2024-03-04T08:49:26.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.940+0000 7fc8c7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c8154580 0x7fc8c8157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:26.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.940+0000 7fc8cdc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 0x7fc8c81579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:26.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.940+0000 7fc8cdc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 0x7fc8c81579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:53888/0 (socket says 172.21.15.46:53888) 2024-03-04T08:49:26.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.940+0000 7fc8cdc00640 1 -- 172.21.15.46:0/3318184625 learned_addr learned my addr 172.21.15.46:0/3318184625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.943+0000 7fc8cdc00640 1 -- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c8154580 msgr2=0x7fc8c8157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.943+0000 7fc8cdc00640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c8154580 0x7fc8c8157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.943+0000 7fc8cdc00640 1 -- 172.21.15.46:0/3318184625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c80cd000 msgr2=0x7fc8c81ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.943+0000 7fc8cdc00640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c80cd000 0x7fc8c81ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.944+0000 7fc8cdc00640 1 -- 172.21.15.46:0/3318184625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c81f3430 con 0x7fc8c815a320 2024-03-04T08:49:26.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.949+0000 7fc8cdc00640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 0x7fc8c81579a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000cd70 tx=0x7fc8c000a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:26.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.954+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0003b90 con 0x7fc8c815a320 2024-03-04T08:49:26.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.954+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0003d30 con 0x7fc8c815a320 2024-03-04T08:49:26.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.954+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0004240 con 0x7fc8c815a320 2024-03-04T08:49:26.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.954+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c81f20b0 con 0x7fc8c815a320 2024-03-04T08:49:26.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.955+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c81f2670 con 0x7fc8c815a320 2024-03-04T08:49:26.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:26.956+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c804f330 con 0x7fc8c815a320 2024-03-04T08:49:27.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.259+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fc8c00043e0 con 0x7fc8c815a320 2024-03-04T08:49:27.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.261+0000 7fc8c4c00640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc8a806b4c0 0x7fc8a806d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:27.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.261+0000 7fc8cd200640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc8a806b4c0 0x7fc8a806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:27.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.262+0000 7fc8cd200640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc8a806b4c0 0x7fc8a806d980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc003cc0 tx=0x7fc8bc0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:27.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.264+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8c0057830 con 0x7fc8c815a320 2024-03-04T08:49:27.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.285+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc8c0059e90 con 0x7fc8c815a320 2024-03-04T08:49:27.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:27.585+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c8153da0 con 0x7fc8c815a320 2024-03-04T08:49:28.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.061+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc8c00046d0 con 0x7fc8c815a320 2024-03-04T08:49:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.082+0000 7fc8c4c00640 1 -- 172.21.15.46:0/3318184625 <== mon.1 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fc8c007aa50 con 0x7fc8c815a320 2024-03-04T08:49:28.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:28.079 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-04T08:49:28.079 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc8a806b4c0 msgr2=0x7fc8a806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc8a806b4c0 0x7fc8a806d980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc003cc0 tx=0x7fc8bc0079b0 comp rx=0 tx=0).stop 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 msgr2=0x7fc8c81579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 0x7fc8c81579a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000cd70 tx=0x7fc8c000a660 comp rx=0 tx=0).stop 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 shutdown_connections 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc8a806b4c0 0x7fc8a806d980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c815a320 0x7fc8c81579a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8c8154580 0x7fc8c8157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:28.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 --2- 172.21.15.46:0/3318184625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c80cd000 0x7fc8c81ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:28.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.085+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 >> 172.21.15.46:0/3318184625 conn(0x7fc8c8067060 msgr2=0x7fc8c81586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:28.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.086+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 shutdown_connections 2024-03-04T08:49:28.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:28.086+0000 7fc8ce600640 1 -- 172.21.15.46:0/3318184625 wait complete. 2024-03-04T08:49:29.588 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2024-03-04T08:49:29.637 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2024-03-04T08:49:29.653 INFO:tasks.ceph.mds.f.smithi073.stdout:starting mds.f at 2024-03-04T08:49:30.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:49:30.293 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-03-04T08:49:30.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.345+0000 7f0672600640 1 Processor -- start 2024-03-04T08:49:30.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.346+0000 7f0672600640 1 -- start start 2024-03-04T08:49:30.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.347+0000 7f0672600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f066c154b20 0x7f066c0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:30.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.347+0000 7f0672600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f066c0ce120 0x7f066c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:30.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.347+0000 7f0672600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c0cc550 con 0x7f066c0ceaf0 2024-03-04T08:49:30.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.347+0000 7f0672600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c15a6d0 con 0x7f066c154b20 2024-03-04T08:49:30.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.347+0000 7f0672600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c0cc830 con 0x7f066c0ce120 2024-03-04T08:49:30.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.360+0000 7f066be00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f066c0ceaf0 0x7f066c15ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:57610/0 (socket says 172.21.15.46:57610) 2024-03-04T08:49:30.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.360+0000 7f066be00640 1 -- 172.21.15.46:0/439246031 learned_addr learned my addr 172.21.15.46:0/439246031 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:30.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.360+0000 7f066aa00640 1 --2- 172.21.15.46:0/439246031 >> v2:172.21.15.73:3300/0 conn(0x7f066c0ce120 0x7f066c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.365+0000 7f066aa00640 1 -- 172.21.15.46:0/439246031 >> v2:172.21.15.46:3300/0 conn(0x7f066c154b20 msgr2=0x7f066c0cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.365+0000 7f066aa00640 1 --2- 172.21.15.46:0/439246031 >> v2:172.21.15.46:3300/0 conn(0x7f066c154b20 0x7f066c0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.365+0000 7f066aa00640 1 -- 172.21.15.46:0/439246031 >> v1:172.21.15.73:6789/0 conn(0x7f066c0ceaf0 legacy=0x7f066c15ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.365+0000 7f066aa00640 1 -- 172.21.15.46:0/439246031 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c0ccb10 con 0x7f066c0ce120 2024-03-04T08:49:30.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.369+0000 7f066aa00640 1 --2- 172.21.15.46:0/439246031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ce120 0x7f066c0cf580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f066c0735e0 tx=0x7f065802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c38f8656f946e80 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:30.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.371+0000 7f066a000640 1 -- 172.21.15.46:0/439246031 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658035020 con 0x7f066c0ce120 2024-03-04T08:49:30.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.373+0000 7f066a000640 1 -- 172.21.15.46:0/439246031 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658031830 con 0x7f066c0ce120 2024-03-04T08:49:30.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.373+0000 7f066a000640 1 -- 172.21.15.46:0/439246031 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658031c00 con 0x7f066c0ce120 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.373+0000 7f0672600640 1 -- 172.21.15.46:0/439246031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ce120 msgr2=0x7f066c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 --2- 172.21.15.46:0/439246031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ce120 0x7f066c0cf580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f066c0735e0 tx=0x7f065802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 -- 172.21.15.46:0/439246031 shutdown_connections 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 --2- 172.21.15.46:0/439246031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ce120 0x7f066c0cf580 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 --2- 172.21.15.46:0/439246031 >> v2:172.21.15.46:3300/0 conn(0x7f066c154b20 0x7f066c0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 -- 172.21.15.46:0/439246031 >> 172.21.15.46:0/439246031 conn(0x7f066c0b16d0 msgr2=0x7f066c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 -- 172.21.15.46:0/439246031 shutdown_connections 2024-03-04T08:49:30.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.374+0000 7f0672600640 1 -- 172.21.15.46:0/439246031 wait complete. 2024-03-04T08:49:30.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.376+0000 7f0672600640 1 Processor -- start 2024-03-04T08:49:30.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.377+0000 7f0672600640 1 -- start start 2024-03-04T08:49:30.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.378+0000 7f0672600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 0x7f066c1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:30.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.378+0000 7f0672600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ceaf0 0x7f066c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.378+0000 7f0672600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c154b20 0x7f066c159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.378+0000 7f0672600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0ce720 con 0x7f066c154b20 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.378+0000 7f0672600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0ce5a0 con 0x7f066c0ceaf0 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.378+0000 7f0672600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0cd380 con 0x7f066c0ce120 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.379+0000 7f066b400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 0x7f066c1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.379+0000 7f066b400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 0x7f066c1f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:54382/0 (socket says 172.21.15.46:54382) 2024-03-04T08:49:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.379+0000 7f066b400640 1 -- 172.21.15.46:0/2717498640 learned_addr learned my addr 172.21.15.46:0/2717498640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:30.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.380+0000 7f066aa00640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ceaf0 0x7f066c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:30.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.380+0000 7f066be00640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c154b20 0x7f066c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:30.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.383+0000 7f066b400640 1 -- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ceaf0 msgr2=0x7f066c1569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:30.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.383+0000 7f066b400640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ceaf0 0x7f066c1569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:30.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.383+0000 7f066b400640 1 -- 172.21.15.46:0/2717498640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c154b20 msgr2=0x7f066c159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:30.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.383+0000 7f066b400640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c154b20 0x7f066c159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:30.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.383+0000 7f066b400640 1 -- 172.21.15.46:0/2717498640 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c1576e0 con 0x7f066c0ce120 2024-03-04T08:49:30.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.385+0000 7f066b400640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 0x7f066c1f5810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f065c00b410 tx=0x7f065c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:30.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.389+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c015020 con 0x7f066c0ce120 2024-03-04T08:49:30.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.389+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c011850 con 0x7f066c0ce120 2024-03-04T08:49:30.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.390+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c011c40 con 0x7f066c0ce120 2024-03-04T08:49:30.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.390+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c1579c0 con 0x7f066c0ce120 2024-03-04T08:49:30.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.390+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c1561e0 con 0x7f066c0ce120 2024-03-04T08:49:30.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.391+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c06e060 con 0x7f066c0ce120 2024-03-04T08:49:30.469 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-03-04T08:49:30.483 INFO:tasks.ceph.mds.e.smithi046.stdout:starting mds.e at 2024-03-04T08:49:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.671+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f065c018020 con 0x7f066c0ce120 2024-03-04T08:49:30.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.673+0000 7f0663400640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f064c06b550 0x7f064c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:30.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.673+0000 7f066aa00640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f064c06b550 0x7f064c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.674+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f065c05f250 con 0x7f066c0ce120 2024-03-04T08:49:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.674+0000 7f066aa00640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f064c06b550 0x7f064c06da10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0658036000 tx=0x7f0658008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:30.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:30.730+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f066c06e060 con 0x7f066c0ce120 2024-03-04T08:49:31.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.036+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f066c0c6720 con 0x7f066c0ce120 2024-03-04T08:49:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.056+0000 7f0663400640 1 -- 172.21.15.46:0/2717498640 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f065c01f020 con 0x7f066c0ce120 2024-03-04T08:49:31.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:31.053 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T08:49:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f064c06b550 msgr2=0x7f064c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f064c06b550 0x7f064c06da10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0658036000 tx=0x7f0658008030 comp rx=0 tx=0).stop 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 msgr2=0x7f066c1f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 0x7f066c1f5810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f065c00b410 tx=0x7f065c00b8d0 comp rx=0 tx=0).stop 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 shutdown_connections 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f064c06b550 0x7f064c06da10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f066c0ceaf0 0x7f066c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c154b20 0x7f066c159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 --2- 172.21.15.46:0/2717498640 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f066c0ce120 0x7f066c1f5810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 >> 172.21.15.46:0/2717498640 conn(0x7f066c0b16d0 msgr2=0x7f066c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 shutdown_connections 2024-03-04T08:49:31.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:31.059+0000 7f0672600640 1 -- 172.21.15.46:0/2717498640 wait complete. 2024-03-04T08:49:33.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:49:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.306+0000 7f154d400640 1 Processor -- start 2024-03-04T08:49:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.306+0000 7f154d400640 1 -- start start 2024-03-04T08:49:33.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.308+0000 7f154d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f15480c2950 0x7f154806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:33.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.308+0000 7f154d400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f154806dfb0 0x7f15481625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:33.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.308+0000 7f154d400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15480c6d10 con 0x7f1548162ae0 2024-03-04T08:49:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.308+0000 7f154d400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154806ea90 con 0x7f15480c2950 2024-03-04T08:49:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.308+0000 7f154d400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1548162110 con 0x7f154806dfb0 2024-03-04T08:49:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.309+0000 7f1546800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f15480c2950 0x7f154806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.309+0000 7f1545e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f154806dfb0 0x7f15481625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.309+0000 7f1547200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1548162ae0 0x7f154806d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36366/0 (socket says 172.21.15.46:36366) 2024-03-04T08:49:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.309+0000 7f1547200640 1 -- 172.21.15.46:0/3900382991 learned_addr learned my addr 172.21.15.46:0/3900382991 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:33.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.312+0000 7f1546800640 1 -- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f154806dfb0 msgr2=0x7f15481625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:33.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.312+0000 7f1546800640 1 --2- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f154806dfb0 0x7f15481625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.312+0000 7f1546800640 1 -- 172.21.15.46:0/3900382991 >> v1:172.21.15.46:6789/0 conn(0x7f1548162ae0 legacy=0x7f154806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:33.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.312+0000 7f1546800640 1 -- 172.21.15.46:0/3900382991 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480c6ff0 con 0x7f15480c2950 2024-03-04T08:49:33.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.314+0000 7f1546800640 1 --2- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15480c2950 0x7f154806e550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1538009dc0 tx=0x7f153802be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5edc49faa58a3b75 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:33.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.318+0000 7f1545400640 1 -- 172.21.15.46:0/3900382991 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538039070 con 0x7f15480c2950 2024-03-04T08:49:33.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.318+0000 7f1545400640 1 -- 172.21.15.46:0/3900382991 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153802cc30 con 0x7f15480c2950 2024-03-04T08:49:33.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.318+0000 7f1545400640 1 -- 172.21.15.46:0/3900382991 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538034440 con 0x7f15480c2950 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.318+0000 7f154d400640 1 -- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15480c2950 msgr2=0x7f154806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.318+0000 7f154d400640 1 --2- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15480c2950 0x7f154806e550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1538009dc0 tx=0x7f153802be80 comp rx=0 tx=0).stop 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.319+0000 7f154d400640 1 -- 172.21.15.46:0/3900382991 shutdown_connections 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.319+0000 7f154d400640 1 --2- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f154806dfb0 0x7f15481625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.319+0000 7f154d400640 1 --2- 172.21.15.46:0/3900382991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15480c2950 0x7f154806e550 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.319+0000 7f154d400640 1 -- 172.21.15.46:0/3900382991 >> 172.21.15.46:0/3900382991 conn(0x7f15480c88d0 msgr2=0x7f15480c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.319+0000 7f154d400640 1 -- 172.21.15.46:0/3900382991 shutdown_connections 2024-03-04T08:49:33.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.319+0000 7f154d400640 1 -- 172.21.15.46:0/3900382991 wait complete. 2024-03-04T08:49:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.321+0000 7f154d400640 1 Processor -- start 2024-03-04T08:49:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.321+0000 7f154d400640 1 -- start start 2024-03-04T08:49:33.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.322+0000 7f154d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 0x7f15480c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:33.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.322+0000 7f154d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15480c2950 0x7f1548071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:33.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.322+0000 7f154d400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1548162ae0 0x7f15480c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:33.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.322+0000 7f154d400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548161da0 con 0x7f15480c2950 2024-03-04T08:49:33.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.322+0000 7f154d400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c75b0 con 0x7f154806dfb0 2024-03-04T08:49:33.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.322+0000 7f154d400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c1f60 con 0x7f1548162ae0 2024-03-04T08:49:33.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.323+0000 7f1546800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 0x7f15480c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:33.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.323+0000 7f1547200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1548162ae0 0x7f15480c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:33.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.323+0000 7f1546800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 0x7f15480c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45856/0 (socket says 172.21.15.46:45856) 2024-03-04T08:49:33.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.323+0000 7f1546800640 1 -- 172.21.15.46:0/823804193 learned_addr learned my addr 172.21.15.46:0/823804193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:33.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.323+0000 7f1545e00640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15480c2950 0x7f1548071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:33.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.326+0000 7f1546800640 1 -- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1548162ae0 msgr2=0x7f15480c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:33.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.326+0000 7f1546800640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1548162ae0 0x7f15480c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.326+0000 7f1546800640 1 -- 172.21.15.46:0/823804193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15480c2950 msgr2=0x7f1548071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:33.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.326+0000 7f1546800640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15480c2950 0x7f1548071c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.326+0000 7f1546800640 1 -- 172.21.15.46:0/823804193 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154815a6c0 con 0x7f154806dfb0 2024-03-04T08:49:33.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.329+0000 7f1546800640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 0x7f15480c2d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1538009dc0 tx=0x7f1538004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.333+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538044020 con 0x7f154806dfb0 2024-03-04T08:49:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.333+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153803f470 con 0x7f154806dfb0 2024-03-04T08:49:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.333+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538039040 con 0x7f154806dfb0 2024-03-04T08:49:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.333+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15480b18c0 con 0x7f154806dfb0 2024-03-04T08:49:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.333+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480b1e80 con 0x7f154806dfb0 2024-03-04T08:49:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.334+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15480680b0 con 0x7f154806dfb0 2024-03-04T08:49:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.354+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1538005d10 con 0x7f154806dfb0 2024-03-04T08:49:33.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.355+0000 7f153ea00640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f152806b520 0x7f152806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:33.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.355+0000 7f1545e00640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f152806b520 0x7f152806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:33.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.355+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1538081f30 con 0x7f154806dfb0 2024-03-04T08:49:33.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.356+0000 7f1545e00640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f152806b520 0x7f152806d9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15480cabb0 tx=0x7f1534009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:33.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.591+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f153804e070 con 0x7f154806dfb0 2024-03-04T08:49:33.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.861+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f154806fb40 con 0x7f154806dfb0 2024-03-04T08:49:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.876+0000 7f153ea00640 1 -- 172.21.15.46:0/823804193 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5271 (secure 0 0 0) 0x7f153807bc10 con 0x7f154806dfb0 2024-03-04T08:49:33.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:33.873 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-04T08:49:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-03-04T08:49:33.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f152806b520 msgr2=0x7f152806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:33.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f152806b520 0x7f152806d9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15480cabb0 tx=0x7f1534009190 comp rx=0 tx=0).stop 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 msgr2=0x7f15480c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 0x7f15480c2d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1538009dc0 tx=0x7f1538004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 shutdown_connections 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f152806b520 0x7f152806d9e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1548162ae0 0x7f15480c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15480c2950 0x7f1548071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 --2- 172.21.15.46:0/823804193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154806dfb0 0x7f15480c2d30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 >> 172.21.15.46:0/823804193 conn(0x7f15480c88d0 msgr2=0x7f1548074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 shutdown_connections 2024-03-04T08:49:33.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:33.879+0000 7f154d400640 1 -- 172.21.15.46:0/823804193 wait complete. 2024-03-04T08:49:33.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:34.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.100+0000 7f8e57e00640 1 Processor -- start 2024-03-04T08:49:34.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.101+0000 7f8e57e00640 1 -- start start 2024-03-04T08:49:34.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.102+0000 7f8e57e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e580c89f0 0x7f8e5815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:34.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.102+0000 7f8e57e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e580c7810 con 0x7f8e58162870 2024-03-04T08:49:34.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.102+0000 7f8e57e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e580c7ad0 con 0x7f8e580c8610 2024-03-04T08:49:34.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.102+0000 7f8e57e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e58161d90 con 0x7f8e580c89f0 2024-03-04T08:49:34.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.103+0000 7f8e56a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e580c8610 0x7f8e58071be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50460/0 (socket says 172.21.15.46:50460) 2024-03-04T08:49:34.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.103+0000 7f8e56a00640 1 -- 172.21.15.46:0/1741604873 learned_addr learned my addr 172.21.15.46:0/1741604873 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.103+0000 7f8e4fe00640 1 --2- 172.21.15.46:0/1741604873 >> v2:172.21.15.46:3300/0 conn(0x7f8e580c89f0 0x7f8e5815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:34.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.105+0000 7f8e56000640 1 -- 172.21.15.46:0/1741604873 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275812276 0 0) 0x7f8e580c7ad0 con 0x7f8e580c8610 2024-03-04T08:49:34.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.106+0000 7f8e56000640 1 -- 172.21.15.46:0/1741604873 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e3c003520 con 0x7f8e580c8610 2024-03-04T08:49:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.108+0000 7f8e4fe00640 1 -- 172.21.15.46:0/1741604873 >> v1:172.21.15.73:6789/0 conn(0x7f8e580c8610 legacy=0x7f8e58071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.108+0000 7f8e4fe00640 1 -- 172.21.15.46:0/1741604873 >> v1:172.21.15.46:6789/0 conn(0x7f8e58162870 legacy=0x7f8e581584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.108+0000 7f8e4fe00640 1 -- 172.21.15.46:0/1741604873 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58162070 con 0x7f8e580c89f0 2024-03-04T08:49:34.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.112+0000 7f8e4fe00640 1 --2- 172.21.15.46:0/1741604873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e580c89f0 0x7f8e5815f0a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e400097a0 tx=0x7f8e4002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755fee5204b265f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:34.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.118+0000 7f8e56000640 1 -- 172.21.15.46:0/1741604873 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4002f810 con 0x7f8e580c89f0 2024-03-04T08:49:34.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.118+0000 7f8e56000640 1 -- 172.21.15.46:0/1741604873 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4002f9b0 con 0x7f8e580c89f0 2024-03-04T08:49:34.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.118+0000 7f8e56000640 1 -- 172.21.15.46:0/1741604873 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4002fd80 con 0x7f8e580c89f0 2024-03-04T08:49:34.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 -- 172.21.15.46:0/1741604873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e580c89f0 msgr2=0x7f8e5815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 --2- 172.21.15.46:0/1741604873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e580c89f0 0x7f8e5815f0a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e400097a0 tx=0x7f8e4002b9f0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 -- 172.21.15.46:0/1741604873 shutdown_connections 2024-03-04T08:49:34.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 --2- 172.21.15.46:0/1741604873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e580c89f0 0x7f8e5815f0a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 -- 172.21.15.46:0/1741604873 >> 172.21.15.46:0/1741604873 conn(0x7f8e5806aff0 msgr2=0x7f8e5806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:34.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 -- 172.21.15.46:0/1741604873 shutdown_connections 2024-03-04T08:49:34.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.119+0000 7f8e57e00640 1 -- 172.21.15.46:0/1741604873 wait complete. 2024-03-04T08:49:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.121+0000 7f8e57e00640 1 Processor -- start 2024-03-04T08:49:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.121+0000 7f8e57e00640 1 -- start start 2024-03-04T08:49:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.122+0000 7f8e57e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e580c8610 0x7f8e580c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.122+0000 7f8e57e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 0x7f8e58160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.122+0000 7f8e57e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e58162870 0x7f8e58160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.122+0000 7f8e57e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c90b0 con 0x7f8e58162870 2024-03-04T08:49:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.122+0000 7f8e57e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c8f30 con 0x7f8e580c89f0 2024-03-04T08:49:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.122+0000 7f8e57e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58158bd0 con 0x7f8e580c8610 2024-03-04T08:49:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.123+0000 7f8e4fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 0x7f8e58160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.123+0000 7f8e57400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e58162870 0x7f8e58160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.123+0000 7f8e56a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e580c8610 0x7f8e580c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.123+0000 7f8e4fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 0x7f8e58160590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45862/0 (socket says 172.21.15.46:45862) 2024-03-04T08:49:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.123+0000 7f8e4fe00640 1 -- 172.21.15.46:0/3577649763 learned_addr learned my addr 172.21.15.46:0/3577649763 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.127+0000 7f8e4fe00640 1 -- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e580c8610 msgr2=0x7f8e580c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.127+0000 7f8e4fe00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e580c8610 0x7f8e580c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.127+0000 7f8e4fe00640 1 -- 172.21.15.46:0/3577649763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e58162870 msgr2=0x7f8e58160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.127+0000 7f8e4fe00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e58162870 0x7f8e58160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.127+0000 7f8e4fe00640 1 -- 172.21.15.46:0/3577649763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5814a4d0 con 0x7f8e580c89f0 2024-03-04T08:49:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.129+0000 7f8e4fe00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 0x7f8e58160590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098c0 tx=0x7f8e400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.132+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400376d0 con 0x7f8e580c89f0 2024-03-04T08:49:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.132+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40037870 con 0x7f8e580c89f0 2024-03-04T08:49:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.132+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40037c60 con 0x7f8e580c89f0 2024-03-04T08:49:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.132+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5814a790 con 0x7f8e580c89f0 2024-03-04T08:49:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.133+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5815f680 con 0x7f8e580c89f0 2024-03-04T08:49:34.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.134+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e580c7200 con 0x7f8e580c89f0 2024-03-04T08:49:34.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.152+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e40049020 con 0x7f8e580c89f0 2024-03-04T08:49:34.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.153+0000 7f8e4ea00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e3406b550 0x7f8e3406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:34.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.153+0000 7f8e56a00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e3406b550 0x7f8e3406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:34.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.154+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e40037e00 con 0x7f8e580c89f0 2024-03-04T08:49:34.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.154+0000 7f8e56a00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e3406b550 0x7f8e3406da10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005880 tx=0x7f8e48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:34.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.399+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8e580c7200 con 0x7f8e580c89f0 2024-03-04T08:49:34.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.638+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e581529d0 con 0x7f8e580c89f0 2024-03-04T08:49:34.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.868+0000 7f8e4ea00640 1 -- 172.21.15.46:0/3577649763 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12824 (secure 0 0 0) 0x7f8e581529d0 con 0x7f8e580c89f0 2024-03-04T08:49:34.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:34.865 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:26.242269+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:34.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e3406b550 msgr2=0x7f8e3406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e3406b550 0x7f8e3406da10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005880 tx=0x7f8e48009040 comp rx=0 tx=0).stop 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 msgr2=0x7f8e58160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 0x7f8e58160590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098c0 tx=0x7f8e400046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 shutdown_connections 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e3406b550 0x7f8e3406da10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e580c89f0 0x7f8e58160590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e58162870 0x7f8e58160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 --2- 172.21.15.46:0/3577649763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e580c8610 0x7f8e580c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.872+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 >> 172.21.15.46:0/3577649763 conn(0x7f8e5806aff0 msgr2=0x7f8e58154370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:34.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.873+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 shutdown_connections 2024-03-04T08:49:34.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:34.873+0000 7f8e57e00640 1 -- 172.21.15.46:0/3577649763 wait complete. 2024-03-04T08:49:34.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:49:22.737500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:49:34.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:49:35.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.119+0000 7fe975200640 1 Processor -- start 2024-03-04T08:49:35.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.120+0000 7fe975200640 1 -- start start 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.121+0000 7fe975200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9700c7c10 0x7fe9700703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.121+0000 7fe975200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe970071140 con 0x7fe9701546c0 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.121+0000 7fe975200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97015a800 con 0x7fe970070930 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.121+0000 7fe975200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9700c3150 con 0x7fe9700c7c10 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.122+0000 7fe96e800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe970070930 0x7fe9700c35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50462/0 (socket says 172.21.15.46:50462) 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.122+0000 7fe96e800640 1 -- 172.21.15.46:0/45881914 learned_addr learned my addr 172.21.15.46:0/45881914 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.122+0000 7fe96d400640 1 --2- 172.21.15.46:0/45881914 >> v2:172.21.15.46:3300/0 conn(0x7fe9700c7c10 0x7fe9700703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.124+0000 7fe96ca00640 1 -- 172.21.15.46:0/45881914 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289744543 0 0) 0x7fe97015a800 con 0x7fe970070930 2024-03-04T08:49:35.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.124+0000 7fe96ca00640 1 -- 172.21.15.46:0/45881914 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe954003520 con 0x7fe970070930 2024-03-04T08:49:35.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.126+0000 7fe96d400640 1 -- 172.21.15.46:0/45881914 >> v1:172.21.15.73:6789/0 conn(0x7fe970070930 legacy=0x7fe9700c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.126+0000 7fe96d400640 1 -- 172.21.15.46:0/45881914 >> v1:172.21.15.46:6789/0 conn(0x7fe9701546c0 legacy=0x7fe97006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.126+0000 7fe96d400640 1 -- 172.21.15.46:0/45881914 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97015aac0 con 0x7fe9700c7c10 2024-03-04T08:49:35.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.132+0000 7fe96d400640 1 --2- 172.21.15.46:0/45881914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9700c7c10 0x7fe9700703f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097a0 tx=0x7fe95802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7a8a4ee6342ebd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.140+0000 7fe96ca00640 1 -- 172.21.15.46:0/45881914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958034070 con 0x7fe9700c7c10 2024-03-04T08:49:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.140+0000 7fe96ca00640 1 -- 172.21.15.46:0/45881914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe958030610 con 0x7fe9700c7c10 2024-03-04T08:49:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.140+0000 7fe96ca00640 1 -- 172.21.15.46:0/45881914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580309e0 con 0x7fe9700c7c10 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 -- 172.21.15.46:0/45881914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9700c7c10 msgr2=0x7fe9700703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 --2- 172.21.15.46:0/45881914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9700c7c10 0x7fe9700703f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097a0 tx=0x7fe95802b960 comp rx=0 tx=0).stop 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 -- 172.21.15.46:0/45881914 shutdown_connections 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 --2- 172.21.15.46:0/45881914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9700c7c10 0x7fe9700703f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 -- 172.21.15.46:0/45881914 >> 172.21.15.46:0/45881914 conn(0x7fe97006c100 msgr2=0x7fe97006c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 -- 172.21.15.46:0/45881914 shutdown_connections 2024-03-04T08:49:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.141+0000 7fe975200640 1 -- 172.21.15.46:0/45881914 wait complete. 2024-03-04T08:49:35.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.143+0000 7fe975200640 1 Processor -- start 2024-03-04T08:49:35.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.143+0000 7fe975200640 1 -- start start 2024-03-04T08:49:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.144+0000 7fe975200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 0x7fe97015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.144+0000 7fe975200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9700c7c10 0x7fe9700c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.144+0000 7fe975200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9701546c0 0x7fe9700c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.144+0000 7fe975200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015b360 con 0x7fe9701546c0 2024-03-04T08:49:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.144+0000 7fe975200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015b080 con 0x7fe970070930 2024-03-04T08:49:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.144+0000 7fe975200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970154aa0 con 0x7fe9700c7c10 2024-03-04T08:49:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.145+0000 7fe96e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9701546c0 0x7fe9700c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.145+0000 7fe96de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 0x7fe97015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.145+0000 7fe96d400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9700c7c10 0x7fe9700c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.145+0000 7fe96de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 0x7fe97015b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45866/0 (socket says 172.21.15.46:45866) 2024-03-04T08:49:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.145+0000 7fe96e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9701546c0 0x7fe9700c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39526/0 (socket says 172.21.15.46:39526) 2024-03-04T08:49:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.145+0000 7fe96de00640 1 -- 172.21.15.46:0/3506557761 learned_addr learned my addr 172.21.15.46:0/3506557761 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:35.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.149+0000 7fe96de00640 1 -- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9700c7c10 msgr2=0x7fe9700c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.149+0000 7fe96de00640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9700c7c10 0x7fe9700c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.149+0000 7fe96de00640 1 -- 172.21.15.46:0/3506557761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9701546c0 msgr2=0x7fe9700c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.149+0000 7fe96de00640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9701546c0 0x7fe9700c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.149+0000 7fe96de00640 1 -- 172.21.15.46:0/3506557761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700c3830 con 0x7fe970070930 2024-03-04T08:49:35.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.152+0000 7fe96de00640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 0x7fe97015b5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c400 tx=0x7fe96000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.155+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600052d0 con 0x7fe970070930 2024-03-04T08:49:35.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.155+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960005490 con 0x7fe970070930 2024-03-04T08:49:35.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.155+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960007260 con 0x7fe970070930 2024-03-04T08:49:35.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.155+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9700c3b10 con 0x7fe970070930 2024-03-04T08:49:35.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.155+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9700c53a0 con 0x7fe970070930 2024-03-04T08:49:35.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.156+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970074df0 con 0x7fe970070930 2024-03-04T08:49:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.176+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe960007400 con 0x7fe970070930 2024-03-04T08:49:35.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.177+0000 7fe966000640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe94c06b520 0x7fe94c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.177+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe960089730 con 0x7fe970070930 2024-03-04T08:49:35.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.178+0000 7fe96d400640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe94c06b520 0x7fe94c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.178+0000 7fe96d400640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe94c06b520 0x7fe94c06d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe958036000 tx=0x7fe95803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.414+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe960058390 con 0x7fe970070930 2024-03-04T08:49:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.625+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9700c8360 con 0x7fe970070930 2024-03-04T08:49:35.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.646+0000 7fe966000640 1 -- 172.21.15.46:0/3506557761 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe96005c430 con 0x7fe970070930 2024-03-04T08:49:35.642 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe94c06b520 msgr2=0x7fe94c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe94c06b520 0x7fe94c06d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe958036000 tx=0x7fe95803b040 comp rx=0 tx=0).stop 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 msgr2=0x7fe97015b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 0x7fe97015b5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c400 tx=0x7fe96000c8c0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 shutdown_connections 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe94c06b520 0x7fe94c06d9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9701546c0 0x7fe9700c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9700c7c10 0x7fe9700c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 --2- 172.21.15.46:0/3506557761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970070930 0x7fe97015b5f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 >> 172.21.15.46:0/3506557761 conn(0x7fe97006c100 msgr2=0x7fe97006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 shutdown_connections 2024-03-04T08:49:35.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.649+0000 7fe975200640 1 -- 172.21.15.46:0/3506557761 wait complete. 2024-03-04T08:49:35.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-04T08:49:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.885+0000 7fdd8b200640 1 Processor -- start 2024-03-04T08:49:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.885+0000 7fdd8b200640 1 -- start start 2024-03-04T08:49:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.887+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd84072130 0x7fdd8406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.887+0000 7fdd8b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd8415e3b0 0x7fdd84154240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.887+0000 7fdd8b200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8415e860 con 0x7fdd8406d4e0 2024-03-04T08:49:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.887+0000 7fdd8b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8406ea90 con 0x7fdd8415e3b0 2024-03-04T08:49:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.887+0000 7fdd8b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c2020 con 0x7fdd84072130 2024-03-04T08:49:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.888+0000 7fdd83400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd84072130 0x7fdd8406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.888+0000 7fdd83e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdd8406d4e0 0x7fdd84071a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50468/0 (socket says 172.21.15.46:50468) 2024-03-04T08:49:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.888+0000 7fdd83e00640 1 -- 172.21.15.46:0/3895700431 learned_addr learned my addr 172.21.15.46:0/3895700431 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.888+0000 7fdd89200640 1 --2- 172.21.15.46:0/3895700431 >> v2:172.21.15.73:3300/0 conn(0x7fdd8415e3b0 0x7fdd84154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.890+0000 7fdd83400640 1 -- 172.21.15.46:0/3895700431 >> v2:172.21.15.73:3300/0 conn(0x7fdd8415e3b0 msgr2=0x7fdd84154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.890+0000 7fdd83400640 1 --2- 172.21.15.46:0/3895700431 >> v2:172.21.15.73:3300/0 conn(0x7fdd8415e3b0 0x7fdd84154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.890+0000 7fdd83400640 1 -- 172.21.15.46:0/3895700431 >> v1:172.21.15.73:6789/0 conn(0x7fdd8406d4e0 legacy=0x7fdd84071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.890+0000 7fdd83400640 1 -- 172.21.15.46:0/3895700431 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840c2300 con 0x7fdd84072130 2024-03-04T08:49:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.893+0000 7fdd83400640 1 --2- 172.21.15.46:0/3895700431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd84072130 0x7fdd8406e550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0097a0 tx=0x7fdd6c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09110d4c58fa578 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.896+0000 7fdd82a00640 1 -- 172.21.15.46:0/3895700431 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c034070 con 0x7fdd84072130 2024-03-04T08:49:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.900+0000 7fdd82a00640 1 -- 172.21.15.46:0/3895700431 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c030800 con 0x7fdd84072130 2024-03-04T08:49:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.900+0000 7fdd82a00640 1 -- 172.21.15.46:0/3895700431 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c030bd0 con 0x7fdd84072130 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.900+0000 7fdd8b200640 1 -- 172.21.15.46:0/3895700431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd84072130 msgr2=0x7fdd8406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.900+0000 7fdd8b200640 1 --2- 172.21.15.46:0/3895700431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd84072130 0x7fdd8406e550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0097a0 tx=0x7fdd6c02b940 comp rx=0 tx=0).stop 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.901+0000 7fdd8b200640 1 -- 172.21.15.46:0/3895700431 shutdown_connections 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.901+0000 7fdd8b200640 1 --2- 172.21.15.46:0/3895700431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd84072130 0x7fdd8406e550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.901+0000 7fdd8b200640 1 --2- 172.21.15.46:0/3895700431 >> v2:172.21.15.73:3300/0 conn(0x7fdd8415e3b0 0x7fdd84154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.901+0000 7fdd8b200640 1 -- 172.21.15.46:0/3895700431 >> 172.21.15.46:0/3895700431 conn(0x7fdd840c88d0 msgr2=0x7fdd840c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.901+0000 7fdd8b200640 1 -- 172.21.15.46:0/3895700431 shutdown_connections 2024-03-04T08:49:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.901+0000 7fdd8b200640 1 -- 172.21.15.46:0/3895700431 wait complete. 2024-03-04T08:49:35.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.902+0000 7fdd8b200640 1 Processor -- start 2024-03-04T08:49:35.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.903+0000 7fdd8b200640 1 -- start start 2024-03-04T08:49:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8406d4e0 0x7fdd8414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415e3b0 0x7fdd84152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840cb6f0 0x7fdd8414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd8b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c2ba0 con 0x7fdd8406d4e0 2024-03-04T08:49:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd8b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c28c0 con 0x7fdd8415e3b0 2024-03-04T08:49:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd8b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8406d8c0 con 0x7fdd840cb6f0 2024-03-04T08:49:35.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.904+0000 7fdd89200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840cb6f0 0x7fdd8414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.905+0000 7fdd83400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415e3b0 0x7fdd84152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:35.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.905+0000 7fdd83400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415e3b0 0x7fdd84152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45880/0 (socket says 172.21.15.46:45880) 2024-03-04T08:49:35.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.905+0000 7fdd83400640 1 -- 172.21.15.46:0/2687360307 learned_addr learned my addr 172.21.15.46:0/2687360307 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:35.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.908+0000 7fdd89200640 1 -- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415e3b0 msgr2=0x7fdd84152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.908+0000 7fdd89200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415e3b0 0x7fdd84152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.908+0000 7fdd89200640 1 -- 172.21.15.46:0/2687360307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8406d4e0 msgr2=0x7fdd8414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:35.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.908+0000 7fdd89200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8406d4e0 0x7fdd8414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:35.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.908+0000 7fdd89200640 1 -- 172.21.15.46:0/2687360307 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd841f31d0 con 0x7fdd840cb6f0 2024-03-04T08:49:35.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.911+0000 7fdd89200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840cb6f0 0x7fdd8414a8b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00e7f0 tx=0x7fdd7c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.917+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c017070 con 0x7fdd840cb6f0 2024-03-04T08:49:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.917+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00c8e0 con 0x7fdd840cb6f0 2024-03-04T08:49:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.917+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8414f350 con 0x7fdd840cb6f0 2024-03-04T08:49:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.917+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00ccb0 con 0x7fdd840cb6f0 2024-03-04T08:49:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.917+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841f3730 con 0x7fdd840cb6f0 2024-03-04T08:49:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:35.918+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd840680b0 con 0x7fdd840cb6f0 2024-03-04T08:49:36.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.165+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd7c01a070 con 0x7fdd840cb6f0 2024-03-04T08:49:36.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.167+0000 7fdd7be00640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd6006b550 0x7fdd6006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.168+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd7c08a030 con 0x7fdd840cb6f0 2024-03-04T08:49:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.168+0000 7fdd83e00640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd6006b550 0x7fdd6006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.169+0000 7fdd83e00640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd6006b550 0x7fdd6006da10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd740012e0 tx=0x7fdd74001590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:36.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.178+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdd841f31d0 con 0x7fdd840cb6f0 2024-03-04T08:49:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.397+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd84150cf0 con 0x7fdd840cb6f0 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.404+0000 7fdd7be00640 1 -- 172.21.15.46:0/2687360307 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdd7c058c00 con 0x7fdd840cb6f0 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-04T08:49:36.401 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd6006b550 msgr2=0x7fdd6006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd6006b550 0x7fdd6006da10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd740012e0 tx=0x7fdd74001590 comp rx=0 tx=0).stop 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840cb6f0 msgr2=0x7fdd8414a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840cb6f0 0x7fdd8414a8b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00e7f0 tx=0x7fdd7c00ecb0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 shutdown_connections 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd6006b550 0x7fdd6006da10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415e3b0 0x7fdd84152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840cb6f0 0x7fdd8414a8b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2687360307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8406d4e0 0x7fdd8414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.407+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 >> 172.21.15.46:0/2687360307 conn(0x7fdd840c88d0 msgr2=0x7fdd8415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.408+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 shutdown_connections 2024-03-04T08:49:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.408+0000 7fdd8b200640 1 -- 172.21.15.46:0/2687360307 wait complete. 2024-03-04T08:49:36.424 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-04T08:49:36.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-04T08:49:36.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.645+0000 7fb516200640 1 Processor -- start 2024-03-04T08:49:36.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.645+0000 7fb516200640 1 -- start start 2024-03-04T08:49:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.647+0000 7fb516200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5100c6d90 0x7fb5101587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.647+0000 7fb516200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510158cf0 0x7fb5100c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.647+0000 7fb516200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51015bab0 con 0x7fb510152250 2024-03-04T08:49:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.647+0000 7fb516200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51015bd90 con 0x7fb5100c6d90 2024-03-04T08:49:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.647+0000 7fb516200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51015c070 con 0x7fb510158cf0 2024-03-04T08:49:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.648+0000 7fb50f400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb510152250 0x7fb51006f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36398/0 (socket says 172.21.15.46:36398) 2024-03-04T08:49:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.648+0000 7fb50ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5100c6d90 0x7fb5101587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.648+0000 7fb50f400640 1 -- 172.21.15.46:0/833637732 learned_addr learned my addr 172.21.15.46:0/833637732 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.648+0000 7fb50fe00640 1 --2- 172.21.15.46:0/833637732 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510158cf0 0x7fb5100c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.651+0000 7fb50e000640 1 -- 172.21.15.46:0/833637732 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138251852 0 0) 0x7fb51015bab0 con 0x7fb510152250 2024-03-04T08:49:36.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.651+0000 7fb50e000640 1 -- 172.21.15.46:0/833637732 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f4003520 con 0x7fb510152250 2024-03-04T08:49:36.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.651+0000 7fb50fe00640 1 -- 172.21.15.46:0/833637732 >> v2:172.21.15.73:3300/0 conn(0x7fb5100c6d90 msgr2=0x7fb5101587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:36.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.651+0000 7fb50fe00640 1 --2- 172.21.15.46:0/833637732 >> v2:172.21.15.73:3300/0 conn(0x7fb5100c6d90 0x7fb5101587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.651+0000 7fb50fe00640 1 -- 172.21.15.46:0/833637732 >> v1:172.21.15.46:6789/0 conn(0x7fb510152250 legacy=0x7fb51006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:36.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.651+0000 7fb50fe00640 1 -- 172.21.15.46:0/833637732 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51015c350 con 0x7fb510158cf0 2024-03-04T08:49:36.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.654+0000 7fb50fe00640 1 --2- 172.21.15.46:0/833637732 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510158cf0 0x7fb5100c5090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb508009dc0 tx=0x7fb50802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cf978ba891eeb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.657+0000 7fb50e000640 1 -- 172.21.15.46:0/833637732 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508039070 con 0x7fb510158cf0 2024-03-04T08:49:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.657+0000 7fb50e000640 1 -- 172.21.15.46:0/833637732 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50802ccd0 con 0x7fb510158cf0 2024-03-04T08:49:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.657+0000 7fb50e000640 1 -- 172.21.15.46:0/833637732 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508034660 con 0x7fb510158cf0 2024-03-04T08:49:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 -- 172.21.15.46:0/833637732 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510158cf0 msgr2=0x7fb5100c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 --2- 172.21.15.46:0/833637732 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510158cf0 0x7fb5100c5090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb508009dc0 tx=0x7fb50802bf20 comp rx=0 tx=0).stop 2024-03-04T08:49:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 -- 172.21.15.46:0/833637732 shutdown_connections 2024-03-04T08:49:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 --2- 172.21.15.46:0/833637732 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510158cf0 0x7fb5100c5090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 --2- 172.21.15.46:0/833637732 >> v2:172.21.15.73:3300/0 conn(0x7fb5100c6d90 0x7fb5101587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 -- 172.21.15.46:0/833637732 >> 172.21.15.46:0/833637732 conn(0x7fb51006aff0 msgr2=0x7fb51006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 -- 172.21.15.46:0/833637732 shutdown_connections 2024-03-04T08:49:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.658+0000 7fb516200640 1 -- 172.21.15.46:0/833637732 wait complete. 2024-03-04T08:49:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.660+0000 7fb516200640 1 Processor -- start 2024-03-04T08:49:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.660+0000 7fb516200640 1 -- start start 2024-03-04T08:49:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.661+0000 7fb516200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5100c6d90 0x7fb5101e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.661+0000 7fb516200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510152250 0x7fb5100c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.661+0000 7fb516200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb510158cf0 0x7fb5100c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.661+0000 7fb516200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5101527b0 con 0x7fb510158cf0 2024-03-04T08:49:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.661+0000 7fb516200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510152630 con 0x7fb5100c6d90 2024-03-04T08:49:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.661+0000 7fb516200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51015b670 con 0x7fb510152250 2024-03-04T08:49:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.662+0000 7fb50f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5100c6d90 0x7fb5101e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.662+0000 7fb50ea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510152250 0x7fb5100c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.662+0000 7fb50fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb510158cf0 0x7fb5100c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.662+0000 7fb50f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5100c6d90 0x7fb5101e3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45900/0 (socket says 172.21.15.46:45900) 2024-03-04T08:49:36.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.662+0000 7fb50f400640 1 -- 172.21.15.46:0/2847974443 learned_addr learned my addr 172.21.15.46:0/2847974443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:36.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.667+0000 7fb50ea00640 1 -- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5100c6d90 msgr2=0x7fb5101e3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:36.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.667+0000 7fb50ea00640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5100c6d90 0x7fb5101e3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.667+0000 7fb50ea00640 1 -- 172.21.15.46:0/2847974443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb510158cf0 msgr2=0x7fb5100c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:36.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.667+0000 7fb50ea00640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb510158cf0 0x7fb5100c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:36.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.667+0000 7fb50ea00640 1 -- 172.21.15.46:0/2847974443 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5101e4170 con 0x7fb510152250 2024-03-04T08:49:36.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.670+0000 7fb50ea00640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510152250 0x7fb5100c2e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e8a0 tx=0x7fb4fc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:36.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.674+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc017070 con 0x7fb510152250 2024-03-04T08:49:36.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.674+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00c940 con 0x7fb510152250 2024-03-04T08:49:36.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.674+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00cd10 con 0x7fb510152250 2024-03-04T08:49:36.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.674+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5101f07d0 con 0x7fb510152250 2024-03-04T08:49:36.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.674+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5101e4510 con 0x7fb510152250 2024-03-04T08:49:36.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.675+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb510067b00 con 0x7fb510152250 2024-03-04T08:49:36.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.933+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4fc01a070 con 0x7fb510152250 2024-03-04T08:49:36.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.935+0000 7fb507400640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb4f006b520 0x7fb4f006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:36.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.935+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4fc08a140 con 0x7fb510152250 2024-03-04T08:49:36.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.936+0000 7fb50f400640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb4f006b520 0x7fb4f006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:36.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.937+0000 7fb50f400640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb4f006b520 0x7fb4f006d9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb500005880 tx=0x7fb500009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:36.946+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb5101e4170 con 0x7fb510152250 2024-03-04T08:49:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.166+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb5100680b0 con 0x7fb510152250 2024-03-04T08:49:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.922+0000 7fb507400640 1 -- 172.21.15.46:0/2847974443 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb4fc058d10 con 0x7fb510152250 2024-03-04T08:49:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb4f006b520 msgr2=0x7fb4f006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb4f006b520 0x7fb4f006d9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb500005880 tx=0x7fb500009040 comp rx=0 tx=0).stop 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510152250 msgr2=0x7fb5100c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510152250 0x7fb5100c2e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e8a0 tx=0x7fb4fc00ed60 comp rx=0 tx=0).stop 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 shutdown_connections 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb4f006b520 0x7fb4f006d9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb510158cf0 0x7fb5100c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb510152250 0x7fb5100c2e80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:37.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 --2- 172.21.15.46:0/2847974443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5100c6d90 0x7fb5101e3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:37.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 >> 172.21.15.46:0/2847974443 conn(0x7fb51006aff0 msgr2=0x7fb5100716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:37.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 shutdown_connections 2024-03-04T08:49:37.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:37.927+0000 7fb516200640 1 -- 172.21.15.46:0/2847974443 wait complete. 2024-03-04T08:49:37.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-04T08:49:38.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.159+0000 7f196d800640 1 Processor -- start 2024-03-04T08:49:38.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.159+0000 7f196d800640 1 -- start start 2024-03-04T08:49:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.160+0000 7f196d800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 0x7f19681545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.160+0000 7f196d800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19680c7e20 0x7f1968072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.160+0000 7f196d800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1968073180 con 0x7f196815da10 2024-03-04T08:49:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.161+0000 7f196d800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196815b010 con 0x7f19680c7e20 2024-03-04T08:49:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.161+0000 7f196d800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196815a420 con 0x7f19681541c0 2024-03-04T08:49:38.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.161+0000 7f1966a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 0x7f19681545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:38.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.162+0000 7f1966a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 0x7f19681545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:49116/0 (socket says 172.21.15.46:49116) 2024-03-04T08:49:38.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.162+0000 7f1966a00640 1 -- 172.21.15.46:0/3227009754 learned_addr learned my addr 172.21.15.46:0/3227009754 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:38.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.162+0000 7f195e000640 1 --2- 172.21.15.46:0/3227009754 >> v2:172.21.15.46:3300/0 conn(0x7f19680c7e20 0x7f1968072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.164+0000 7f1966a00640 1 -- 172.21.15.46:0/3227009754 >> v2:172.21.15.46:3300/0 conn(0x7f19680c7e20 msgr2=0x7f1968072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.164+0000 7f1966a00640 1 --2- 172.21.15.46:0/3227009754 >> v2:172.21.15.46:3300/0 conn(0x7f19680c7e20 0x7f1968072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.164+0000 7f1966a00640 1 -- 172.21.15.46:0/3227009754 >> v1:172.21.15.46:6789/0 conn(0x7f196815da10 legacy=0x7f19680c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.164+0000 7f1966a00640 1 -- 172.21.15.46:0/3227009754 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1968073440 con 0x7f19681541c0 2024-03-04T08:49:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.166+0000 7f1966a00640 1 --2- 172.21.15.46:0/3227009754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 0x7f19681545a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1958009e50 tx=0x7f195802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2afd269b77ef6ad8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:38.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f1966000640 1 -- 172.21.15.46:0/3227009754 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195802cb90 con 0x7f19681541c0 2024-03-04T08:49:38.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f1966000640 1 -- 172.21.15.46:0/3227009754 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195802cd30 con 0x7f19681541c0 2024-03-04T08:49:38.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f1966000640 1 -- 172.21.15.46:0/3227009754 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958034610 con 0x7f19681541c0 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 -- 172.21.15.46:0/3227009754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 msgr2=0x7f19681545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 --2- 172.21.15.46:0/3227009754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 0x7f19681545a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1958009e50 tx=0x7f195802bff0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 -- 172.21.15.46:0/3227009754 shutdown_connections 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 --2- 172.21.15.46:0/3227009754 >> v2:172.21.15.46:3300/0 conn(0x7f19680c7e20 0x7f1968072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 --2- 172.21.15.46:0/3227009754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19681541c0 0x7f19681545a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 -- 172.21.15.46:0/3227009754 >> 172.21.15.46:0/3227009754 conn(0x7f196806aff0 msgr2=0x7f196806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.172+0000 7f196d800640 1 -- 172.21.15.46:0/3227009754 shutdown_connections 2024-03-04T08:49:38.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.173+0000 7f196d800640 1 -- 172.21.15.46:0/3227009754 wait complete. 2024-03-04T08:49:38.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.174+0000 7f196d800640 1 Processor -- start 2024-03-04T08:49:38.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.174+0000 7f196d800640 1 -- start start 2024-03-04T08:49:38.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.175+0000 7f196d800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19680c7e20 0x7f19680c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:38.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.175+0000 7f196d800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 0x7f196814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:38.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.175+0000 7f196d800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f196815da10 0x7f196814e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:38.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.175+0000 7f196d800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196815aca0 con 0x7f196815da10 2024-03-04T08:49:38.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.175+0000 7f196d800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196815a9c0 con 0x7f19681541c0 2024-03-04T08:49:38.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.175+0000 7f196d800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1968072dd0 con 0x7f19680c7e20 2024-03-04T08:49:38.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.176+0000 7f1967400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f196815da10 0x7f196814e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:38.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.176+0000 7f195e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 0x7f196814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:38.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.176+0000 7f1966a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19680c7e20 0x7f19680c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:38.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.176+0000 7f1967400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f196815da10 0x7f196814e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39564/0 (socket says 172.21.15.46:39564) 2024-03-04T08:49:38.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.176+0000 7f1967400640 1 -- 172.21.15.46:0/1210332701 learned_addr learned my addr 172.21.15.46:0/1210332701 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:38.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.176+0000 7f195e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 0x7f196814e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45906/0 (socket says 172.21.15.46:45906) 2024-03-04T08:49:38.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.180+0000 7f1966a00640 1 -- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 msgr2=0x7f196814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:38.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.180+0000 7f1966a00640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 0x7f196814e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.180+0000 7f1966a00640 1 -- 172.21.15.46:0/1210332701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f196815da10 msgr2=0x7f196814e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:38.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.180+0000 7f1966a00640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f196815da10 0x7f196814e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.180+0000 7f1966a00640 1 -- 172.21.15.46:0/1210332701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196815a150 con 0x7f19680c7e20 2024-03-04T08:49:38.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.180+0000 7f195e000640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 0x7f196814e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:49:38.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.182+0000 7f1966a00640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19680c7e20 0x7f19680c9b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1958032000 tx=0x7f1958004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:38.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.186+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958043020 con 0x7f19680c7e20 2024-03-04T08:49:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.186+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195803e450 con 0x7f19680c7e20 2024-03-04T08:49:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.186+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19681f0bf0 con 0x7f19680c7e20 2024-03-04T08:49:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.186+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958009510 con 0x7f19680c7e20 2024-03-04T08:49:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.186+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19680c2fa0 con 0x7f19680c7e20 2024-03-04T08:49:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.188+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19680680b0 con 0x7f19680c7e20 2024-03-04T08:49:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.207+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1958046020 con 0x7f19680c7e20 2024-03-04T08:49:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.208+0000 7f195f400640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f194406b520 0x7f194406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.209+0000 7f195e000640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f194406b520 0x7f194406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.210+0000 7f195e000640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f194406b520 0x7f194406d9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19680c4970 tx=0x7f1950008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.435+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f19580794c0 con 0x7f19680c7e20 2024-03-04T08:49:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.446+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f195804d030 con 0x7f19680c7e20 2024-03-04T08:49:38.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.660+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1968072650 con 0x7f19680c7e20 2024-03-04T08:49:38.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.973+0000 7f195f400640 1 -- 172.21.15.46:0/1210332701 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f195807b420 con 0x7f19680c7e20 2024-03-04T08:49:38.970 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-03-04T08:49:38.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.976+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f194406b520 msgr2=0x7f194406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.976+0000 7f196d800640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f194406b520 0x7f194406d9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19680c4970 tx=0x7f1950008040 comp rx=0 tx=0).stop 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.976+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19680c7e20 msgr2=0x7f19680c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.976+0000 7f196d800640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19680c7e20 0x7f19680c9b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1958032000 tx=0x7f1958004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 shutdown_connections 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f194406b520 0x7f194406d9e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19681541c0 0x7f196814e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f196815da10 0x7f196814e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 --2- 172.21.15.46:0/1210332701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19680c7e20 0x7f19680c9b90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:38.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 >> 172.21.15.46:0/1210332701 conn(0x7f196806aff0 msgr2=0x7f19680c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:38.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 shutdown_connections 2024-03-04T08:49:38.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:38.977+0000 7f196d800640 1 -- 172.21.15.46:0/1210332701 wait complete. 2024-03-04T08:49:39.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-04T08:49:39.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:39.117 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:39.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.208+0000 7fbff8400640 1 Processor -- start 2024-03-04T08:49:39.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.208+0000 7fbff8400640 1 -- start start 2024-03-04T08:49:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.209+0000 7fbff8400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbff00720c0 0x7fbff00c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.209+0000 7fbff8400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff00c8120 con 0x7fbff0151350 2024-03-04T08:49:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.209+0000 7fbff8400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff0157110 con 0x7fbff015a700 2024-03-04T08:49:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.209+0000 7fbff8400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00724d0 con 0x7fbff00720c0 2024-03-04T08:49:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.210+0000 7fbff5000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbff015a700 0x7fbff015fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50472/0 (socket says 172.21.15.46:50472) 2024-03-04T08:49:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.210+0000 7fbff5000640 1 -- 172.21.15.46:0/2425511970 learned_addr learned my addr 172.21.15.46:0/2425511970 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:39.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.280+0000 7fbff6400640 1 --2- 172.21.15.46:0/2425511970 >> v2:172.21.15.46:3300/0 conn(0x7fbff00720c0 0x7fbff00c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:39.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.384+0000 7fbfefe00640 1 -- 172.21.15.46:0/2425511970 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954276990 0 0) 0x7fbff0157110 con 0x7fbff015a700 2024-03-04T08:49:39.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.384+0000 7fbfefe00640 1 -- 172.21.15.46:0/2425511970 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd8003520 con 0x7fbff015a700 2024-03-04T08:49:39.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.392+0000 7fbff6400640 1 -- 172.21.15.46:0/2425511970 >> v1:172.21.15.73:6789/0 conn(0x7fbff015a700 legacy=0x7fbff015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:39.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.392+0000 7fbff6400640 1 -- 172.21.15.46:0/2425511970 >> v1:172.21.15.46:6789/0 conn(0x7fbff0151350 legacy=0x7fbff00c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:39.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.392+0000 7fbff6400640 1 -- 172.21.15.46:0/2425511970 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00c10a0 con 0x7fbff00720c0 2024-03-04T08:49:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.569+0000 7fbff6400640 1 --2- 172.21.15.46:0/2425511970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff00720c0 0x7fbff00c7ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097a0 tx=0x7fbfe802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99455dcecd3a405 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.608+0000 7fbfefe00640 1 -- 172.21.15.46:0/2425511970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe802f810 con 0x7fbff00720c0 2024-03-04T08:49:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.608+0000 7fbfefe00640 1 -- 172.21.15.46:0/2425511970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe802f9b0 con 0x7fbff00720c0 2024-03-04T08:49:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.608+0000 7fbfefe00640 1 -- 172.21.15.46:0/2425511970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe802fd80 con 0x7fbff00720c0 2024-03-04T08:49:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.609+0000 7fbff8400640 1 -- 172.21.15.46:0/2425511970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff00720c0 msgr2=0x7fbff00c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:39.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.609+0000 7fbff8400640 1 --2- 172.21.15.46:0/2425511970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff00720c0 0x7fbff00c7ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097a0 tx=0x7fbfe802b9f0 comp rx=0 tx=0).stop 2024-03-04T08:49:39.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.610+0000 7fbff8400640 1 -- 172.21.15.46:0/2425511970 shutdown_connections 2024-03-04T08:49:39.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.610+0000 7fbff8400640 1 --2- 172.21.15.46:0/2425511970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff00720c0 0x7fbff00c7ac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:39.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.610+0000 7fbff8400640 1 -- 172.21.15.46:0/2425511970 >> 172.21.15.46:0/2425511970 conn(0x7fbff006aff0 msgr2=0x7fbff006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:39.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.610+0000 7fbff8400640 1 -- 172.21.15.46:0/2425511970 shutdown_connections 2024-03-04T08:49:39.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.610+0000 7fbff8400640 1 -- 172.21.15.46:0/2425511970 wait complete. 2024-03-04T08:49:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.612+0000 7fbff8400640 1 Processor -- start 2024-03-04T08:49:39.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.613+0000 7fbff8400640 1 -- start start 2024-03-04T08:49:39.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.614+0000 7fbff8400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 0x7fbff01e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:39.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.614+0000 7fbff8400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff0151350 0x7fbff01f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:39.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.614+0000 7fbff8400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbff015a700 0x7fbff01458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:39.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.614+0000 7fbff8400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01573d0 con 0x7fbff0151350 2024-03-04T08:49:39.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.614+0000 7fbff8400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00c1660 con 0x7fbff00720c0 2024-03-04T08:49:39.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.614+0000 7fbff8400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01576b0 con 0x7fbff015a700 2024-03-04T08:49:39.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.616+0000 7fbff5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 0x7fbff01e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:39.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.616+0000 7fbff5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 0x7fbff01e1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45908/0 (socket says 172.21.15.46:45908) 2024-03-04T08:49:39.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.616+0000 7fbff5a00640 1 -- 172.21.15.46:0/3664914194 learned_addr learned my addr 172.21.15.46:0/3664914194 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:39.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.620+0000 7fbff5a00640 1 -- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbff015a700 msgr2=0x7fbff01458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:39.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.620+0000 7fbff5a00640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbff015a700 0x7fbff01458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:39.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.620+0000 7fbff5a00640 1 -- 172.21.15.46:0/3664914194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff0151350 msgr2=0x7fbff01f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:39.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.620+0000 7fbff5a00640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff0151350 0x7fbff01f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:39.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.620+0000 7fbff5a00640 1 -- 172.21.15.46:0/3664914194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff01e5210 con 0x7fbff00720c0 2024-03-04T08:49:39.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.622+0000 7fbff5a00640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 0x7fbff01e1ff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400c790 tx=0x7fbfe400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:39.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.625+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4016020 con 0x7fbff00720c0 2024-03-04T08:49:39.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.626+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4006d50 con 0x7fbff00720c0 2024-03-04T08:49:39.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.626+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4003bb0 con 0x7fbff00720c0 2024-03-04T08:49:39.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.626+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff01f2630 con 0x7fbff00720c0 2024-03-04T08:49:39.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.626+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff01e5790 con 0x7fbff00720c0 2024-03-04T08:49:39.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.627+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff00680b0 con 0x7fbff00720c0 2024-03-04T08:49:39.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.646+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbfe400a7d0 con 0x7fbff00720c0 2024-03-04T08:49:39.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.647+0000 7fbfed600640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbfd006b520 0x7fbfd006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:39.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.647+0000 7fbff5000640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbfd006b520 0x7fbfd006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:39.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.648+0000 7fbff5000640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbfd006b520 0x7fbfd006d9e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbff0074d80 tx=0x7fbfdc007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:39.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.880+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbfe4057540 con 0x7fbff00720c0 2024-03-04T08:49:39.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:39.891+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbfe4020020 con 0x7fbff00720c0 2024-03-04T08:49:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:40.179+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbff01e5960 con 0x7fbff00720c0 2024-03-04T08:49:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.008+0000 7fbfed600640 1 -- 172.21.15.46:0/3664914194 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbfe4059ba0 con 0x7fbff00720c0 2024-03-04T08:49:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-03-04T08:49:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.011+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbfd006b520 msgr2=0x7fbfd006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.011+0000 7fbff8400640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbfd006b520 0x7fbfd006d9e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbff0074d80 tx=0x7fbfdc007930 comp rx=0 tx=0).stop 2024-03-04T08:49:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.011+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 msgr2=0x7fbff01e1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.011+0000 7fbff8400640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 0x7fbff01e1ff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400c790 tx=0x7fbfe400cc50 comp rx=0 tx=0).stop 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 shutdown_connections 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbfd006b520 0x7fbfd006d9e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbff015a700 0x7fbff01458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbff0151350 0x7fbff01f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 --2- 172.21.15.46:0/3664914194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff00720c0 0x7fbff01e1ff0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 >> 172.21.15.46:0/3664914194 conn(0x7fbff006aff0 msgr2=0x7fbff014fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 shutdown_connections 2024-03-04T08:49:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.012+0000 7fbff8400640 1 -- 172.21.15.46:0/3664914194 wait complete. 2024-03-04T08:49:42.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:42.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.262+0000 7efdfe200640 1 Processor -- start 2024-03-04T08:49:42.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.263+0000 7efdfe200640 1 -- start start 2024-03-04T08:49:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.264+0000 7efdfe200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efdf8152500 0x7efdf8158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.264+0000 7efdfe200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 0x7efdf806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.264+0000 7efdfe200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf806b090 con 0x7efdf815b6d0 2024-03-04T08:49:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.264+0000 7efdfe200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf806b670 con 0x7efdf8152500 2024-03-04T08:49:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.264+0000 7efdfe200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8070d20 con 0x7efdf81595d0 2024-03-04T08:49:42.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.265+0000 7efdf6a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 0x7efdf806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:42.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.265+0000 7efdf6a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 0x7efdf806bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:36760/0 (socket says 172.21.15.46:36760) 2024-03-04T08:49:42.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.265+0000 7efdf6a00640 1 -- 172.21.15.46:0/636270116 learned_addr learned my addr 172.21.15.46:0/636270116 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.267+0000 7efdf7400640 1 --2- 172.21.15.46:0/636270116 >> v2:172.21.15.73:3300/0 conn(0x7efdf8152500 0x7efdf8158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.267+0000 7efdf6a00640 1 -- 172.21.15.46:0/636270116 >> v2:172.21.15.73:3300/0 conn(0x7efdf8152500 msgr2=0x7efdf8158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.267+0000 7efdf6a00640 1 --2- 172.21.15.46:0/636270116 >> v2:172.21.15.73:3300/0 conn(0x7efdf8152500 0x7efdf8158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.267+0000 7efdf6a00640 1 -- 172.21.15.46:0/636270116 >> v1:172.21.15.46:6789/0 conn(0x7efdf815b6d0 legacy=0x7efdf80c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.267+0000 7efdf6a00640 1 -- 172.21.15.46:0/636270116 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf806c040 con 0x7efdf81595d0 2024-03-04T08:49:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.269+0000 7efdf6a00640 1 --2- 172.21.15.46:0/636270116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 0x7efdf806bb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efde4009870 tx=0x7efde402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce31f4cb2abe2f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.273+0000 7efdf6000640 1 -- 172.21.15.46:0/636270116 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4034070 con 0x7efdf81595d0 2024-03-04T08:49:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.273+0000 7efdf6000640 1 -- 172.21.15.46:0/636270116 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4030840 con 0x7efdf81595d0 2024-03-04T08:49:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.273+0000 7efdf6000640 1 -- 172.21.15.46:0/636270116 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4030c10 con 0x7efdf81595d0 2024-03-04T08:49:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 -- 172.21.15.46:0/636270116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 msgr2=0x7efdf806bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 --2- 172.21.15.46:0/636270116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 0x7efdf806bb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efde4009870 tx=0x7efde402b980 comp rx=0 tx=0).stop 2024-03-04T08:49:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 -- 172.21.15.46:0/636270116 shutdown_connections 2024-03-04T08:49:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 --2- 172.21.15.46:0/636270116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf81595d0 0x7efdf806bb00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 --2- 172.21.15.46:0/636270116 >> v2:172.21.15.73:3300/0 conn(0x7efdf8152500 0x7efdf8158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 -- 172.21.15.46:0/636270116 >> 172.21.15.46:0/636270116 conn(0x7efdf8072730 msgr2=0x7efdf8072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 -- 172.21.15.46:0/636270116 shutdown_connections 2024-03-04T08:49:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.274+0000 7efdfe200640 1 -- 172.21.15.46:0/636270116 wait complete. 2024-03-04T08:49:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.276+0000 7efdfe200640 1 Processor -- start 2024-03-04T08:49:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.276+0000 7efdfe200640 1 -- start start 2024-03-04T08:49:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.277+0000 7efdfe200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf8152500 0x7efdf81ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.277+0000 7efdfe200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf81595d0 0x7efdf8143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.277+0000 7efdfe200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 0x7efdf8143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.277+0000 7efdfe200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf806b300 con 0x7efdf81595d0 2024-03-04T08:49:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.277+0000 7efdfe200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815c290 con 0x7efdf815b6d0 2024-03-04T08:49:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.277+0000 7efdfe200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815c570 con 0x7efdf8152500 2024-03-04T08:49:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.278+0000 7efdf7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 0x7efdf8143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.278+0000 7efdf7400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf8152500 0x7efdf81ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.278+0000 7efdf7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 0x7efdf8143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33220/0 (socket says 172.21.15.46:33220) 2024-03-04T08:49:42.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.278+0000 7efdf7e00640 1 -- 172.21.15.46:0/912200927 learned_addr learned my addr 172.21.15.46:0/912200927 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.281+0000 7efdf7e00640 1 -- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf8152500 msgr2=0x7efdf81ebd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.281+0000 7efdf7e00640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf8152500 0x7efdf81ebd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.281+0000 7efdf7e00640 1 -- 172.21.15.46:0/912200927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf81595d0 msgr2=0x7efdf8143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.281+0000 7efdf7e00640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf81595d0 0x7efdf8143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.281+0000 7efdf7e00640 1 -- 172.21.15.46:0/912200927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf814cc10 con 0x7efdf815b6d0 2024-03-04T08:49:42.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.283+0000 7efdf7e00640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 0x7efdf8143650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efdf000b9f0 tx=0x7efdf000beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:42.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.287+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0019070 con 0x7efdf815b6d0 2024-03-04T08:49:42.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.287+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000cbd0 con 0x7efdf815b6d0 2024-03-04T08:49:42.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.287+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0014440 con 0x7efdf815b6d0 2024-03-04T08:49:42.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.287+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf8144ba0 con 0x7efdf815b6d0 2024-03-04T08:49:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.287+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf8145160 con 0x7efdf815b6d0 2024-03-04T08:49:42.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.289+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8074df0 con 0x7efdf815b6d0 2024-03-04T08:49:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.306+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efdf001c070 con 0x7efdf815b6d0 2024-03-04T08:49:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.307+0000 7efdef400640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdd806b520 0x7efdd806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.308+0000 7efdf7400640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdd806b520 0x7efdd806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.308+0000 7efdf7400640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdd806b520 0x7efdd806d9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efde800aac0 tx=0x7efde8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.309+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdf0056c10 con 0x7efdf815b6d0 2024-03-04T08:49:42.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.561+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efdf0023020 con 0x7efdf815b6d0 2024-03-04T08:49:42.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.775+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf80c5600 con 0x7efdf815b6d0 2024-03-04T08:49:42.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.864+0000 7efdef400640 1 -- 172.21.15.46:0/912200927 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7efdf0058b70 con 0x7efdf815b6d0 2024-03-04T08:49:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:42.863 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:42.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdd806b520 msgr2=0x7efdd806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdd806b520 0x7efdd806d9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efde800aac0 tx=0x7efde8008040 comp rx=0 tx=0).stop 2024-03-04T08:49:42.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 msgr2=0x7efdf8143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 0x7efdf8143650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efdf000b9f0 tx=0x7efdf000beb0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 shutdown_connections 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdd806b520 0x7efdd806d9e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf815b6d0 0x7efdf8143650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf81595d0 0x7efdf8143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 --2- 172.21.15.46:0/912200927 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf8152500 0x7efdf81ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 >> 172.21.15.46:0/912200927 conn(0x7efdf8072730 msgr2=0x7efdf8072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:42.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 shutdown_connections 2024-03-04T08:49:42.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:42.868+0000 7efdfe200640 1 -- 172.21.15.46:0/912200927 wait complete. 2024-03-04T08:49:42.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:43.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.097+0000 7fcc63200640 1 Processor -- start 2024-03-04T08:49:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.097+0000 7fcc63200640 1 -- start start 2024-03-04T08:49:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.098+0000 7fcc63200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc640d01b0 0x7fcc640ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.098+0000 7fcc63200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 0x7fcc6415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.098+0000 7fcc63200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc6415c040 0x7fcc6406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.098+0000 7fcc63200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6415b310 con 0x7fcc6415c040 2024-03-04T08:49:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.098+0000 7fcc63200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6415c4a0 con 0x7fcc640d01b0 2024-03-04T08:49:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.098+0000 7fcc63200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6415a700 con 0x7fcc640ca900 2024-03-04T08:49:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.099+0000 7fcc62800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc6415c040 0x7fcc6406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.099+0000 7fcc61400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 0x7fcc6415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.099+0000 7fcc61400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 0x7fcc6415bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:36776/0 (socket says 172.21.15.46:36776) 2024-03-04T08:49:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.099+0000 7fcc61400640 1 -- 172.21.15.46:0/2878548332 learned_addr learned my addr 172.21.15.46:0/2878548332 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.100+0000 7fcc61e00640 1 --2- 172.21.15.46:0/2878548332 >> v2:172.21.15.73:3300/0 conn(0x7fcc640d01b0 0x7fcc640ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.102+0000 7fcc61400640 1 -- 172.21.15.46:0/2878548332 >> v2:172.21.15.73:3300/0 conn(0x7fcc640d01b0 msgr2=0x7fcc640ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.102+0000 7fcc61400640 1 --2- 172.21.15.46:0/2878548332 >> v2:172.21.15.73:3300/0 conn(0x7fcc640d01b0 0x7fcc640ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.102+0000 7fcc61400640 1 -- 172.21.15.46:0/2878548332 >> v2:172.21.15.46:3300/0 conn(0x7fcc6415c040 msgr2=0x7fcc6406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.102+0000 7fcc61400640 1 --2- 172.21.15.46:0/2878548332 >> v2:172.21.15.46:3300/0 conn(0x7fcc6415c040 0x7fcc6406d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.102+0000 7fcc61400640 1 -- 172.21.15.46:0/2878548332 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6415a9e0 con 0x7fcc640ca900 2024-03-04T08:49:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.104+0000 7fcc61400640 1 --2- 172.21.15.46:0/2878548332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 0x7fcc6415bb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc640cc420 tx=0x7fcc5002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6072d6baa5152c96 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:43.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.108+0000 7fcc60a00640 1 -- 172.21.15.46:0/2878548332 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50034070 con 0x7fcc640ca900 2024-03-04T08:49:43.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.108+0000 7fcc60a00640 1 -- 172.21.15.46:0/2878548332 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50030860 con 0x7fcc640ca900 2024-03-04T08:49:43.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.108+0000 7fcc60a00640 1 -- 172.21.15.46:0/2878548332 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50030c30 con 0x7fcc640ca900 2024-03-04T08:49:43.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 -- 172.21.15.46:0/2878548332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 msgr2=0x7fcc6415bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 --2- 172.21.15.46:0/2878548332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 0x7fcc6415bb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc640cc420 tx=0x7fcc5002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 -- 172.21.15.46:0/2878548332 shutdown_connections 2024-03-04T08:49:43.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 --2- 172.21.15.46:0/2878548332 >> v2:172.21.15.46:3300/0 conn(0x7fcc6415c040 0x7fcc6406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 --2- 172.21.15.46:0/2878548332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc640ca900 0x7fcc6415bb00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 --2- 172.21.15.46:0/2878548332 >> v2:172.21.15.73:3300/0 conn(0x7fcc640d01b0 0x7fcc640ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 -- 172.21.15.46:0/2878548332 >> 172.21.15.46:0/2878548332 conn(0x7fcc64066c40 msgr2=0x7fcc64067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:43.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 -- 172.21.15.46:0/2878548332 shutdown_connections 2024-03-04T08:49:43.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.109+0000 7fcc63200640 1 -- 172.21.15.46:0/2878548332 wait complete. 2024-03-04T08:49:43.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.113+0000 7fcc63200640 1 Processor -- start 2024-03-04T08:49:43.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.113+0000 7fcc63200640 1 -- start start 2024-03-04T08:49:43.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.114+0000 7fcc63200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc640ca900 0x7fcc641efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.114+0000 7fcc63200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc640d01b0 0x7fcc64154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.115+0000 7fcc63200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 0x7fcc640b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.115+0000 7fcc63200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640d0590 con 0x7fcc640ca900 2024-03-04T08:49:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.115+0000 7fcc63200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6415afa0 con 0x7fcc640d01b0 2024-03-04T08:49:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.115+0000 7fcc63200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6415a3b0 con 0x7fcc6415c040 2024-03-04T08:49:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.115+0000 7fcc62800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 0x7fcc640b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.116+0000 7fcc62800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 0x7fcc640b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:36790/0 (socket says 172.21.15.46:36790) 2024-03-04T08:49:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.116+0000 7fcc62800640 1 -- 172.21.15.46:0/2144790704 learned_addr learned my addr 172.21.15.46:0/2144790704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.116+0000 7fcc61400640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc640d01b0 0x7fcc64154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.117+0000 7fcc61e00640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc640ca900 0x7fcc641efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.119+0000 7fcc62800640 1 -- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc640d01b0 msgr2=0x7fcc64154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.119+0000 7fcc62800640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc640d01b0 0x7fcc64154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.119+0000 7fcc62800640 1 -- 172.21.15.46:0/2144790704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc640ca900 msgr2=0x7fcc641efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.119+0000 7fcc62800640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc640ca900 0x7fcc641efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.119+0000 7fcc62800640 1 -- 172.21.15.46:0/2144790704 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6414efd0 con 0x7fcc6415c040 2024-03-04T08:49:43.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.123+0000 7fcc62800640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 0x7fcc640b1920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00efc0 tx=0x7fcc5c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:43.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.128+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c018020 con 0x7fcc6415c040 2024-03-04T08:49:43.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.128+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c014480 con 0x7fcc6415c040 2024-03-04T08:49:43.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.128+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c014870 con 0x7fcc6415c040 2024-03-04T08:49:43.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.128+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6414f2b0 con 0x7fcc6415c040 2024-03-04T08:49:43.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.128+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6414f870 con 0x7fcc6415c040 2024-03-04T08:49:43.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.129+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc640c9d50 con 0x7fcc6415c040 2024-03-04T08:49:43.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.148+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc5c005d10 con 0x7fcc6415c040 2024-03-04T08:49:43.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.150+0000 7fcc5a000640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc4406b520 0x7fcc4406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.150+0000 7fcc61e00640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc4406b520 0x7fcc4406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.151+0000 7fcc61e00640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc4406b520 0x7fcc4406d9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009b40 tx=0x7fcc54009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:43.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.383+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc5c057ce0 con 0x7fcc6415c040 2024-03-04T08:49:43.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.394+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcc640c9d50 con 0x7fcc6415c040 2024-03-04T08:49:43.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.627+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc6404f330 con 0x7fcc6415c040 2024-03-04T08:49:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.732+0000 7fcc5a000640 1 -- 172.21.15.46:0/2144790704 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7fcc5c022030 con 0x7fcc6415c040 2024-03-04T08:49:43.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:43.729 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc4406b520 msgr2=0x7fcc4406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc4406b520 0x7fcc4406d9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009b40 tx=0x7fcc54009190 comp rx=0 tx=0).stop 2024-03-04T08:49:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 msgr2=0x7fcc640b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 0x7fcc640b1920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00efc0 tx=0x7fcc5c00c490 comp rx=0 tx=0).stop 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 shutdown_connections 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc4406b520 0x7fcc4406d9e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc640d01b0 0x7fcc64154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc6415c040 0x7fcc640b1920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 --2- 172.21.15.46:0/2144790704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc640ca900 0x7fcc641efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 >> 172.21.15.46:0/2144790704 conn(0x7fcc64066c40 msgr2=0x7fcc64067020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 shutdown_connections 2024-03-04T08:49:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.737+0000 7fcc63200640 1 -- 172.21.15.46:0/2144790704 wait complete. 2024-03-04T08:49:43.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-04T08:49:43.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.991+0000 7f71eca00640 1 Processor -- start 2024-03-04T08:49:43.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.991+0000 7f71eca00640 1 -- start start 2024-03-04T08:49:43.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.993+0000 7f71eca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71e80c7890 0x7f71e80c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:43.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.993+0000 7f71eca00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e815ed60 con 0x7f71e8158430 2024-03-04T08:49:43.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.993+0000 7f71eca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e815f000 con 0x7f71e80c7ce0 2024-03-04T08:49:43.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.993+0000 7f71eca00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e815f2e0 con 0x7f71e80c7890 2024-03-04T08:49:43.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.994+0000 7f71e6800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f71e8158430 0x7f71e815e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58988/0 (socket says 172.21.15.46:58988) 2024-03-04T08:49:43.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.994+0000 7f71e6800640 1 -- 172.21.15.46:0/1017684695 learned_addr learned my addr 172.21.15.46:0/1017684695 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:43.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.994+0000 7f71e5e00640 1 --2- 172.21.15.46:0/1017684695 >> v2:172.21.15.73:3300/0 conn(0x7f71e80c7890 0x7f71e80c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:43.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.998+0000 7f71e5400640 1 -- 172.21.15.46:0/1017684695 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450173655 0 0) 0x7f71e815ed60 con 0x7f71e8158430 2024-03-04T08:49:43.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.998+0000 7f71e5400640 1 -- 172.21.15.46:0/1017684695 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71cc003520 con 0x7f71e8158430 2024-03-04T08:49:43.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.998+0000 7f71e5e00640 1 -- 172.21.15.46:0/1017684695 >> v1:172.21.15.73:6789/0 conn(0x7f71e80c7ce0 legacy=0x7f71e80c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.998+0000 7f71e5e00640 1 -- 172.21.15.46:0/1017684695 >> v1:172.21.15.46:6789/0 conn(0x7f71e8158430 legacy=0x7f71e815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:43.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:43.998+0000 7f71e5e00640 1 -- 172.21.15.46:0/1017684695 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80c8570 con 0x7f71e80c7890 2024-03-04T08:49:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.002+0000 7f71e5e00640 1 --2- 172.21.15.46:0/1017684695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e80c8d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009d90 tx=0x7f71d402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c36e63a9fb6ff6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.007+0000 7f71e5400640 1 -- 172.21.15.46:0/1017684695 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4039070 con 0x7f71e80c7890 2024-03-04T08:49:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.007+0000 7f71e5400640 1 -- 172.21.15.46:0/1017684695 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d402cd80 con 0x7f71e80c7890 2024-03-04T08:49:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.007+0000 7f71e5400640 1 -- 172.21.15.46:0/1017684695 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4034660 con 0x7f71e80c7890 2024-03-04T08:49:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 -- 172.21.15.46:0/1017684695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 msgr2=0x7f71e80c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 --2- 172.21.15.46:0/1017684695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e80c8d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009d90 tx=0x7f71d402bfd0 comp rx=0 tx=0).stop 2024-03-04T08:49:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 -- 172.21.15.46:0/1017684695 shutdown_connections 2024-03-04T08:49:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 --2- 172.21.15.46:0/1017684695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e80c8d70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 -- 172.21.15.46:0/1017684695 >> 172.21.15.46:0/1017684695 conn(0x7f71e806d1c0 msgr2=0x7f71e806d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 -- 172.21.15.46:0/1017684695 shutdown_connections 2024-03-04T08:49:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.008+0000 7f71eca00640 1 -- 172.21.15.46:0/1017684695 wait complete. 2024-03-04T08:49:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.010+0000 7f71eca00640 1 Processor -- start 2024-03-04T08:49:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.010+0000 7f71eca00640 1 -- start start 2024-03-04T08:49:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.011+0000 7f71eca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e8155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.011+0000 7f71eca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71e80c7ce0 0x7f71e815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.011+0000 7f71eca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71e8158430 0x7f71e815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.011+0000 7f71eca00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80c71b0 con 0x7f71e80c7ce0 2024-03-04T08:49:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.011+0000 7f71eca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e8071cc0 con 0x7f71e80c7890 2024-03-04T08:49:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.011+0000 7f71eca00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80c7330 con 0x7f71e8158430 2024-03-04T08:49:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.012+0000 7f71e6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e8155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.012+0000 7f71e5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71e80c7ce0 0x7f71e815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.012+0000 7f71e7200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71e8158430 0x7f71e815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.012+0000 7f71e6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e8155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33262/0 (socket says 172.21.15.46:33262) 2024-03-04T08:49:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.012+0000 7f71e6800640 1 -- 172.21.15.46:0/2796830954 learned_addr learned my addr 172.21.15.46:0/2796830954 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.015+0000 7f71e6800640 1 -- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71e8158430 msgr2=0x7f71e815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.015+0000 7f71e6800640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71e8158430 0x7f71e815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.015+0000 7f71e6800640 1 -- 172.21.15.46:0/2796830954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71e80c7ce0 msgr2=0x7f71e815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.015+0000 7f71e6800640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71e80c7ce0 0x7f71e815cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.015+0000 7f71e6800640 1 -- 172.21.15.46:0/2796830954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8152770 con 0x7f71e80c7890 2024-03-04T08:49:44.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.018+0000 7f71e6800640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e8155e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c410 tx=0x7f71d800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:44.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.021+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8017070 con 0x7f71e80c7890 2024-03-04T08:49:44.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.021+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8005ce0 con 0x7f71e80c7890 2024-03-04T08:49:44.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.021+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80072f0 con 0x7f71e80c7890 2024-03-04T08:49:44.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.022+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e81f7dd0 con 0x7f71e80c7890 2024-03-04T08:49:44.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.022+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e8152cf0 con 0x7f71e80c7890 2024-03-04T08:49:44.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.023+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e815bcb0 con 0x7f71e80c7890 2024-03-04T08:49:44.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.042+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71d801a070 con 0x7f71e80c7890 2024-03-04T08:49:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.043+0000 7f71dea00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f71c806b550 0x7f71c806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.043+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71d8089960 con 0x7f71e80c7890 2024-03-04T08:49:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.043+0000 7f71e5e00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f71c806b550 0x7f71c806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.044+0000 7f71e5e00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f71c806b550 0x7f71c806da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71d4036000 tx=0x7f71d4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:44.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.295+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f71d8021020 con 0x7f71e80c7890 2024-03-04T08:49:44.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:44.589+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f71e804f410 con 0x7f71e80c7890 2024-03-04T08:49:45.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.891+0000 7f71dea00640 1 -- 172.21.15.46:0/2796830954 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f71d8058330 con 0x7f71e80c7890 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f71c806b550 msgr2=0x7f71c806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f71c806b550 0x7f71c806da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71d4036000 tx=0x7f71d4030000 comp rx=0 tx=0).stop 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 msgr2=0x7f71e8155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e8155e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c410 tx=0x7f71d800c8d0 comp rx=0 tx=0).stop 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 shutdown_connections 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f71c806b550 0x7f71c806da10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71e8158430 0x7f71e815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71e80c7ce0 0x7f71e815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 --2- 172.21.15.46:0/2796830954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e80c7890 0x7f71e8155e70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.894+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 >> 172.21.15.46:0/2796830954 conn(0x7f71e806d1c0 msgr2=0x7f71e80c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:45.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.895+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 shutdown_connections 2024-03-04T08:49:45.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:45.895+0000 7f71eca00640 1 -- 172.21.15.46:0/2796830954 wait complete. 2024-03-04T08:49:45.912 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-03-04T08:49:45.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-04T08:49:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.125+0000 7f0529c00640 1 Processor -- start 2024-03-04T08:49:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.125+0000 7f0529c00640 1 -- start start 2024-03-04T08:49:46.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.127+0000 7f0529c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f05240cf0f0 0x7f0524165d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:46.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.127+0000 7f0529c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052415a5c0 con 0x7f0524154900 2024-03-04T08:49:46.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.127+0000 7f0529c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240ca5c0 con 0x7f05240cd1b0 2024-03-04T08:49:46.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.127+0000 7f0529c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052415b490 con 0x7f05240cf0f0 2024-03-04T08:49:46.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.127+0000 7f0523400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f05240cd1b0 0x7f05240ce090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:56884/0 (socket says 172.21.15.46:56884) 2024-03-04T08:49:46.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.127+0000 7f0523400640 1 -- 172.21.15.46:0/3048660155 learned_addr learned my addr 172.21.15.46:0/3048660155 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:46.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.128+0000 7f0529200640 1 --2- 172.21.15.46:0/3048660155 >> v2:172.21.15.73:3300/0 conn(0x7f05240cf0f0 0x7f0524165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:46.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.131+0000 7f0522a00640 1 -- 172.21.15.46:0/3048660155 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503762648 0 0) 0x7f052415a5c0 con 0x7f0524154900 2024-03-04T08:49:46.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.131+0000 7f0522a00640 1 -- 172.21.15.46:0/3048660155 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0508003520 con 0x7f0524154900 2024-03-04T08:49:46.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.132+0000 7f0529200640 1 -- 172.21.15.46:0/3048660155 >> v1:172.21.15.73:6789/0 conn(0x7f05240cd1b0 legacy=0x7f05240ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:46.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.132+0000 7f0529200640 1 -- 172.21.15.46:0/3048660155 >> v1:172.21.15.46:6789/0 conn(0x7f0524154900 legacy=0x7f052415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:46.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.132+0000 7f0529200640 1 -- 172.21.15.46:0/3048660155 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240ca8a0 con 0x7f05240cf0f0 2024-03-04T08:49:46.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.136+0000 7f0529200640 1 --2- 172.21.15.46:0/3048660155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524165d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f051c009d90 tx=0x7f051c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2805e7cb17528e08 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.139+0000 7f0522a00640 1 -- 172.21.15.46:0/3048660155 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c039070 con 0x7f05240cf0f0 2024-03-04T08:49:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.139+0000 7f0522a00640 1 -- 172.21.15.46:0/3048660155 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c02cd00 con 0x7f05240cf0f0 2024-03-04T08:49:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.139+0000 7f0522a00640 1 -- 172.21.15.46:0/3048660155 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c034660 con 0x7f05240cf0f0 2024-03-04T08:49:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 -- 172.21.15.46:0/3048660155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 msgr2=0x7f0524165d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 --2- 172.21.15.46:0/3048660155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524165d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f051c009d90 tx=0x7f051c02bf50 comp rx=0 tx=0).stop 2024-03-04T08:49:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 -- 172.21.15.46:0/3048660155 shutdown_connections 2024-03-04T08:49:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 --2- 172.21.15.46:0/3048660155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524165d60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 -- 172.21.15.46:0/3048660155 >> 172.21.15.46:0/3048660155 conn(0x7f05240b15b0 msgr2=0x7f05240b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 -- 172.21.15.46:0/3048660155 shutdown_connections 2024-03-04T08:49:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.140+0000 7f0529c00640 1 -- 172.21.15.46:0/3048660155 wait complete. 2024-03-04T08:49:46.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.142+0000 7f0529c00640 1 Processor -- start 2024-03-04T08:49:46.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.142+0000 7f0529c00640 1 -- start start 2024-03-04T08:49:46.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.143+0000 7f0529c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05240cd1b0 0x7f05240c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:46.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.143+0000 7f0529c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:46.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.143+0000 7f0529c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524154900 0x7f05240c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:46.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.143+0000 7f0529c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052406c5c0 con 0x7f0524154900 2024-03-04T08:49:46.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.143+0000 7f0529c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240cab80 con 0x7f05240cf0f0 2024-03-04T08:49:46.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.143+0000 7f0529c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05241f0bc0 con 0x7f05240cd1b0 2024-03-04T08:49:46.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.144+0000 7f0529200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524154900 0x7f05240c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.144+0000 7f0523400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.144+0000 7f0523e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05240cd1b0 0x7f05240c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.144+0000 7f0523400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33280/0 (socket says 172.21.15.46:33280) 2024-03-04T08:49:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.144+0000 7f0523400640 1 -- 172.21.15.46:0/3467479726 learned_addr learned my addr 172.21.15.46:0/3467479726 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.147+0000 7f0523400640 1 -- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05240cd1b0 msgr2=0x7f05240c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.147+0000 7f0523400640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05240cd1b0 0x7f05240c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.147+0000 7f0523400640 1 -- 172.21.15.46:0/3467479726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524154900 msgr2=0x7f05240c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.147+0000 7f0523400640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524154900 0x7f05240c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.147+0000 7f0523400640 1 -- 172.21.15.46:0/3467479726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05241f0ea0 con 0x7f05240cf0f0 2024-03-04T08:49:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.150+0000 7f0523400640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524157670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f051000c4a0 tx=0x7f051000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.153+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f05240cf0f0 2024-03-04T08:49:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.153+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510005ce0 con 0x7f05240cf0f0 2024-03-04T08:49:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.153+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510007270 con 0x7f05240cf0f0 2024-03-04T08:49:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.153+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05241f1180 con 0x7f05240cf0f0 2024-03-04T08:49:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.154+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05241569d0 con 0x7f05240cf0f0 2024-03-04T08:49:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.155+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05241f16a0 con 0x7f05240cf0f0 2024-03-04T08:49:46.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.174+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f051001a070 con 0x7f05240cf0f0 2024-03-04T08:49:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.175+0000 7f051be00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f050406b550 0x7f050406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.175+0000 7f0523e00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f050406b550 0x7f050406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.176+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0510056270 con 0x7f05240cf0f0 2024-03-04T08:49:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.176+0000 7f0523e00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f050406b550 0x7f050406da10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05140011e0 tx=0x7f0514009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:46.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.413+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f05241f16a0 con 0x7f05240cf0f0 2024-03-04T08:49:46.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:46.676+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f05240682c0 con 0x7f05240cf0f0 2024-03-04T08:49:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.653+0000 7f051be00640 1 -- 172.21.15.46:0/3467479726 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f05100581d0 con 0x7f05240cf0f0 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f050406b550 msgr2=0x7f050406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f050406b550 0x7f050406da10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05140011e0 tx=0x7f0514009040 comp rx=0 tx=0).stop 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 msgr2=0x7f0524157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524157670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f051000c4a0 tx=0x7f051000c960 comp rx=0 tx=0).stop 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 shutdown_connections 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f050406b550 0x7f050406da10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05240cf0f0 0x7f0524157670 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524154900 0x7f05240c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 --2- 172.21.15.46:0/3467479726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05240cd1b0 0x7f05240c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.656+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 >> 172.21.15.46:0/3467479726 conn(0x7f05240b15b0 msgr2=0x7f05240af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:47.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.657+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 shutdown_connections 2024-03-04T08:49:47.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.657+0000 7f0529c00640 1 -- 172.21.15.46:0/3467479726 wait complete. 2024-03-04T08:49:47.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-04T08:49:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.871+0000 7f119ea00640 1 Processor -- start 2024-03-04T08:49:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.871+0000 7f119ea00640 1 -- start start 2024-03-04T08:49:47.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.873+0000 7f119ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f119815b250 0x7f1198066c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:47.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.873+0000 7f119ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1198067180 0x7f11980ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:47.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.873+0000 7f119ea00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119806c830 con 0x7f1198154c00 2024-03-04T08:49:47.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.873+0000 7f119ea00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119806cb10 con 0x7f119815b250 2024-03-04T08:49:47.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.873+0000 7f119ea00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119806cdf0 con 0x7f1198067180 2024-03-04T08:49:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.874+0000 7f119ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1198067180 0x7f11980ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.874+0000 7f119ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1198067180 0x7f11980ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33290/0 (socket says 172.21.15.46:33290) 2024-03-04T08:49:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.874+0000 7f119ca00640 1 -- 172.21.15.46:0/172139650 learned_addr learned my addr 172.21.15.46:0/172139650 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:47.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.876+0000 7f119ca00640 1 -- 172.21.15.46:0/172139650 >> v2:172.21.15.46:3300/0 conn(0x7f119815b250 msgr2=0x7f1198066c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:47.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.876+0000 7f119ca00640 1 --2- 172.21.15.46:0/172139650 >> v2:172.21.15.46:3300/0 conn(0x7f119815b250 0x7f1198066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.876+0000 7f119ca00640 1 -- 172.21.15.46:0/172139650 >> v1:172.21.15.46:6789/0 conn(0x7f1198154c00 legacy=0x7f11980cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:47.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.876+0000 7f119ca00640 1 -- 172.21.15.46:0/172139650 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119806d0d0 con 0x7f1198067180 2024-03-04T08:49:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.878+0000 7f119ca00640 1 --2- 172.21.15.46:0/172139650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198067180 0x7f11980ca620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f119808dc90 tx=0x7f119002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=289408e37b57a92f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:47.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.882+0000 7f1196a00640 1 -- 172.21.15.46:0/172139650 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119002ca80 con 0x7f1198067180 2024-03-04T08:49:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.886+0000 7f1196a00640 1 -- 172.21.15.46:0/172139650 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119002cc20 con 0x7f1198067180 2024-03-04T08:49:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.886+0000 7f1196a00640 1 -- 172.21.15.46:0/172139650 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900343f0 con 0x7f1198067180 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.887+0000 7f119ea00640 1 -- 172.21.15.46:0/172139650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198067180 msgr2=0x7f11980ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.887+0000 7f119ea00640 1 --2- 172.21.15.46:0/172139650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198067180 0x7f11980ca620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f119808dc90 tx=0x7f119002bee0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.887+0000 7f119ea00640 1 -- 172.21.15.46:0/172139650 shutdown_connections 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.887+0000 7f119ea00640 1 --2- 172.21.15.46:0/172139650 >> v2:172.21.15.46:3300/0 conn(0x7f119815b250 0x7f1198066c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.887+0000 7f119ea00640 1 --2- 172.21.15.46:0/172139650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198067180 0x7f11980ca620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.887+0000 7f119ea00640 1 -- 172.21.15.46:0/172139650 >> 172.21.15.46:0/172139650 conn(0x7f11980cfca0 msgr2=0x7f11980d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.888+0000 7f119ea00640 1 -- 172.21.15.46:0/172139650 shutdown_connections 2024-03-04T08:49:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.888+0000 7f119ea00640 1 -- 172.21.15.46:0/172139650 wait complete. 2024-03-04T08:49:47.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.890+0000 7f119ea00640 1 Processor -- start 2024-03-04T08:49:47.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.891+0000 7f119ea00640 1 -- start start 2024-03-04T08:49:47.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.892+0000 7f119ea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1198067180 0x7f11981553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:47.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.892+0000 7f119ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 0x7f1198152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:47.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.892+0000 7f119ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119815b250 0x7f1198157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:47.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.892+0000 7f119ea00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815b6a0 con 0x7f119815b250 2024-03-04T08:49:47.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.892+0000 7f119ea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198067680 con 0x7f1198154c00 2024-03-04T08:49:47.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.892+0000 7f119ea00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119806d8d0 con 0x7f1198067180 2024-03-04T08:49:47.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.895+0000 7f1197400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 0x7f1198152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:47.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.896+0000 7f1197400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 0x7f1198152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33298/0 (socket says 172.21.15.46:33298) 2024-03-04T08:49:47.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.896+0000 7f1197400640 1 -- 172.21.15.46:0/1833142798 learned_addr learned my addr 172.21.15.46:0/1833142798 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:47.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.897+0000 7f1197e00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1198067180 0x7f11981553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:47.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.898+0000 7f119ca00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119815b250 0x7f1198157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:47.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.901+0000 7f1197400640 1 -- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1198067180 msgr2=0x7f11981553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:47.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.901+0000 7f1197400640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1198067180 0x7f11981553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.901+0000 7f1197400640 1 -- 172.21.15.46:0/1833142798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119815b250 msgr2=0x7f1198157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:47.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.901+0000 7f1197400640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119815b250 0x7f1198157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:47.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.901+0000 7f1197400640 1 -- 172.21.15.46:0/1833142798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11981558f0 con 0x7f1198154c00 2024-03-04T08:49:47.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.945+0000 7f1197400640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 0x7f1198152690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f118400b4a0 tx=0x7f118400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.952+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184014070 con 0x7f1198154c00 2024-03-04T08:49:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.953+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1184010610 con 0x7f1198154c00 2024-03-04T08:49:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.953+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184010a00 con 0x7f1198154c00 2024-03-04T08:49:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.953+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11980b28c0 con 0x7f1198154c00 2024-03-04T08:49:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.953+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11980b2e60 con 0x7f1198154c00 2024-03-04T08:49:47.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.954+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980680b0 con 0x7f1198154c00 2024-03-04T08:49:47.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.975+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1184017070 con 0x7f1198154c00 2024-03-04T08:49:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.976+0000 7f118fe00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f117806b520 0x7f117806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.976+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1184089fd0 con 0x7f1198154c00 2024-03-04T08:49:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.977+0000 7f1197e00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f117806b520 0x7f117806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:47.977+0000 7f1197e00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f117806b520 0x7f117806d9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f11880017f0 tx=0x7f1188009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:48.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:48.221+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1184058850 con 0x7f1198154c00 2024-03-04T08:49:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:48.481+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f11981f3ab0 con 0x7f1198154c00 2024-03-04T08:49:49.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.347+0000 7f118fe00640 1 -- 172.21.15.46:0/1833142798 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f118405c8f0 con 0x7f1198154c00 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f117806b520 msgr2=0x7f117806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f117806b520 0x7f117806d9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f11880017f0 tx=0x7f1188009040 comp rx=0 tx=0).stop 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 msgr2=0x7f1198152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 0x7f1198152690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f118400b4a0 tx=0x7f118400b960 comp rx=0 tx=0).stop 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 shutdown_connections 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f117806b520 0x7f117806d9e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1198154c00 0x7f1198152690 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119815b250 0x7f1198157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 --2- 172.21.15.46:0/1833142798 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1198067180 0x7f11981553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 >> 172.21.15.46:0/1833142798 conn(0x7f11980cfca0 msgr2=0x7f1198150cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 shutdown_connections 2024-03-04T08:49:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.350+0000 7f119ea00640 1 -- 172.21.15.46:0/1833142798 wait complete. 2024-03-04T08:49:49.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-04T08:49:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.575+0000 7fba0fe00640 1 Processor -- start 2024-03-04T08:49:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.576+0000 7fba0fe00640 1 -- start start 2024-03-04T08:49:49.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.578+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100caae0 0x7fba1015a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:49.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.578+0000 7fba0fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba100cd220 0x7fba100cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:49.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.578+0000 7fba0fe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100cc270 con 0x7fba1015a950 2024-03-04T08:49:49.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.578+0000 7fba0fe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100cf1d0 con 0x7fba100cd220 2024-03-04T08:49:49.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.578+0000 7fba0fe00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100ccb30 con 0x7fba100caae0 2024-03-04T08:49:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.579+0000 7fba0f400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fba1015a950 0x7fba1015d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:56890/0 (socket says 172.21.15.46:56890) 2024-03-04T08:49:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.579+0000 7fba0f400640 1 -- 172.21.15.46:0/59207700 learned_addr learned my addr 172.21.15.46:0/59207700 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.579+0000 7fba0ea00640 1 --2- 172.21.15.46:0/59207700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100caae0 0x7fba1015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.579+0000 7fba06000640 1 --2- 172.21.15.46:0/59207700 >> v2:172.21.15.46:3300/0 conn(0x7fba100cd220 0x7fba100cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.581+0000 7fba0e000640 1 -- 172.21.15.46:0/59207700 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919534372 0 0) 0x7fba100cc270 con 0x7fba1015a950 2024-03-04T08:49:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.581+0000 7fba0e000640 1 -- 172.21.15.46:0/59207700 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f4003520 con 0x7fba1015a950 2024-03-04T08:49:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.582+0000 7fba0ea00640 1 -- 172.21.15.46:0/59207700 >> v2:172.21.15.46:3300/0 conn(0x7fba100cd220 msgr2=0x7fba100cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.582+0000 7fba0ea00640 1 --2- 172.21.15.46:0/59207700 >> v2:172.21.15.46:3300/0 conn(0x7fba100cd220 0x7fba100cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.582+0000 7fba0ea00640 1 -- 172.21.15.46:0/59207700 >> v1:172.21.15.73:6789/0 conn(0x7fba1015a950 legacy=0x7fba1015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.582+0000 7fba0ea00640 1 -- 172.21.15.46:0/59207700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100ccfc0 con 0x7fba100caae0 2024-03-04T08:49:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.584+0000 7fba0ea00640 1 --2- 172.21.15.46:0/59207700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100caae0 0x7fba1015a410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba000097a0 tx=0x7fba0002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=713838967f371b62 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.586+0000 7fba0e000640 1 -- 172.21.15.46:0/59207700 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00035020 con 0x7fba100caae0 2024-03-04T08:49:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.587+0000 7fba0e000640 1 -- 172.21.15.46:0/59207700 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00031830 con 0x7fba100caae0 2024-03-04T08:49:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.588+0000 7fba0e000640 1 -- 172.21.15.46:0/59207700 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00031be0 con 0x7fba100caae0 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.588+0000 7fba0fe00640 1 -- 172.21.15.46:0/59207700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100caae0 msgr2=0x7fba1015a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.588+0000 7fba0fe00640 1 --2- 172.21.15.46:0/59207700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100caae0 0x7fba1015a410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba000097a0 tx=0x7fba0002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.589+0000 7fba0fe00640 1 -- 172.21.15.46:0/59207700 shutdown_connections 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.589+0000 7fba0fe00640 1 --2- 172.21.15.46:0/59207700 >> v2:172.21.15.46:3300/0 conn(0x7fba100cd220 0x7fba100cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.589+0000 7fba0fe00640 1 --2- 172.21.15.46:0/59207700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100caae0 0x7fba1015a410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.589+0000 7fba0fe00640 1 -- 172.21.15.46:0/59207700 >> 172.21.15.46:0/59207700 conn(0x7fba100b15b0 msgr2=0x7fba100b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.589+0000 7fba0fe00640 1 -- 172.21.15.46:0/59207700 shutdown_connections 2024-03-04T08:49:49.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.589+0000 7fba0fe00640 1 -- 172.21.15.46:0/59207700 wait complete. 2024-03-04T08:49:49.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.591+0000 7fba0fe00640 1 Processor -- start 2024-03-04T08:49:49.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.592+0000 7fba0fe00640 1 -- start start 2024-03-04T08:49:49.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.593+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 0x7fba10153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:49.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.593+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd220 0x7fba101570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:49.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.593+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba1015a950 0x7fba1014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:49.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.593+0000 7fba0fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100cc4e0 con 0x7fba1015a950 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.593+0000 7fba0fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100cf6e0 con 0x7fba100caae0 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.593+0000 7fba0fe00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100cc7c0 con 0x7fba100cd220 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.594+0000 7fba0ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 0x7fba10153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.594+0000 7fba06000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd220 0x7fba101570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.594+0000 7fba0ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 0x7fba10153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33302/0 (socket says 172.21.15.46:33302) 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.594+0000 7fba0ea00640 1 -- 172.21.15.46:0/2077955338 learned_addr learned my addr 172.21.15.46:0/2077955338 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:49.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.594+0000 7fba0f400640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba1015a950 0x7fba1014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:49.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.598+0000 7fba06000640 1 -- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 msgr2=0x7fba10153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:49.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.598+0000 7fba06000640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 0x7fba10153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.598+0000 7fba06000640 1 -- 172.21.15.46:0/2077955338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba1015a950 msgr2=0x7fba1014dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:49.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.598+0000 7fba06000640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba1015a950 0x7fba1014dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:49.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.598+0000 7fba06000640 1 -- 172.21.15.46:0/2077955338 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba10158e00 con 0x7fba100cd220 2024-03-04T08:49:49.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.598+0000 7fba0ea00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 0x7fba10153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:49:49.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.600+0000 7fba06000640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd220 0x7fba101570b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800e850 tx=0x7fb9f800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.603+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8017070 con 0x7fba100cd220 2024-03-04T08:49:49.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.603+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f800c940 con 0x7fba100cd220 2024-03-04T08:49:49.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.603+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800cd10 con 0x7fba100cd220 2024-03-04T08:49:49.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.603+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101590e0 con 0x7fba100cd220 2024-03-04T08:49:49.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.603+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101596a0 con 0x7fba100cd220 2024-03-04T08:49:49.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.605+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100ceff0 con 0x7fba100cd220 2024-03-04T08:49:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.850+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9f801a070 con 0x7fba100cd220 2024-03-04T08:49:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.852+0000 7fba07e00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9ec06b4d0 0x7fb9ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.853+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9f808a760 con 0x7fba100cd220 2024-03-04T08:49:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.853+0000 7fba0ea00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9ec06b4d0 0x7fb9ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:49.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.854+0000 7fba0ea00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9ec06b4d0 0x7fb9ec06d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba000097a0 tx=0x7fba00008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:49.862+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fba100ceff0 con 0x7fba100cd220 2024-03-04T08:49:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.115+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fba1015a730 con 0x7fba100cd220 2024-03-04T08:49:50.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.667+0000 7fba07e00640 1 -- 172.21.15.46:0/2077955338 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb9f8059100 con 0x7fba100cd220 2024-03-04T08:49:50.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9ec06b4d0 msgr2=0x7fb9ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9ec06b4d0 0x7fb9ec06d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba000097a0 tx=0x7fba00008030 comp rx=0 tx=0).stop 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd220 msgr2=0x7fba101570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd220 0x7fba101570b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800e850 tx=0x7fb9f800ed10 comp rx=0 tx=0).stop 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 shutdown_connections 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9ec06b4d0 0x7fb9ec06d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba1015a950 0x7fba1014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd220 0x7fba101570b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 --2- 172.21.15.46:0/2077955338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba100caae0 0x7fba10153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 >> 172.21.15.46:0/2077955338 conn(0x7fba100b15b0 msgr2=0x7fba100b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 shutdown_connections 2024-03-04T08:49:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.670+0000 7fba0fe00640 1 -- 172.21.15.46:0/2077955338 wait complete. 2024-03-04T08:49:50.685 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-04T08:49:50.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:49:50.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.902+0000 7fd337600640 1 Processor -- start 2024-03-04T08:49:50.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.902+0000 7fd337600640 1 -- start start 2024-03-04T08:49:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.903+0000 7fd337600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd330154560 0x7fd33015e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.903+0000 7fd337600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd33015add0 0x7fd3300c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:50.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.903+0000 7fd337600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300c8b40 con 0x7fd33006bac0 2024-03-04T08:49:50.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.903+0000 7fd337600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33015d940 con 0x7fd330154560 2024-03-04T08:49:50.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.903+0000 7fd337600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33015df00 con 0x7fd33015add0 2024-03-04T08:49:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.904+0000 7fd32fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd33015add0 0x7fd3300c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.904+0000 7fd32fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd33015add0 0x7fd3300c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33304/0 (socket says 172.21.15.46:33304) 2024-03-04T08:49:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.904+0000 7fd32fe00640 1 -- 172.21.15.46:0/1830561619 learned_addr learned my addr 172.21.15.46:0/1830561619 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.904+0000 7fd334c00640 1 --2- 172.21.15.46:0/1830561619 >> v2:172.21.15.46:3300/0 conn(0x7fd330154560 0x7fd33015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.906+0000 7fd32fe00640 1 -- 172.21.15.46:0/1830561619 >> v2:172.21.15.46:3300/0 conn(0x7fd330154560 msgr2=0x7fd33015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.906+0000 7fd32fe00640 1 --2- 172.21.15.46:0/1830561619 >> v2:172.21.15.46:3300/0 conn(0x7fd330154560 0x7fd33015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.906+0000 7fd32fe00640 1 -- 172.21.15.46:0/1830561619 >> v1:172.21.15.46:6789/0 conn(0x7fd33006bac0 legacy=0x7fd33006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:50.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.906+0000 7fd32fe00640 1 -- 172.21.15.46:0/1830561619 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300c8e20 con 0x7fd33015add0 2024-03-04T08:49:50.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.908+0000 7fd32fe00640 1 --2- 172.21.15.46:0/1830561619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33015add0 0x7fd3300c9660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd330071320 tx=0x7fd31c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efdcd9d8d954cbe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:50.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.912+0000 7fd32f400640 1 -- 172.21.15.46:0/1830561619 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c034070 con 0x7fd33015add0 2024-03-04T08:49:50.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.912+0000 7fd32f400640 1 -- 172.21.15.46:0/1830561619 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c030860 con 0x7fd33015add0 2024-03-04T08:49:50.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.912+0000 7fd32f400640 1 -- 172.21.15.46:0/1830561619 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c030c30 con 0x7fd33015add0 2024-03-04T08:49:50.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 -- 172.21.15.46:0/1830561619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33015add0 msgr2=0x7fd3300c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 --2- 172.21.15.46:0/1830561619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33015add0 0x7fd3300c9660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd330071320 tx=0x7fd31c02b9a0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 -- 172.21.15.46:0/1830561619 shutdown_connections 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 --2- 172.21.15.46:0/1830561619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33015add0 0x7fd3300c9660 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 --2- 172.21.15.46:0/1830561619 >> v2:172.21.15.46:3300/0 conn(0x7fd330154560 0x7fd33015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 -- 172.21.15.46:0/1830561619 >> 172.21.15.46:0/1830561619 conn(0x7fd3300702a0 msgr2=0x7fd3300706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 -- 172.21.15.46:0/1830561619 shutdown_connections 2024-03-04T08:49:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.913+0000 7fd337600640 1 -- 172.21.15.46:0/1830561619 wait complete. 2024-03-04T08:49:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.915+0000 7fd337600640 1 Processor -- start 2024-03-04T08:49:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.915+0000 7fd337600640 1 -- start start 2024-03-04T08:49:50.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd337600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd33006bac0 0x7fd330156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd337600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 0x7fd330158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd337600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33015add0 0x7fd3301efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd337600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33015db90 con 0x7fd33015add0 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd337600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33015e8d0 con 0x7fd330154560 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd337600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33015b270 con 0x7fd33006bac0 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.916+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 0x7fd330158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.917+0000 7fd335600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33015add0 0x7fd3301efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.917+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 0x7fd330158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:33306/0 (socket says 172.21.15.46:33306) 2024-03-04T08:49:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.917+0000 7fd32fe00640 1 -- 172.21.15.46:0/2934114294 learned_addr learned my addr 172.21.15.46:0/2934114294 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.917+0000 7fd334c00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd33006bac0 0x7fd330156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.920+0000 7fd32fe00640 1 -- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd33006bac0 msgr2=0x7fd330156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.920+0000 7fd32fe00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd33006bac0 0x7fd330156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.920+0000 7fd32fe00640 1 -- 172.21.15.46:0/2934114294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33015add0 msgr2=0x7fd3301efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.920+0000 7fd32fe00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33015add0 0x7fd3301efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.920+0000 7fd32fe00640 1 -- 172.21.15.46:0/2934114294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3301e7440 con 0x7fd330154560 2024-03-04T08:49:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.923+0000 7fd32fe00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 0x7fd330158430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd31c02b9e0 tx=0x7fd31c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.925+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c034040 con 0x7fd330154560 2024-03-04T08:49:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.925+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3301f32d0 con 0x7fd330154560 2024-03-04T08:49:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.925+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3301f3890 con 0x7fd330154560 2024-03-04T08:49:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.926+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3300680b0 con 0x7fd330154560 2024-03-04T08:49:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.927+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c030860 con 0x7fd330154560 2024-03-04T08:49:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.927+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c04c450 con 0x7fd330154560 2024-03-04T08:49:50.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.950+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd31c04a060 con 0x7fd330154560 2024-03-04T08:49:50.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.951+0000 7fd32cc00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd31006b500 0x7fd31006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:50.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.951+0000 7fd334c00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd31006b500 0x7fd31006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:50.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:50.952+0000 7fd334c00640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd31006b500 0x7fd31006d9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd324009b40 tx=0x7fd324009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:51.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.216+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd31c078e60 con 0x7fd330154560 2024-03-04T08:49:51.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.229+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd31c03e070 con 0x7fd330154560 2024-03-04T08:49:51.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.474+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd330074d90 con 0x7fd330154560 2024-03-04T08:49:51.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.520+0000 7fd32cc00640 1 -- 172.21.15.46:0/2934114294 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6587 (secure 0 0 0) 0x7fd31c07adc0 con 0x7fd330154560 2024-03-04T08:49:51.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:51.517 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:49:40.471641+0000","modified":"2024-03-04T08:49:50.597790+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2],"up":{"mds_0":4273,"mds_1":4267,"mds_2":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"f","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273,4267]},"id":1}]} 2024-03-04T08:49:51.517 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 12 2024-03-04T08:49:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.523+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd31006b500 msgr2=0x7fd31006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.523+0000 7fd337600640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd31006b500 0x7fd31006d9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd324009b40 tx=0x7fd324009190 comp rx=0 tx=0).stop 2024-03-04T08:49:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.523+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 msgr2=0x7fd330158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.523+0000 7fd337600640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 0x7fd330158430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd31c02b9e0 tx=0x7fd31c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 shutdown_connections 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd31006b500 0x7fd31006d9c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd330154560 0x7fd330158430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33015add0 0x7fd3301efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 --2- 172.21.15.46:0/2934114294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd33006bac0 0x7fd330156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 >> 172.21.15.46:0/2934114294 conn(0x7fd3300702a0 msgr2=0x7fd330070680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 shutdown_connections 2024-03-04T08:49:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.524+0000 7fd337600640 1 -- 172.21.15.46:0/2934114294 wait complete. 2024-03-04T08:49:51.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.765+0000 7fee1b200640 1 Processor -- start 2024-03-04T08:49:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.766+0000 7fee1b200640 1 -- start start 2024-03-04T08:49:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.767+0000 7fee1b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c15e400 0x7fee1c0ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.767+0000 7fee1b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0cf240 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.767+0000 7fee1b200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0cf520 con 0x7fee1c0cc3b0 2024-03-04T08:49:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.767+0000 7fee1b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c154a00 con 0x7fee1c15e400 2024-03-04T08:49:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.768+0000 7fee19e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fee1c0cc3b0 0x7fee1c06c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49618/0 (socket says 172.21.15.46:49618) 2024-03-04T08:49:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.768+0000 7fee19e00640 1 -- 172.21.15.46:0/3185851593 learned_addr learned my addr 172.21.15.46:0/3185851593 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.768+0000 7fee13e00640 1 --2- 172.21.15.46:0/3185851593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c15e400 0x7fee1c0ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.770+0000 7fee13e00640 1 -- 172.21.15.46:0/3185851593 >> v1:172.21.15.73:6789/0 conn(0x7fee1c0cc3b0 legacy=0x7fee1c06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.771+0000 7fee13e00640 1 -- 172.21.15.46:0/3185851593 >> v1:172.21.15.46:6789/0 conn(0x7fee1c0ce1f0 legacy=0x7fee1c164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.771+0000 7fee13e00640 1 -- 172.21.15.46:0/3185851593 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c15d920 con 0x7fee1c15e400 2024-03-04T08:49:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.771+0000 7fee19400640 1 -- 172.21.15.46:0/3185851593 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248037887 0 0) 0x7fee1c0cf520 con 0x7fee1c0cc3b0 2024-03-04T08:49:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.773+0000 7fee13e00640 1 --2- 172.21.15.46:0/3185851593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c15e400 0x7fee1c0ce720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee040097d0 tx=0x7fee0402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a70721e56e6af55c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:51.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.776+0000 7fee19400640 1 -- 172.21.15.46:0/3185851593 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04035020 con 0x7fee1c15e400 2024-03-04T08:49:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.776+0000 7fee19400640 1 -- 172.21.15.46:0/3185851593 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04031800 con 0x7fee1c15e400 2024-03-04T08:49:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.776+0000 7fee19400640 1 -- 172.21.15.46:0/3185851593 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04031bd0 con 0x7fee1c15e400 2024-03-04T08:49:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 -- 172.21.15.46:0/3185851593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c15e400 msgr2=0x7fee1c0ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 --2- 172.21.15.46:0/3185851593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c15e400 0x7fee1c0ce720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee040097d0 tx=0x7fee0402b8a0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 -- 172.21.15.46:0/3185851593 shutdown_connections 2024-03-04T08:49:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 --2- 172.21.15.46:0/3185851593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c15e400 0x7fee1c0ce720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 -- 172.21.15.46:0/3185851593 >> 172.21.15.46:0/3185851593 conn(0x7fee1c0cf9a0 msgr2=0x7fee1c0cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 -- 172.21.15.46:0/3185851593 shutdown_connections 2024-03-04T08:49:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.777+0000 7fee1b200640 1 -- 172.21.15.46:0/3185851593 wait complete. 2024-03-04T08:49:51.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.780+0000 7fee1b200640 1 Processor -- start 2024-03-04T08:49:51.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.780+0000 7fee1b200640 1 -- start start 2024-03-04T08:49:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee1c0cc3b0 0x7fee1c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 0x7fee1c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee1c15e400 0x7fee1c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c15dee0 con 0x7fee1c0cc3b0 2024-03-04T08:49:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0cf800 con 0x7fee1c15e400 2024-03-04T08:49:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0cec90 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee13e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 0x7fee1c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee19e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee1c0cc3b0 0x7fee1c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.782+0000 7fee1a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee1c15e400 0x7fee1c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.783+0000 7fee13e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 0x7fee1c159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37690/0 (socket says 172.21.15.46:37690) 2024-03-04T08:49:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.783+0000 7fee13e00640 1 -- 172.21.15.46:0/4043956995 learned_addr learned my addr 172.21.15.46:0/4043956995 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.786+0000 7fee13e00640 1 -- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee1c15e400 msgr2=0x7fee1c155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.786+0000 7fee13e00640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee1c15e400 0x7fee1c155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.786+0000 7fee13e00640 1 -- 172.21.15.46:0/4043956995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee1c0cc3b0 msgr2=0x7fee1c15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.786+0000 7fee13e00640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee1c0cc3b0 0x7fee1c15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.786+0000 7fee13e00640 1 -- 172.21.15.46:0/4043956995 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c157840 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.788+0000 7fee13e00640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 0x7fee1c159370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee0402beb0 tx=0x7fee040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.790+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04035040 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.790+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c157ae0 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.790+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c0cff70 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.792+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0403f070 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.792+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0404b060 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.793+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c04f330 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.813+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee04038020 con 0x7fee1c0ce1f0 2024-03-04T08:49:51.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.815+0000 7fee12000640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fedf806b4d0 0x7fedf806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:51.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.815+0000 7fee19e00640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fedf806b4d0 0x7fedf806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:51.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:51.816+0000 7fee19e00640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fedf806b4d0 0x7fedf806d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee0c000f60 tx=0x7fee0c007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:52.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.059+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee04078a60 con 0x7fee1c0ce1f0 2024-03-04T08:49:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.070+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fee0407a9c0 con 0x7fee1c0ce1f0 2024-03-04T08:49:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.280+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee1c15d700 con 0x7fee1c0ce1f0 2024-03-04T08:49:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.317+0000 7fee12000640 1 -- 172.21.15.46:0/4043956995 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7fee0407ea60 con 0x7fee1c0ce1f0 2024-03-04T08:49:52.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:52.314 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:52.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.319+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fedf806b4d0 msgr2=0x7fedf806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:52.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.319+0000 7fee1b200640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fedf806b4d0 0x7fedf806d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee0c000f60 tx=0x7fee0c007d50 comp rx=0 tx=0).stop 2024-03-04T08:49:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.319+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 msgr2=0x7fee1c159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.319+0000 7fee1b200640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 0x7fee1c159370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee0402beb0 tx=0x7fee040046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 shutdown_connections 2024-03-04T08:49:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fedf806b4d0 0x7fedf806d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee1c15e400 0x7fee1c155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee1c0ce1f0 0x7fee1c159370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 --2- 172.21.15.46:0/4043956995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee1c0cc3b0 0x7fee1c15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 >> 172.21.15.46:0/4043956995 conn(0x7fee1c0cf9a0 msgr2=0x7fee1c14fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 shutdown_connections 2024-03-04T08:49:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.320+0000 7fee1b200640 1 -- 172.21.15.46:0/4043956995 wait complete. 2024-03-04T08:49:52.341 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-04T08:49:52.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:49:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.546+0000 7fea19c00640 1 Processor -- start 2024-03-04T08:49:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.546+0000 7fea19c00640 1 -- start start 2024-03-04T08:49:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.547+0000 7fea19c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1415add0 0x7fea1415e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.547+0000 7fea19c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea1406bac0 0x7fea14164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.548+0000 7fea19c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea140c8b40 con 0x7fea14154560 2024-03-04T08:49:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.548+0000 7fea19c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1415d940 con 0x7fea1406bac0 2024-03-04T08:49:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.548+0000 7fea19c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415df00 con 0x7fea1415add0 2024-03-04T08:49:52.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.552+0000 7fea13400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea1406bac0 0x7fea14164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:52.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.552+0000 7fea12a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fea14154560 0x7fea140c9660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50122/0 (socket says 172.21.15.46:50122) 2024-03-04T08:49:52.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.552+0000 7fea12a00640 1 -- 172.21.15.46:0/3845932321 learned_addr learned my addr 172.21.15.46:0/3845932321 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.554+0000 7fea12000640 1 --2- 172.21.15.46:0/3845932321 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1415add0 0x7fea1415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:52.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.557+0000 7fea12000640 1 -- 172.21.15.46:0/3845932321 >> v2:172.21.15.46:3300/0 conn(0x7fea1406bac0 msgr2=0x7fea14164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:52.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.557+0000 7fea12000640 1 --2- 172.21.15.46:0/3845932321 >> v2:172.21.15.46:3300/0 conn(0x7fea1406bac0 0x7fea14164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.557+0000 7fea12000640 1 -- 172.21.15.46:0/3845932321 >> v1:172.21.15.46:6789/0 conn(0x7fea14154560 legacy=0x7fea140c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:52.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.557+0000 7fea12000640 1 -- 172.21.15.46:0/3845932321 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140c8e20 con 0x7fea1415add0 2024-03-04T08:49:52.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.559+0000 7fea12000640 1 --2- 172.21.15.46:0/3845932321 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1415add0 0x7fea1415e390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea000097a0 tx=0x7fea0002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5508581fdd2387 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:52.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.621+0000 7fea11600640 1 -- 172.21.15.46:0/3845932321 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00035020 con 0x7fea1415add0 2024-03-04T08:49:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.629+0000 7fea11600640 1 -- 172.21.15.46:0/3845932321 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00031810 con 0x7fea1415add0 2024-03-04T08:49:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.629+0000 7fea11600640 1 -- 172.21.15.46:0/3845932321 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00031be0 con 0x7fea1415add0 2024-03-04T08:49:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 -- 172.21.15.46:0/3845932321 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1415add0 msgr2=0x7fea1415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 --2- 172.21.15.46:0/3845932321 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1415add0 0x7fea1415e390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea000097a0 tx=0x7fea0002b8b0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 -- 172.21.15.46:0/3845932321 shutdown_connections 2024-03-04T08:49:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 --2- 172.21.15.46:0/3845932321 >> v2:172.21.15.46:3300/0 conn(0x7fea1406bac0 0x7fea14164cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 --2- 172.21.15.46:0/3845932321 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1415add0 0x7fea1415e390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 -- 172.21.15.46:0/3845932321 >> 172.21.15.46:0/3845932321 conn(0x7fea140702a0 msgr2=0x7fea140706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:52.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 -- 172.21.15.46:0/3845932321 shutdown_connections 2024-03-04T08:49:52.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.630+0000 7fea19c00640 1 -- 172.21.15.46:0/3845932321 wait complete. 2024-03-04T08:49:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.633+0000 7fea19c00640 1 Processor -- start 2024-03-04T08:49:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.633+0000 7fea19c00640 1 -- start start 2024-03-04T08:49:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.634+0000 7fea19c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 0x7fea141f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea19c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea14154560 0x7fea141f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea19c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1415add0 0x7fea141f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea19c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415db90 con 0x7fea1415add0 2024-03-04T08:49:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea19c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415e8d0 con 0x7fea1406bac0 2024-03-04T08:49:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea19c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415b270 con 0x7fea14154560 2024-03-04T08:49:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea12a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 0x7fea141f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea12000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea14154560 0x7fea141f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.635+0000 7fea12a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 0x7fea141f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43722/0 (socket says 172.21.15.46:43722) 2024-03-04T08:49:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.636+0000 7fea12a00640 1 -- 172.21.15.46:0/2610088399 learned_addr learned my addr 172.21.15.46:0/2610088399 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.639+0000 7fea12000640 1 -- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 msgr2=0x7fea141f10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.639+0000 7fea12000640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 0x7fea141f10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.639+0000 7fea12000640 1 -- 172.21.15.46:0/2610088399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1415add0 msgr2=0x7fea141f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.639+0000 7fea12000640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1415add0 0x7fea141f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.639+0000 7fea12000640 1 -- 172.21.15.46:0/2610088399 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1415cb40 con 0x7fea14154560 2024-03-04T08:49:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.639+0000 7fea12a00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 0x7fea141f10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:49:52.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.641+0000 7fea12000640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea14154560 0x7fea141f1920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea00033000 tx=0x7fea000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:52.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.645+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00040070 con 0x7fea14154560 2024-03-04T08:49:52.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.645+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00039cf0 con 0x7fea14154560 2024-03-04T08:49:52.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.645+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00035040 con 0x7fea14154560 2024-03-04T08:49:52.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.645+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1415ce20 con 0x7fea14154560 2024-03-04T08:49:52.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.645+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea141f08a0 con 0x7fea14154560 2024-03-04T08:49:52.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.647+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1406cf70 con 0x7fea14154560 2024-03-04T08:49:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.667+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fea0004b060 con 0x7fea14154560 2024-03-04T08:49:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.669+0000 7fea0aa00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9f406b520 0x7fe9f406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.669+0000 7fea12a00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9f406b520 0x7fe9f406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:52.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.669+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea00078a60 con 0x7fea14154560 2024-03-04T08:49:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.670+0000 7fea12a00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9f406b520 0x7fe9f406d9e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea04007d50 tx=0x7fea04007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:52.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:52.938+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fea1406cf70 con 0x7fea14154560 2024-03-04T08:49:53.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.143+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea140680b0 con 0x7fe9f406b520 2024-03-04T08:49:53.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.150+0000 7fea0aa00640 1 -- 172.21.15.46:0/2610088399 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251917 (secure 0 0 0) 0x7fea140680b0 con 0x7fe9f406b520 2024-03-04T08:49:53.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:53.151 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9f406b520 msgr2=0x7fe9f406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9f406b520 0x7fe9f406d9e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea04007d50 tx=0x7fea04007ca0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea14154560 msgr2=0x7fea141f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea14154560 0x7fea141f1920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea00033000 tx=0x7fea000046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 shutdown_connections 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9f406b520 0x7fe9f406d9e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1415add0 0x7fea141f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea14154560 0x7fea141f1920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 --2- 172.21.15.46:0/2610088399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1406bac0 0x7fea141f10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 >> 172.21.15.46:0/2610088399 conn(0x7fea140702a0 msgr2=0x7fea140c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 shutdown_connections 2024-03-04T08:49:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.154+0000 7fea19c00640 1 -- 172.21.15.46:0/2610088399 wait complete. 2024-03-04T08:49:53.168 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-04T08:49:51.431865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235864,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738856,"statfs":{"total":773094113280,"available":772852588544,"internally_reserved":0,"allocated":3121152,"data_stored":1853540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002084"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281486+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T08:49:43.281486+0000","last_peered":"2024-03-04T08:49:43.281486+0000","last_clean":"2024-03-04T08:49:43.281486+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T08:49:43.281486+0000","last_undegraded":"2024-03-04T08:49:43.281486+0000","last_fullsized":"2024-03-04T08:49:43.281486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047094+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T08:49:43.047094+0000","last_peered":"2024-03-04T08:49:43.047094+0000","last_clean":"2024-03-04T08:49:43.047094+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T08:49:43.047094+0000","last_undegraded":"2024-03-04T08:49:43.047094+0000","last_fullsized":"2024-03-04T08:49:43.047094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047069+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T08:49:43.047069+0000","last_peered":"2024-03-04T08:49:43.047069+0000","last_clean":"2024-03-04T08:49:43.047069+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T08:49:43.047069+0000","last_undegraded":"2024-03-04T08:49:43.047069+0000","last_fullsized":"2024-03-04T08:49:43.047069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369960+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T08:49:42.369960+0000","last_peered":"2024-03-04T08:49:42.369960+0000","last_clean":"2024-03-04T08:49:42.369960+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T08:49:42.369960+0000","last_undegraded":"2024-03-04T08:49:42.369960+0000","last_fullsized":"2024-03-04T08:49:42.369960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280132+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T08:49:43.280132+0000","last_peered":"2024-03-04T08:49:43.280132+0000","last_clean":"2024-03-04T08:49:43.280132+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T08:49:43.280132+0000","last_undegraded":"2024-03-04T08:49:43.280132+0000","last_fullsized":"2024-03-04T08:49:43.280132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369716+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T08:49:42.369716+0000","last_peered":"2024-03-04T08:49:42.369716+0000","last_clean":"2024-03-04T08:49:42.369716+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T08:49:42.369716+0000","last_undegraded":"2024-03-04T08:49:42.369716+0000","last_fullsized":"2024-03-04T08:49:42.369716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279556+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T08:49:43.279556+0000","last_peered":"2024-03-04T08:49:43.279556+0000","last_clean":"2024-03-04T08:49:43.279556+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T08:49:43.279556+0000","last_undegraded":"2024-03-04T08:49:43.279556+0000","last_fullsized":"2024-03-04T08:49:43.279556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280535+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T08:49:43.280535+0000","last_peered":"2024-03-04T08:49:43.280535+0000","last_clean":"2024-03-04T08:49:43.280535+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T08:49:43.280535+0000","last_undegraded":"2024-03-04T08:49:43.280535+0000","last_fullsized":"2024-03-04T08:49:43.280535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281592+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T08:49:43.281592+0000","last_peered":"2024-03-04T08:49:43.281592+0000","last_clean":"2024-03-04T08:49:43.281592+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T08:49:43.281592+0000","last_undegraded":"2024-03-04T08:49:43.281592+0000","last_fullsized":"2024-03-04T08:49:43.281592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280787+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T08:49:43.280787+0000","last_peered":"2024-03-04T08:49:43.280787+0000","last_clean":"2024-03-04T08:49:43.280787+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T08:49:43.280787+0000","last_undegraded":"2024-03-04T08:49:43.280787+0000","last_fullsized":"2024-03-04T08:49:43.280787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280684+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T08:49:43.280684+0000","last_peered":"2024-03-04T08:49:43.280684+0000","last_clean":"2024-03-04T08:49:43.280684+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T08:49:43.280684+0000","last_undegraded":"2024-03-04T08:49:43.280684+0000","last_fullsized":"2024-03-04T08:49:43.280684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276060+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T08:49:43.276060+0000","last_peered":"2024-03-04T08:49:43.276060+0000","last_clean":"2024-03-04T08:49:43.276060+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T08:49:43.276060+0000","last_undegraded":"2024-03-04T08:49:43.276060+0000","last_fullsized":"2024-03-04T08:49:43.276060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276313+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T08:49:43.276313+0000","last_peered":"2024-03-04T08:49:43.276313+0000","last_clean":"2024-03-04T08:49:43.276313+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T08:49:43.276313+0000","last_undegraded":"2024-03-04T08:49:43.276313+0000","last_fullsized":"2024-03-04T08:49:43.276313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046770+0000","last_change":"2024-03-04T08:49:40.146477+0000","last_active":"2024-03-04T08:49:43.046770+0000","last_peered":"2024-03-04T08:49:43.046770+0000","last_clean":"2024-03-04T08:49:43.046770+0000","last_became_active":"2024-03-04T08:49:40.146170+0000","last_became_peered":"2024-03-04T08:49:40.146170+0000","last_unstale":"2024-03-04T08:49:43.046770+0000","last_undegraded":"2024-03-04T08:49:43.046770+0000","last_fullsized":"2024-03-04T08:49:43.046770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:53:13.937230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325117+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T08:49:42.325117+0000","last_peered":"2024-03-04T08:49:42.325117+0000","last_clean":"2024-03-04T08:49:42.325117+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T08:49:42.325117+0000","last_undegraded":"2024-03-04T08:49:42.325117+0000","last_fullsized":"2024-03-04T08:49:42.325117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325919+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T08:49:42.325919+0000","last_peered":"2024-03-04T08:49:42.325919+0000","last_clean":"2024-03-04T08:49:42.325919+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T08:49:42.325919+0000","last_undegraded":"2024-03-04T08:49:42.325919+0000","last_fullsized":"2024-03-04T08:49:42.325919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277148+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T08:49:43.277148+0000","last_peered":"2024-03-04T08:49:43.277148+0000","last_clean":"2024-03-04T08:49:43.277148+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T08:49:43.277148+0000","last_undegraded":"2024-03-04T08:49:43.277148+0000","last_fullsized":"2024-03-04T08:49:43.277148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326173+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T08:49:42.326173+0000","last_peered":"2024-03-04T08:49:42.326173+0000","last_clean":"2024-03-04T08:49:42.326173+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T08:49:42.326173+0000","last_undegraded":"2024-03-04T08:49:42.326173+0000","last_fullsized":"2024-03-04T08:49:42.326173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280559+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T08:49:43.280559+0000","last_peered":"2024-03-04T08:49:43.280559+0000","last_clean":"2024-03-04T08:49:43.280559+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T08:49:43.280559+0000","last_undegraded":"2024-03-04T08:49:43.280559+0000","last_fullsized":"2024-03-04T08:49:43.280559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276042+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T08:49:43.276042+0000","last_peered":"2024-03-04T08:49:43.276042+0000","last_clean":"2024-03-04T08:49:43.276042+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T08:49:43.276042+0000","last_undegraded":"2024-03-04T08:49:43.276042+0000","last_fullsized":"2024-03-04T08:49:43.276042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277967+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T08:49:43.277967+0000","last_peered":"2024-03-04T08:49:43.277967+0000","last_clean":"2024-03-04T08:49:43.277967+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T08:49:43.277967+0000","last_undegraded":"2024-03-04T08:49:43.277967+0000","last_fullsized":"2024-03-04T08:49:43.277967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046777+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T08:49:43.046777+0000","last_peered":"2024-03-04T08:49:43.046777+0000","last_clean":"2024-03-04T08:49:43.046777+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T08:49:43.046777+0000","last_undegraded":"2024-03-04T08:49:43.046777+0000","last_fullsized":"2024-03-04T08:49:43.046777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325115+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T08:49:42.325115+0000","last_peered":"2024-03-04T08:49:42.325115+0000","last_clean":"2024-03-04T08:49:42.325115+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T08:49:42.325115+0000","last_undegraded":"2024-03-04T08:49:42.325115+0000","last_fullsized":"2024-03-04T08:49:42.325115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047184+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T08:49:43.047184+0000","last_peered":"2024-03-04T08:49:43.047184+0000","last_clean":"2024-03-04T08:49:43.047184+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T08:49:43.047184+0000","last_undegraded":"2024-03-04T08:49:43.047184+0000","last_fullsized":"2024-03-04T08:49:43.047184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370272+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T08:49:42.370272+0000","last_peered":"2024-03-04T08:49:42.370272+0000","last_clean":"2024-03-04T08:49:42.370272+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T08:49:42.370272+0000","last_undegraded":"2024-03-04T08:49:42.370272+0000","last_fullsized":"2024-03-04T08:49:42.370272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275907+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T08:49:43.275907+0000","last_peered":"2024-03-04T08:49:43.275907+0000","last_clean":"2024-03-04T08:49:43.275907+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T08:49:43.275907+0000","last_undegraded":"2024-03-04T08:49:43.275907+0000","last_fullsized":"2024-03-04T08:49:43.275907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276346+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T08:49:43.276346+0000","last_peered":"2024-03-04T08:49:43.276346+0000","last_clean":"2024-03-04T08:49:43.276346+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T08:49:43.276346+0000","last_undegraded":"2024-03-04T08:49:43.276346+0000","last_fullsized":"2024-03-04T08:49:43.276346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046951+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T08:49:43.046951+0000","last_peered":"2024-03-04T08:49:43.046951+0000","last_clean":"2024-03-04T08:49:43.046951+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T08:49:43.046951+0000","last_undegraded":"2024-03-04T08:49:43.046951+0000","last_fullsized":"2024-03-04T08:49:43.046951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325310+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T08:49:42.325310+0000","last_peered":"2024-03-04T08:49:42.325310+0000","last_clean":"2024-03-04T08:49:42.325310+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T08:49:42.325310+0000","last_undegraded":"2024-03-04T08:49:42.325310+0000","last_fullsized":"2024-03-04T08:49:42.325310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276935+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T08:49:43.276935+0000","last_peered":"2024-03-04T08:49:43.276935+0000","last_clean":"2024-03-04T08:49:43.276935+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T08:49:43.276935+0000","last_undegraded":"2024-03-04T08:49:43.276935+0000","last_fullsized":"2024-03-04T08:49:43.276935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369643+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T08:49:42.369643+0000","last_peered":"2024-03-04T08:49:42.369643+0000","last_clean":"2024-03-04T08:49:42.369643+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T08:49:42.369643+0000","last_undegraded":"2024-03-04T08:49:42.369643+0000","last_fullsized":"2024-03-04T08:49:42.369643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278146+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T08:49:43.278146+0000","last_peered":"2024-03-04T08:49:43.278146+0000","last_clean":"2024-03-04T08:49:43.278146+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T08:49:43.278146+0000","last_undegraded":"2024-03-04T08:49:43.278146+0000","last_fullsized":"2024-03-04T08:49:43.278146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047134+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T08:49:43.047134+0000","last_peered":"2024-03-04T08:49:43.047134+0000","last_clean":"2024-03-04T08:49:43.047134+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T08:49:43.047134+0000","last_undegraded":"2024-03-04T08:49:43.047134+0000","last_fullsized":"2024-03-04T08:49:43.047134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276098+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T08:49:43.276098+0000","last_peered":"2024-03-04T08:49:43.276098+0000","last_clean":"2024-03-04T08:49:43.276098+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T08:49:43.276098+0000","last_undegraded":"2024-03-04T08:49:43.276098+0000","last_fullsized":"2024-03-04T08:49:43.276098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325413+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T08:49:42.325413+0000","last_peered":"2024-03-04T08:49:42.325413+0000","last_clean":"2024-03-04T08:49:42.325413+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T08:49:42.325413+0000","last_undegraded":"2024-03-04T08:49:42.325413+0000","last_fullsized":"2024-03-04T08:49:42.325413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275796+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T08:49:43.275796+0000","last_peered":"2024-03-04T08:49:43.275796+0000","last_clean":"2024-03-04T08:49:43.275796+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T08:49:43.275796+0000","last_undegraded":"2024-03-04T08:49:43.275796+0000","last_fullsized":"2024-03-04T08:49:43.275796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047047+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T08:49:43.047047+0000","last_peered":"2024-03-04T08:49:43.047047+0000","last_clean":"2024-03-04T08:49:43.047047+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T08:49:43.047047+0000","last_undegraded":"2024-03-04T08:49:43.047047+0000","last_fullsized":"2024-03-04T08:49:43.047047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325217+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T08:49:42.325217+0000","last_peered":"2024-03-04T08:49:42.325217+0000","last_clean":"2024-03-04T08:49:42.325217+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T08:49:42.325217+0000","last_undegraded":"2024-03-04T08:49:42.325217+0000","last_fullsized":"2024-03-04T08:49:42.325217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275934+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T08:49:43.275934+0000","last_peered":"2024-03-04T08:49:43.275934+0000","last_clean":"2024-03-04T08:49:43.275934+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T08:49:43.275934+0000","last_undegraded":"2024-03-04T08:49:43.275934+0000","last_fullsized":"2024-03-04T08:49:43.275934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280875+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T08:49:43.280875+0000","last_peered":"2024-03-04T08:49:43.280875+0000","last_clean":"2024-03-04T08:49:43.280875+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T08:49:43.280875+0000","last_undegraded":"2024-03-04T08:49:43.280875+0000","last_fullsized":"2024-03-04T08:49:43.280875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370223+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T08:49:42.370223+0000","last_peered":"2024-03-04T08:49:42.370223+0000","last_clean":"2024-03-04T08:49:42.370223+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T08:49:42.370223+0000","last_undegraded":"2024-03-04T08:49:42.370223+0000","last_fullsized":"2024-03-04T08:49:42.370223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281584+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T08:49:43.281584+0000","last_peered":"2024-03-04T08:49:43.281584+0000","last_clean":"2024-03-04T08:49:43.281584+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T08:49:43.281584+0000","last_undegraded":"2024-03-04T08:49:43.281584+0000","last_fullsized":"2024-03-04T08:49:43.281584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047304+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T08:49:43.047304+0000","last_peered":"2024-03-04T08:49:43.047304+0000","last_clean":"2024-03-04T08:49:43.047304+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T08:49:43.047304+0000","last_undegraded":"2024-03-04T08:49:43.047304+0000","last_fullsized":"2024-03-04T08:49:43.047304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.367561+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T08:49:43.367561+0000","last_peered":"2024-03-04T08:49:43.367561+0000","last_clean":"2024-03-04T08:49:43.367561+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T08:49:43.367561+0000","last_undegraded":"2024-03-04T08:49:43.367561+0000","last_fullsized":"2024-03-04T08:49:43.367561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325558+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T08:49:42.325558+0000","last_peered":"2024-03-04T08:49:42.325558+0000","last_clean":"2024-03-04T08:49:42.325558+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T08:49:42.325558+0000","last_undegraded":"2024-03-04T08:49:42.325558+0000","last_fullsized":"2024-03-04T08:49:42.325558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.386510+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T08:49:43.386510+0000","last_peered":"2024-03-04T08:49:43.386510+0000","last_clean":"2024-03-04T08:49:43.386510+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T08:49:43.386510+0000","last_undegraded":"2024-03-04T08:49:43.386510+0000","last_fullsized":"2024-03-04T08:49:43.386510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281324+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T08:49:43.281324+0000","last_peered":"2024-03-04T08:49:43.281324+0000","last_clean":"2024-03-04T08:49:43.281324+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T08:49:43.281324+0000","last_undegraded":"2024-03-04T08:49:43.281324+0000","last_fullsized":"2024-03-04T08:49:43.281324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.364847+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T08:49:43.364847+0000","last_peered":"2024-03-04T08:49:43.364847+0000","last_clean":"2024-03-04T08:49:43.364847+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T08:49:43.364847+0000","last_undegraded":"2024-03-04T08:49:43.364847+0000","last_fullsized":"2024-03-04T08:49:43.364847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276382+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T08:49:43.276382+0000","last_peered":"2024-03-04T08:49:43.276382+0000","last_clean":"2024-03-04T08:49:43.276382+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T08:49:43.276382+0000","last_undegraded":"2024-03-04T08:49:43.276382+0000","last_fullsized":"2024-03-04T08:49:43.276382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325598+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T08:49:42.325598+0000","last_peered":"2024-03-04T08:49:42.325598+0000","last_clean":"2024-03-04T08:49:42.325598+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T08:49:42.325598+0000","last_undegraded":"2024-03-04T08:49:42.325598+0000","last_fullsized":"2024-03-04T08:49:42.325598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325413+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T08:49:42.325413+0000","last_peered":"2024-03-04T08:49:42.325413+0000","last_clean":"2024-03-04T08:49:42.325413+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T08:49:42.325413+0000","last_undegraded":"2024-03-04T08:49:42.325413+0000","last_fullsized":"2024-03-04T08:49:42.325413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279639+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T08:49:43.279639+0000","last_peered":"2024-03-04T08:49:43.279639+0000","last_clean":"2024-03-04T08:49:43.279639+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T08:49:43.279639+0000","last_undegraded":"2024-03-04T08:49:43.279639+0000","last_fullsized":"2024-03-04T08:49:43.279639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277684+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T08:49:43.277684+0000","last_peered":"2024-03-04T08:49:43.277684+0000","last_clean":"2024-03-04T08:49:43.277684+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T08:49:43.277684+0000","last_undegraded":"2024-03-04T08:49:43.277684+0000","last_fullsized":"2024-03-04T08:49:43.277684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.472895+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T08:49:43.472895+0000","last_peered":"2024-03-04T08:49:43.472895+0000","last_clean":"2024-03-04T08:49:43.472895+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T08:49:43.472895+0000","last_undegraded":"2024-03-04T08:49:43.472895+0000","last_fullsized":"2024-03-04T08:49:43.472895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325325+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T08:49:42.325325+0000","last_peered":"2024-03-04T08:49:42.325325+0000","last_clean":"2024-03-04T08:49:42.325325+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T08:49:42.325325+0000","last_undegraded":"2024-03-04T08:49:42.325325+0000","last_fullsized":"2024-03-04T08:49:42.325325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281803+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T08:49:43.281803+0000","last_peered":"2024-03-04T08:49:43.281803+0000","last_clean":"2024-03-04T08:49:43.281803+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T08:49:43.281803+0000","last_undegraded":"2024-03-04T08:49:43.281803+0000","last_fullsized":"2024-03-04T08:49:43.281803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370359+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T08:49:42.370359+0000","last_peered":"2024-03-04T08:49:42.370359+0000","last_clean":"2024-03-04T08:49:42.370359+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T08:49:42.370359+0000","last_undegraded":"2024-03-04T08:49:42.370359+0000","last_fullsized":"2024-03-04T08:49:42.370359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.409698+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T08:49:43.409698+0000","last_peered":"2024-03-04T08:49:43.409698+0000","last_clean":"2024-03-04T08:49:43.409698+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T08:49:43.409698+0000","last_undegraded":"2024-03-04T08:49:43.409698+0000","last_fullsized":"2024-03-04T08:49:43.409698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281668+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T08:49:43.281668+0000","last_peered":"2024-03-04T08:49:43.281668+0000","last_clean":"2024-03-04T08:49:43.281668+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T08:49:43.281668+0000","last_undegraded":"2024-03-04T08:49:43.281668+0000","last_fullsized":"2024-03-04T08:49:43.281668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047046+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T08:49:43.047046+0000","last_peered":"2024-03-04T08:49:43.047046+0000","last_clean":"2024-03-04T08:49:43.047046+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T08:49:43.047046+0000","last_undegraded":"2024-03-04T08:49:43.047046+0000","last_fullsized":"2024-03-04T08:49:43.047046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280764+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T08:49:43.280764+0000","last_peered":"2024-03-04T08:49:43.280764+0000","last_clean":"2024-03-04T08:49:43.280764+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T08:49:43.280764+0000","last_undegraded":"2024-03-04T08:49:43.280764+0000","last_fullsized":"2024-03-04T08:49:43.280764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276455+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T08:49:43.276455+0000","last_peered":"2024-03-04T08:49:43.276455+0000","last_clean":"2024-03-04T08:49:43.276455+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T08:49:43.276455+0000","last_undegraded":"2024-03-04T08:49:43.276455+0000","last_fullsized":"2024-03-04T08:49:43.276455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325992+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T08:49:42.325992+0000","last_peered":"2024-03-04T08:49:42.325992+0000","last_clean":"2024-03-04T08:49:42.325992+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T08:49:42.325992+0000","last_undegraded":"2024-03-04T08:49:42.325992+0000","last_fullsized":"2024-03-04T08:49:42.325992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277565+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T08:49:43.277565+0000","last_peered":"2024-03-04T08:49:43.277565+0000","last_clean":"2024-03-04T08:49:43.277565+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T08:49:43.277565+0000","last_undegraded":"2024-03-04T08:49:43.277565+0000","last_fullsized":"2024-03-04T08:49:43.277565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326001+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T08:49:42.326001+0000","last_peered":"2024-03-04T08:49:42.326001+0000","last_clean":"2024-03-04T08:49:42.326001+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T08:49:42.326001+0000","last_undegraded":"2024-03-04T08:49:42.326001+0000","last_fullsized":"2024-03-04T08:49:42.326001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276209+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T08:49:43.276209+0000","last_peered":"2024-03-04T08:49:43.276209+0000","last_clean":"2024-03-04T08:49:43.276209+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T08:49:43.276209+0000","last_undegraded":"2024-03-04T08:49:43.276209+0000","last_fullsized":"2024-03-04T08:49:43.276209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325220+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T08:49:42.325220+0000","last_peered":"2024-03-04T08:49:42.325220+0000","last_clean":"2024-03-04T08:49:42.325220+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T08:49:42.325220+0000","last_undegraded":"2024-03-04T08:49:42.325220+0000","last_fullsized":"2024-03-04T08:49:42.325220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275709+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T08:49:43.275709+0000","last_peered":"2024-03-04T08:49:43.275709+0000","last_clean":"2024-03-04T08:49:43.275709+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T08:49:43.275709+0000","last_undegraded":"2024-03-04T08:49:43.275709+0000","last_fullsized":"2024-03-04T08:49:43.275709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276884+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T08:49:43.276884+0000","last_peered":"2024-03-04T08:49:43.276884+0000","last_clean":"2024-03-04T08:49:43.276884+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T08:49:43.276884+0000","last_undegraded":"2024-03-04T08:49:43.276884+0000","last_fullsized":"2024-03-04T08:49:43.276884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325800+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T08:49:42.325800+0000","last_peered":"2024-03-04T08:49:42.325800+0000","last_clean":"2024-03-04T08:49:42.325800+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T08:49:42.325800+0000","last_undegraded":"2024-03-04T08:49:42.325800+0000","last_fullsized":"2024-03-04T08:49:42.325800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279927+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T08:49:43.279927+0000","last_peered":"2024-03-04T08:49:43.279927+0000","last_clean":"2024-03-04T08:49:43.279927+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T08:49:43.279927+0000","last_undegraded":"2024-03-04T08:49:43.279927+0000","last_fullsized":"2024-03-04T08:49:43.279927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047009+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T08:49:43.047009+0000","last_peered":"2024-03-04T08:49:43.047009+0000","last_clean":"2024-03-04T08:49:43.047009+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T08:49:43.047009+0000","last_undegraded":"2024-03-04T08:49:43.047009+0000","last_fullsized":"2024-03-04T08:49:43.047009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369747+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T08:49:42.369747+0000","last_peered":"2024-03-04T08:49:42.369747+0000","last_clean":"2024-03-04T08:49:42.369747+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T08:49:42.369747+0000","last_undegraded":"2024-03-04T08:49:42.369747+0000","last_fullsized":"2024-03-04T08:49:42.369747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326112+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T08:49:42.326112+0000","last_peered":"2024-03-04T08:49:42.326112+0000","last_clean":"2024-03-04T08:49:42.326112+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T08:49:42.326112+0000","last_undegraded":"2024-03-04T08:49:42.326112+0000","last_fullsized":"2024-03-04T08:49:42.326112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276449+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T08:49:43.276449+0000","last_peered":"2024-03-04T08:49:43.276449+0000","last_clean":"2024-03-04T08:49:43.276449+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T08:49:43.276449+0000","last_undegraded":"2024-03-04T08:49:43.276449+0000","last_fullsized":"2024-03-04T08:49:43.276449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276308+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T08:49:43.276308+0000","last_peered":"2024-03-04T08:49:43.276308+0000","last_clean":"2024-03-04T08:49:43.276308+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T08:49:43.276308+0000","last_undegraded":"2024-03-04T08:49:43.276308+0000","last_fullsized":"2024-03-04T08:49:43.276308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275984+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T08:49:43.275984+0000","last_peered":"2024-03-04T08:49:43.275984+0000","last_clean":"2024-03-04T08:49:43.275984+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T08:49:43.275984+0000","last_undegraded":"2024-03-04T08:49:43.275984+0000","last_fullsized":"2024-03-04T08:49:43.275984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.616085+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T08:49:43.616085+0000","last_peered":"2024-03-04T08:49:43.616085+0000","last_clean":"2024-03-04T08:49:43.616085+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T08:49:43.616085+0000","last_undegraded":"2024-03-04T08:49:43.616085+0000","last_fullsized":"2024-03-04T08:49:43.616085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276106+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T08:49:43.276106+0000","last_peered":"2024-03-04T08:49:43.276106+0000","last_clean":"2024-03-04T08:49:43.276106+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T08:49:43.276106+0000","last_undegraded":"2024-03-04T08:49:43.276106+0000","last_fullsized":"2024-03-04T08:49:43.276106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278793+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T08:49:43.278793+0000","last_peered":"2024-03-04T08:49:43.278793+0000","last_clean":"2024-03-04T08:49:43.278793+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T08:49:43.278793+0000","last_undegraded":"2024-03-04T08:49:43.278793+0000","last_fullsized":"2024-03-04T08:49:43.278793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325605+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T08:49:42.325605+0000","last_peered":"2024-03-04T08:49:42.325605+0000","last_clean":"2024-03-04T08:49:42.325605+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T08:49:42.325605+0000","last_undegraded":"2024-03-04T08:49:42.325605+0000","last_fullsized":"2024-03-04T08:49:42.325605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275898+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T08:49:43.275898+0000","last_peered":"2024-03-04T08:49:43.275898+0000","last_clean":"2024-03-04T08:49:43.275898+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T08:49:43.275898+0000","last_undegraded":"2024-03-04T08:49:43.275898+0000","last_fullsized":"2024-03-04T08:49:43.275898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275588+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T08:49:43.275588+0000","last_peered":"2024-03-04T08:49:43.275588+0000","last_clean":"2024-03-04T08:49:43.275588+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T08:49:43.275588+0000","last_undegraded":"2024-03-04T08:49:43.275588+0000","last_fullsized":"2024-03-04T08:49:43.275588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276417+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T08:49:43.276417+0000","last_peered":"2024-03-04T08:49:43.276417+0000","last_clean":"2024-03-04T08:49:43.276417+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T08:49:43.276417+0000","last_undegraded":"2024-03-04T08:49:43.276417+0000","last_fullsized":"2024-03-04T08:49:43.276417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277053+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T08:49:43.277053+0000","last_peered":"2024-03-04T08:49:43.277053+0000","last_clean":"2024-03-04T08:49:43.277053+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T08:49:43.277053+0000","last_undegraded":"2024-03-04T08:49:43.277053+0000","last_fullsized":"2024-03-04T08:49:43.277053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.615035+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T08:49:43.615035+0000","last_peered":"2024-03-04T08:49:43.615035+0000","last_clean":"2024-03-04T08:49:43.615035+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T08:49:43.615035+0000","last_undegraded":"2024-03-04T08:49:43.615035+0000","last_fullsized":"2024-03-04T08:49:43.615035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325238+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T08:49:42.325238+0000","last_peered":"2024-03-04T08:49:42.325238+0000","last_clean":"2024-03-04T08:49:42.325238+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T08:49:42.325238+0000","last_undegraded":"2024-03-04T08:49:42.325238+0000","last_fullsized":"2024-03-04T08:49:42.325238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326038+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T08:49:42.326038+0000","last_peered":"2024-03-04T08:49:42.326038+0000","last_clean":"2024-03-04T08:49:42.326038+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T08:49:42.326038+0000","last_undegraded":"2024-03-04T08:49:42.326038+0000","last_fullsized":"2024-03-04T08:49:42.326038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.605652+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T08:49:43.605652+0000","last_peered":"2024-03-04T08:49:43.605652+0000","last_clean":"2024-03-04T08:49:43.605652+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T08:49:43.605652+0000","last_undegraded":"2024-03-04T08:49:43.605652+0000","last_fullsized":"2024-03-04T08:49:43.605652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278451+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T08:49:43.278451+0000","last_peered":"2024-03-04T08:49:43.278451+0000","last_clean":"2024-03-04T08:49:43.278451+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T08:49:43.278451+0000","last_undegraded":"2024-03-04T08:49:43.278451+0000","last_fullsized":"2024-03-04T08:49:43.278451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.603961+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T08:49:43.603961+0000","last_peered":"2024-03-04T08:49:43.603961+0000","last_clean":"2024-03-04T08:49:43.603961+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T08:49:43.603961+0000","last_undegraded":"2024-03-04T08:49:43.603961+0000","last_fullsized":"2024-03-04T08:49:43.603961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047218+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T08:49:43.047218+0000","last_peered":"2024-03-04T08:49:43.047218+0000","last_clean":"2024-03-04T08:49:43.047218+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T08:49:43.047218+0000","last_undegraded":"2024-03-04T08:49:43.047218+0000","last_fullsized":"2024-03-04T08:49:43.047218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047265+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T08:49:43.047265+0000","last_peered":"2024-03-04T08:49:43.047265+0000","last_clean":"2024-03-04T08:49:43.047265+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T08:49:43.047265+0000","last_undegraded":"2024-03-04T08:49:43.047265+0000","last_fullsized":"2024-03-04T08:49:43.047265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047168+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T08:49:43.047168+0000","last_peered":"2024-03-04T08:49:43.047168+0000","last_clean":"2024-03-04T08:49:43.047168+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T08:49:43.047168+0000","last_undegraded":"2024-03-04T08:49:43.047168+0000","last_fullsized":"2024-03-04T08:49:43.047168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.481646+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T08:49:43.481646+0000","last_peered":"2024-03-04T08:49:43.481646+0000","last_clean":"2024-03-04T08:49:43.481646+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T08:49:43.481646+0000","last_undegraded":"2024-03-04T08:49:43.481646+0000","last_fullsized":"2024-03-04T08:49:43.481646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":84080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":85110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":831488,"data_stored":673936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":83554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":83622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":83498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":673958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":85782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:49:53.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:49:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.407+0000 7fcec5800640 1 Processor -- start 2024-03-04T08:49:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.407+0000 7fcec5800640 1 -- start start 2024-03-04T08:49:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.409+0000 7fcec5800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 0x7fcec00ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.409+0000 7fcec5800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcec015e400 0x7fcec00cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.409+0000 7fcec5800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcec00ce1f0 0x7fcec006c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.409+0000 7fcec5800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec0154a00 con 0x7fcec00ce1f0 2024-03-04T08:49:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.409+0000 7fcec5800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec00cf800 con 0x7fcec015e400 2024-03-04T08:49:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.409+0000 7fcec5800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec006c6e0 con 0x7fcec00cc3b0 2024-03-04T08:49:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.410+0000 7fcebfe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 0x7fcec00ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.410+0000 7fcec4e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcec00ce1f0 0x7fcec006c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.410+0000 7fcebfe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 0x7fcec00ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37716/0 (socket says 172.21.15.46:37716) 2024-03-04T08:49:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.410+0000 7fcebfe00640 1 -- 172.21.15.46:0/3988962657 learned_addr learned my addr 172.21.15.46:0/3988962657 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.412+0000 7fcebfe00640 1 -- 172.21.15.46:0/3988962657 >> v2:172.21.15.73:3300/0 conn(0x7fcec015e400 msgr2=0x7fcec00cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.412+0000 7fcebfe00640 1 --2- 172.21.15.46:0/3988962657 >> v2:172.21.15.73:3300/0 conn(0x7fcec015e400 0x7fcec00cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.413+0000 7fcebfe00640 1 -- 172.21.15.46:0/3988962657 >> v2:172.21.15.46:3300/0 conn(0x7fcec00ce1f0 msgr2=0x7fcec006c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.413+0000 7fcebfe00640 1 --2- 172.21.15.46:0/3988962657 >> v2:172.21.15.46:3300/0 conn(0x7fcec00ce1f0 0x7fcec006c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.413+0000 7fcebfe00640 1 -- 172.21.15.46:0/3988962657 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec00cf240 con 0x7fcec00cc3b0 2024-03-04T08:49:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.415+0000 7fcebfe00640 1 --2- 172.21.15.46:0/3988962657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 0x7fcec00ce720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcec00b2520 tx=0x7fceb002b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b3866255a9366f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:53.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.419+0000 7fcebea00640 1 -- 172.21.15.46:0/3988962657 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb002e070 con 0x7fcec00cc3b0 2024-03-04T08:49:53.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.419+0000 7fcebea00640 1 -- 172.21.15.46:0/3988962657 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0037070 con 0x7fcec00cc3b0 2024-03-04T08:49:53.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.419+0000 7fcebea00640 1 -- 172.21.15.46:0/3988962657 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0031a00 con 0x7fcec00cc3b0 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 -- 172.21.15.46:0/3988962657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 msgr2=0x7fcec00ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 --2- 172.21.15.46:0/3988962657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 0x7fcec00ce720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcec00b2520 tx=0x7fceb002b880 comp rx=0 tx=0).stop 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 -- 172.21.15.46:0/3988962657 shutdown_connections 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 --2- 172.21.15.46:0/3988962657 >> v2:172.21.15.46:3300/0 conn(0x7fcec00ce1f0 0x7fcec006c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 --2- 172.21.15.46:0/3988962657 >> v2:172.21.15.73:3300/0 conn(0x7fcec015e400 0x7fcec00cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 --2- 172.21.15.46:0/3988962657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00cc3b0 0x7fcec00ce720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 -- 172.21.15.46:0/3988962657 >> 172.21.15.46:0/3988962657 conn(0x7fcec00cf9a0 msgr2=0x7fcec00cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:53.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 -- 172.21.15.46:0/3988962657 shutdown_connections 2024-03-04T08:49:53.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.420+0000 7fcec5800640 1 -- 172.21.15.46:0/3988962657 wait complete. 2024-03-04T08:49:53.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.422+0000 7fcec5800640 1 Processor -- start 2024-03-04T08:49:53.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.422+0000 7fcec5800640 1 -- start start 2024-03-04T08:49:53.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.423+0000 7fcec5800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec00cc3b0 0x7fcec0159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.423+0000 7fcec5800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 0x7fcec01e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.423+0000 7fcec5800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec015e400 0x7fcec00c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.423+0000 7fcec5800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec015dc00 con 0x7fcec00cc3b0 2024-03-04T08:49:53.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.423+0000 7fcec5800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec015d920 con 0x7fcec015e400 2024-03-04T08:49:53.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.423+0000 7fcec5800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec015dee0 con 0x7fcec00ce1f0 2024-03-04T08:49:53.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.424+0000 7fcebf400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 0x7fcec01e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:53.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.424+0000 7fcec4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec015e400 0x7fcec00c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:53.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.424+0000 7fcebfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec00cc3b0 0x7fcec0159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:53.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.424+0000 7fcebf400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 0x7fcec01e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37732/0 (socket says 172.21.15.46:37732) 2024-03-04T08:49:53.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.424+0000 7fcebf400640 1 -- 172.21.15.46:0/2480837901 learned_addr learned my addr 172.21.15.46:0/2480837901 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:53.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.427+0000 7fcebf400640 1 -- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec015e400 msgr2=0x7fcec00c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.427+0000 7fcebf400640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec015e400 0x7fcec00c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.427+0000 7fcebf400640 1 -- 172.21.15.46:0/2480837901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec00cc3b0 msgr2=0x7fcec0159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.427+0000 7fcebf400640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec00cc3b0 0x7fcec0159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.427+0000 7fcebf400640 1 -- 172.21.15.46:0/2480837901 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0158e90 con 0x7fcec00ce1f0 2024-03-04T08:49:53.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.430+0000 7fcebf400640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 0x7fcec01e7140 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fceac00b410 tx=0x7fceac00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:53.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.433+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac015020 con 0x7fcec00ce1f0 2024-03-04T08:49:53.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.434+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac011850 con 0x7fcec00ce1f0 2024-03-04T08:49:53.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.434+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011c40 con 0x7fcec00ce1f0 2024-03-04T08:49:53.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.434+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec01f3d80 con 0x7fcec00ce1f0 2024-03-04T08:49:53.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.434+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec00c9c40 con 0x7fcec00ce1f0 2024-03-04T08:49:53.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.435+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec004f330 con 0x7fcec00ce1f0 2024-03-04T08:49:53.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.688+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fceac018020 con 0x7fcec00ce1f0 2024-03-04T08:49:53.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.690+0000 7fceb7e00640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcea006b550 0x7fcea006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:53.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.691+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceac08a4f0 con 0x7fcec00ce1f0 2024-03-04T08:49:53.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.691+0000 7fcebfe00640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcea006b550 0x7fcea006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.692+0000 7fcebfe00640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcea006b550 0x7fcea006da10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fceb0036000 tx=0x7fceb003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:53.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.701+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fceac01f020 con 0x7fcec00ce1f0 2024-03-04T08:49:53.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.946+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcec0158c40 con 0x7fcea006b550 2024-03-04T08:49:53.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.959+0000 7fceb7e00640 1 -- 172.21.15.46:0/2480837901 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251975 (secure 0 0 0) 0x7fcec0158c40 con 0x7fcea006b550 2024-03-04T08:49:53.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:53.963 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T08:49:53.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcea006b550 msgr2=0x7fcea006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcea006b550 0x7fcea006da10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fceb0036000 tx=0x7fceb003d040 comp rx=0 tx=0).stop 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 msgr2=0x7fcec01e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 0x7fcec01e7140 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fceac00b410 tx=0x7fceac00b8d0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 shutdown_connections 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcea006b550 0x7fcea006da10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec015e400 0x7fcec00c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcec00ce1f0 0x7fcec01e7140 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 --2- 172.21.15.46:0/2480837901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec00cc3b0 0x7fcec0159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 >> 172.21.15.46:0/2480837901 conn(0x7fcec00cf9a0 msgr2=0x7fcec0153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 shutdown_connections 2024-03-04T08:49:53.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:53.962+0000 7fcec5800640 1 -- 172.21.15.46:0/2480837901 wait complete. 2024-03-04T08:49:53.974 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-03-04T08:49:53.432162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235880,"kb_used_data":3084,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738840,"statfs":{"total":773094113280,"available":772852572160,"internally_reserved":0,"allocated":3158016,"data_stored":1856150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4488,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.867547"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281486+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T08:49:43.281486+0000","last_peered":"2024-03-04T08:49:43.281486+0000","last_clean":"2024-03-04T08:49:43.281486+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T08:49:43.281486+0000","last_undegraded":"2024-03-04T08:49:43.281486+0000","last_fullsized":"2024-03-04T08:49:43.281486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047094+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T08:49:43.047094+0000","last_peered":"2024-03-04T08:49:43.047094+0000","last_clean":"2024-03-04T08:49:43.047094+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T08:49:43.047094+0000","last_undegraded":"2024-03-04T08:49:43.047094+0000","last_fullsized":"2024-03-04T08:49:43.047094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047069+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T08:49:43.047069+0000","last_peered":"2024-03-04T08:49:43.047069+0000","last_clean":"2024-03-04T08:49:43.047069+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T08:49:43.047069+0000","last_undegraded":"2024-03-04T08:49:43.047069+0000","last_fullsized":"2024-03-04T08:49:43.047069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369960+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T08:49:42.369960+0000","last_peered":"2024-03-04T08:49:42.369960+0000","last_clean":"2024-03-04T08:49:42.369960+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T08:49:42.369960+0000","last_undegraded":"2024-03-04T08:49:42.369960+0000","last_fullsized":"2024-03-04T08:49:42.369960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280132+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T08:49:43.280132+0000","last_peered":"2024-03-04T08:49:43.280132+0000","last_clean":"2024-03-04T08:49:43.280132+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T08:49:43.280132+0000","last_undegraded":"2024-03-04T08:49:43.280132+0000","last_fullsized":"2024-03-04T08:49:43.280132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369716+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T08:49:42.369716+0000","last_peered":"2024-03-04T08:49:42.369716+0000","last_clean":"2024-03-04T08:49:42.369716+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T08:49:42.369716+0000","last_undegraded":"2024-03-04T08:49:42.369716+0000","last_fullsized":"2024-03-04T08:49:42.369716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279556+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T08:49:43.279556+0000","last_peered":"2024-03-04T08:49:43.279556+0000","last_clean":"2024-03-04T08:49:43.279556+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T08:49:43.279556+0000","last_undegraded":"2024-03-04T08:49:43.279556+0000","last_fullsized":"2024-03-04T08:49:43.279556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280535+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T08:49:43.280535+0000","last_peered":"2024-03-04T08:49:43.280535+0000","last_clean":"2024-03-04T08:49:43.280535+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T08:49:43.280535+0000","last_undegraded":"2024-03-04T08:49:43.280535+0000","last_fullsized":"2024-03-04T08:49:43.280535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281592+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T08:49:43.281592+0000","last_peered":"2024-03-04T08:49:43.281592+0000","last_clean":"2024-03-04T08:49:43.281592+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T08:49:43.281592+0000","last_undegraded":"2024-03-04T08:49:43.281592+0000","last_fullsized":"2024-03-04T08:49:43.281592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280787+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T08:49:43.280787+0000","last_peered":"2024-03-04T08:49:43.280787+0000","last_clean":"2024-03-04T08:49:43.280787+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T08:49:43.280787+0000","last_undegraded":"2024-03-04T08:49:43.280787+0000","last_fullsized":"2024-03-04T08:49:43.280787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280684+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T08:49:43.280684+0000","last_peered":"2024-03-04T08:49:43.280684+0000","last_clean":"2024-03-04T08:49:43.280684+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T08:49:43.280684+0000","last_undegraded":"2024-03-04T08:49:43.280684+0000","last_fullsized":"2024-03-04T08:49:43.280684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276060+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T08:49:43.276060+0000","last_peered":"2024-03-04T08:49:43.276060+0000","last_clean":"2024-03-04T08:49:43.276060+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T08:49:43.276060+0000","last_undegraded":"2024-03-04T08:49:43.276060+0000","last_fullsized":"2024-03-04T08:49:43.276060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276313+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T08:49:43.276313+0000","last_peered":"2024-03-04T08:49:43.276313+0000","last_clean":"2024-03-04T08:49:43.276313+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T08:49:43.276313+0000","last_undegraded":"2024-03-04T08:49:43.276313+0000","last_fullsized":"2024-03-04T08:49:43.276313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046770+0000","last_change":"2024-03-04T08:49:40.146477+0000","last_active":"2024-03-04T08:49:43.046770+0000","last_peered":"2024-03-04T08:49:43.046770+0000","last_clean":"2024-03-04T08:49:43.046770+0000","last_became_active":"2024-03-04T08:49:40.146170+0000","last_became_peered":"2024-03-04T08:49:40.146170+0000","last_unstale":"2024-03-04T08:49:43.046770+0000","last_undegraded":"2024-03-04T08:49:43.046770+0000","last_fullsized":"2024-03-04T08:49:43.046770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:53:13.937230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325117+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T08:49:42.325117+0000","last_peered":"2024-03-04T08:49:42.325117+0000","last_clean":"2024-03-04T08:49:42.325117+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T08:49:42.325117+0000","last_undegraded":"2024-03-04T08:49:42.325117+0000","last_fullsized":"2024-03-04T08:49:42.325117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325919+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T08:49:42.325919+0000","last_peered":"2024-03-04T08:49:42.325919+0000","last_clean":"2024-03-04T08:49:42.325919+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T08:49:42.325919+0000","last_undegraded":"2024-03-04T08:49:42.325919+0000","last_fullsized":"2024-03-04T08:49:42.325919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277148+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T08:49:43.277148+0000","last_peered":"2024-03-04T08:49:43.277148+0000","last_clean":"2024-03-04T08:49:43.277148+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T08:49:43.277148+0000","last_undegraded":"2024-03-04T08:49:43.277148+0000","last_fullsized":"2024-03-04T08:49:43.277148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326173+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T08:49:42.326173+0000","last_peered":"2024-03-04T08:49:42.326173+0000","last_clean":"2024-03-04T08:49:42.326173+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T08:49:42.326173+0000","last_undegraded":"2024-03-04T08:49:42.326173+0000","last_fullsized":"2024-03-04T08:49:42.326173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280559+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T08:49:43.280559+0000","last_peered":"2024-03-04T08:49:43.280559+0000","last_clean":"2024-03-04T08:49:43.280559+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T08:49:43.280559+0000","last_undegraded":"2024-03-04T08:49:43.280559+0000","last_fullsized":"2024-03-04T08:49:43.280559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276042+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T08:49:43.276042+0000","last_peered":"2024-03-04T08:49:43.276042+0000","last_clean":"2024-03-04T08:49:43.276042+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T08:49:43.276042+0000","last_undegraded":"2024-03-04T08:49:43.276042+0000","last_fullsized":"2024-03-04T08:49:43.276042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277967+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T08:49:43.277967+0000","last_peered":"2024-03-04T08:49:43.277967+0000","last_clean":"2024-03-04T08:49:43.277967+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T08:49:43.277967+0000","last_undegraded":"2024-03-04T08:49:43.277967+0000","last_fullsized":"2024-03-04T08:49:43.277967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046777+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T08:49:43.046777+0000","last_peered":"2024-03-04T08:49:43.046777+0000","last_clean":"2024-03-04T08:49:43.046777+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T08:49:43.046777+0000","last_undegraded":"2024-03-04T08:49:43.046777+0000","last_fullsized":"2024-03-04T08:49:43.046777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325115+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T08:49:42.325115+0000","last_peered":"2024-03-04T08:49:42.325115+0000","last_clean":"2024-03-04T08:49:42.325115+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T08:49:42.325115+0000","last_undegraded":"2024-03-04T08:49:42.325115+0000","last_fullsized":"2024-03-04T08:49:42.325115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047184+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T08:49:43.047184+0000","last_peered":"2024-03-04T08:49:43.047184+0000","last_clean":"2024-03-04T08:49:43.047184+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T08:49:43.047184+0000","last_undegraded":"2024-03-04T08:49:43.047184+0000","last_fullsized":"2024-03-04T08:49:43.047184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370272+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T08:49:42.370272+0000","last_peered":"2024-03-04T08:49:42.370272+0000","last_clean":"2024-03-04T08:49:42.370272+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T08:49:42.370272+0000","last_undegraded":"2024-03-04T08:49:42.370272+0000","last_fullsized":"2024-03-04T08:49:42.370272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275907+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T08:49:43.275907+0000","last_peered":"2024-03-04T08:49:43.275907+0000","last_clean":"2024-03-04T08:49:43.275907+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T08:49:43.275907+0000","last_undegraded":"2024-03-04T08:49:43.275907+0000","last_fullsized":"2024-03-04T08:49:43.275907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276346+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T08:49:43.276346+0000","last_peered":"2024-03-04T08:49:43.276346+0000","last_clean":"2024-03-04T08:49:43.276346+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T08:49:43.276346+0000","last_undegraded":"2024-03-04T08:49:43.276346+0000","last_fullsized":"2024-03-04T08:49:43.276346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046951+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T08:49:43.046951+0000","last_peered":"2024-03-04T08:49:43.046951+0000","last_clean":"2024-03-04T08:49:43.046951+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T08:49:43.046951+0000","last_undegraded":"2024-03-04T08:49:43.046951+0000","last_fullsized":"2024-03-04T08:49:43.046951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325310+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T08:49:42.325310+0000","last_peered":"2024-03-04T08:49:42.325310+0000","last_clean":"2024-03-04T08:49:42.325310+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T08:49:42.325310+0000","last_undegraded":"2024-03-04T08:49:42.325310+0000","last_fullsized":"2024-03-04T08:49:42.325310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276935+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T08:49:43.276935+0000","last_peered":"2024-03-04T08:49:43.276935+0000","last_clean":"2024-03-04T08:49:43.276935+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T08:49:43.276935+0000","last_undegraded":"2024-03-04T08:49:43.276935+0000","last_fullsized":"2024-03-04T08:49:43.276935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369643+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T08:49:42.369643+0000","last_peered":"2024-03-04T08:49:42.369643+0000","last_clean":"2024-03-04T08:49:42.369643+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T08:49:42.369643+0000","last_undegraded":"2024-03-04T08:49:42.369643+0000","last_fullsized":"2024-03-04T08:49:42.369643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278146+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T08:49:43.278146+0000","last_peered":"2024-03-04T08:49:43.278146+0000","last_clean":"2024-03-04T08:49:43.278146+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T08:49:43.278146+0000","last_undegraded":"2024-03-04T08:49:43.278146+0000","last_fullsized":"2024-03-04T08:49:43.278146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.407135+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T08:49:49.407135+0000","last_peered":"2024-03-04T08:49:49.407135+0000","last_clean":"2024-03-04T08:49:49.407135+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T08:49:49.407135+0000","last_undegraded":"2024-03-04T08:49:49.407135+0000","last_fullsized":"2024-03-04T08:49:49.407135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276098+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T08:49:43.276098+0000","last_peered":"2024-03-04T08:49:43.276098+0000","last_clean":"2024-03-04T08:49:43.276098+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T08:49:43.276098+0000","last_undegraded":"2024-03-04T08:49:43.276098+0000","last_fullsized":"2024-03-04T08:49:43.276098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325413+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T08:49:42.325413+0000","last_peered":"2024-03-04T08:49:42.325413+0000","last_clean":"2024-03-04T08:49:42.325413+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T08:49:42.325413+0000","last_undegraded":"2024-03-04T08:49:42.325413+0000","last_fullsized":"2024-03-04T08:49:42.325413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.916638+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T08:49:51.916638+0000","last_peered":"2024-03-04T08:49:51.916638+0000","last_clean":"2024-03-04T08:49:51.916638+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T08:49:51.916638+0000","last_undegraded":"2024-03-04T08:49:51.916638+0000","last_fullsized":"2024-03-04T08:49:51.916638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047047+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T08:49:43.047047+0000","last_peered":"2024-03-04T08:49:43.047047+0000","last_clean":"2024-03-04T08:49:43.047047+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T08:49:43.047047+0000","last_undegraded":"2024-03-04T08:49:43.047047+0000","last_fullsized":"2024-03-04T08:49:43.047047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325217+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T08:49:42.325217+0000","last_peered":"2024-03-04T08:49:42.325217+0000","last_clean":"2024-03-04T08:49:42.325217+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T08:49:42.325217+0000","last_undegraded":"2024-03-04T08:49:42.325217+0000","last_fullsized":"2024-03-04T08:49:42.325217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275934+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T08:49:43.275934+0000","last_peered":"2024-03-04T08:49:43.275934+0000","last_clean":"2024-03-04T08:49:43.275934+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T08:49:43.275934+0000","last_undegraded":"2024-03-04T08:49:43.275934+0000","last_fullsized":"2024-03-04T08:49:43.275934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280875+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T08:49:43.280875+0000","last_peered":"2024-03-04T08:49:43.280875+0000","last_clean":"2024-03-04T08:49:43.280875+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T08:49:43.280875+0000","last_undegraded":"2024-03-04T08:49:43.280875+0000","last_fullsized":"2024-03-04T08:49:43.280875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370223+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T08:49:42.370223+0000","last_peered":"2024-03-04T08:49:42.370223+0000","last_clean":"2024-03-04T08:49:42.370223+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T08:49:42.370223+0000","last_undegraded":"2024-03-04T08:49:42.370223+0000","last_fullsized":"2024-03-04T08:49:42.370223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281584+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T08:49:43.281584+0000","last_peered":"2024-03-04T08:49:43.281584+0000","last_clean":"2024-03-04T08:49:43.281584+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T08:49:43.281584+0000","last_undegraded":"2024-03-04T08:49:43.281584+0000","last_fullsized":"2024-03-04T08:49:43.281584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047304+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T08:49:43.047304+0000","last_peered":"2024-03-04T08:49:43.047304+0000","last_clean":"2024-03-04T08:49:43.047304+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T08:49:43.047304+0000","last_undegraded":"2024-03-04T08:49:43.047304+0000","last_fullsized":"2024-03-04T08:49:43.047304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.367835+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T08:49:43.367835+0000","last_peered":"2024-03-04T08:49:43.367835+0000","last_clean":"2024-03-04T08:49:43.367835+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T08:49:43.367835+0000","last_undegraded":"2024-03-04T08:49:43.367835+0000","last_fullsized":"2024-03-04T08:49:43.367835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325558+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T08:49:42.325558+0000","last_peered":"2024-03-04T08:49:42.325558+0000","last_clean":"2024-03-04T08:49:42.325558+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T08:49:42.325558+0000","last_undegraded":"2024-03-04T08:49:42.325558+0000","last_fullsized":"2024-03-04T08:49:42.325558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.386510+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T08:49:43.386510+0000","last_peered":"2024-03-04T08:49:43.386510+0000","last_clean":"2024-03-04T08:49:43.386510+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T08:49:43.386510+0000","last_undegraded":"2024-03-04T08:49:43.386510+0000","last_fullsized":"2024-03-04T08:49:43.386510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281324+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T08:49:43.281324+0000","last_peered":"2024-03-04T08:49:43.281324+0000","last_clean":"2024-03-04T08:49:43.281324+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T08:49:43.281324+0000","last_undegraded":"2024-03-04T08:49:43.281324+0000","last_fullsized":"2024-03-04T08:49:43.281324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.866328+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T08:49:51.866328+0000","last_peered":"2024-03-04T08:49:51.866328+0000","last_clean":"2024-03-04T08:49:51.866328+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T08:49:51.866328+0000","last_undegraded":"2024-03-04T08:49:51.866328+0000","last_fullsized":"2024-03-04T08:49:51.866328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276382+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T08:49:43.276382+0000","last_peered":"2024-03-04T08:49:43.276382+0000","last_clean":"2024-03-04T08:49:43.276382+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T08:49:43.276382+0000","last_undegraded":"2024-03-04T08:49:43.276382+0000","last_fullsized":"2024-03-04T08:49:43.276382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325598+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T08:49:42.325598+0000","last_peered":"2024-03-04T08:49:42.325598+0000","last_clean":"2024-03-04T08:49:42.325598+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T08:49:42.325598+0000","last_undegraded":"2024-03-04T08:49:42.325598+0000","last_fullsized":"2024-03-04T08:49:42.325598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325413+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T08:49:42.325413+0000","last_peered":"2024-03-04T08:49:42.325413+0000","last_clean":"2024-03-04T08:49:42.325413+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T08:49:42.325413+0000","last_undegraded":"2024-03-04T08:49:42.325413+0000","last_fullsized":"2024-03-04T08:49:42.325413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279639+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T08:49:43.279639+0000","last_peered":"2024-03-04T08:49:43.279639+0000","last_clean":"2024-03-04T08:49:43.279639+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T08:49:43.279639+0000","last_undegraded":"2024-03-04T08:49:43.279639+0000","last_fullsized":"2024-03-04T08:49:43.279639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277684+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T08:49:43.277684+0000","last_peered":"2024-03-04T08:49:43.277684+0000","last_clean":"2024-03-04T08:49:43.277684+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T08:49:43.277684+0000","last_undegraded":"2024-03-04T08:49:43.277684+0000","last_fullsized":"2024-03-04T08:49:43.277684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'15","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.866662+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T08:49:51.866662+0000","last_peered":"2024-03-04T08:49:51.866662+0000","last_clean":"2024-03-04T08:49:51.866662+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T08:49:51.866662+0000","last_undegraded":"2024-03-04T08:49:51.866662+0000","last_fullsized":"2024-03-04T08:49:51.866662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325325+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T08:49:42.325325+0000","last_peered":"2024-03-04T08:49:42.325325+0000","last_clean":"2024-03-04T08:49:42.325325+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T08:49:42.325325+0000","last_undegraded":"2024-03-04T08:49:42.325325+0000","last_fullsized":"2024-03-04T08:49:42.325325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281803+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T08:49:43.281803+0000","last_peered":"2024-03-04T08:49:43.281803+0000","last_clean":"2024-03-04T08:49:43.281803+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T08:49:43.281803+0000","last_undegraded":"2024-03-04T08:49:43.281803+0000","last_fullsized":"2024-03-04T08:49:43.281803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370359+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T08:49:42.370359+0000","last_peered":"2024-03-04T08:49:42.370359+0000","last_clean":"2024-03-04T08:49:42.370359+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T08:49:42.370359+0000","last_undegraded":"2024-03-04T08:49:42.370359+0000","last_fullsized":"2024-03-04T08:49:42.370359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.409698+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T08:49:43.409698+0000","last_peered":"2024-03-04T08:49:43.409698+0000","last_clean":"2024-03-04T08:49:43.409698+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T08:49:43.409698+0000","last_undegraded":"2024-03-04T08:49:43.409698+0000","last_fullsized":"2024-03-04T08:49:43.409698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281668+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T08:49:43.281668+0000","last_peered":"2024-03-04T08:49:43.281668+0000","last_clean":"2024-03-04T08:49:43.281668+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T08:49:43.281668+0000","last_undegraded":"2024-03-04T08:49:43.281668+0000","last_fullsized":"2024-03-04T08:49:43.281668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047046+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T08:49:43.047046+0000","last_peered":"2024-03-04T08:49:43.047046+0000","last_clean":"2024-03-04T08:49:43.047046+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T08:49:43.047046+0000","last_undegraded":"2024-03-04T08:49:43.047046+0000","last_fullsized":"2024-03-04T08:49:43.047046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280764+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T08:49:43.280764+0000","last_peered":"2024-03-04T08:49:43.280764+0000","last_clean":"2024-03-04T08:49:43.280764+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T08:49:43.280764+0000","last_undegraded":"2024-03-04T08:49:43.280764+0000","last_fullsized":"2024-03-04T08:49:43.280764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.917389+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T08:49:51.917389+0000","last_peered":"2024-03-04T08:49:51.917389+0000","last_clean":"2024-03-04T08:49:51.917389+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T08:49:51.917389+0000","last_undegraded":"2024-03-04T08:49:51.917389+0000","last_fullsized":"2024-03-04T08:49:51.917389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325992+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T08:49:42.325992+0000","last_peered":"2024-03-04T08:49:42.325992+0000","last_clean":"2024-03-04T08:49:42.325992+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T08:49:42.325992+0000","last_undegraded":"2024-03-04T08:49:42.325992+0000","last_fullsized":"2024-03-04T08:49:42.325992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277565+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T08:49:43.277565+0000","last_peered":"2024-03-04T08:49:43.277565+0000","last_clean":"2024-03-04T08:49:43.277565+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T08:49:43.277565+0000","last_undegraded":"2024-03-04T08:49:43.277565+0000","last_fullsized":"2024-03-04T08:49:43.277565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326001+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T08:49:42.326001+0000","last_peered":"2024-03-04T08:49:42.326001+0000","last_clean":"2024-03-04T08:49:42.326001+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T08:49:42.326001+0000","last_undegraded":"2024-03-04T08:49:42.326001+0000","last_fullsized":"2024-03-04T08:49:42.326001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276209+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T08:49:43.276209+0000","last_peered":"2024-03-04T08:49:43.276209+0000","last_clean":"2024-03-04T08:49:43.276209+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T08:49:43.276209+0000","last_undegraded":"2024-03-04T08:49:43.276209+0000","last_fullsized":"2024-03-04T08:49:43.276209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325220+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T08:49:42.325220+0000","last_peered":"2024-03-04T08:49:42.325220+0000","last_clean":"2024-03-04T08:49:42.325220+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T08:49:42.325220+0000","last_undegraded":"2024-03-04T08:49:42.325220+0000","last_fullsized":"2024-03-04T08:49:42.325220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275709+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T08:49:43.275709+0000","last_peered":"2024-03-04T08:49:43.275709+0000","last_clean":"2024-03-04T08:49:43.275709+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T08:49:43.275709+0000","last_undegraded":"2024-03-04T08:49:43.275709+0000","last_fullsized":"2024-03-04T08:49:43.275709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.866871+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T08:49:51.866871+0000","last_peered":"2024-03-04T08:49:51.866871+0000","last_clean":"2024-03-04T08:49:51.866871+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T08:49:51.866871+0000","last_undegraded":"2024-03-04T08:49:51.866871+0000","last_fullsized":"2024-03-04T08:49:51.866871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325800+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T08:49:42.325800+0000","last_peered":"2024-03-04T08:49:42.325800+0000","last_clean":"2024-03-04T08:49:42.325800+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T08:49:42.325800+0000","last_undegraded":"2024-03-04T08:49:42.325800+0000","last_fullsized":"2024-03-04T08:49:42.325800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279927+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T08:49:43.279927+0000","last_peered":"2024-03-04T08:49:43.279927+0000","last_clean":"2024-03-04T08:49:43.279927+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T08:49:43.279927+0000","last_undegraded":"2024-03-04T08:49:43.279927+0000","last_fullsized":"2024-03-04T08:49:43.279927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047009+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T08:49:43.047009+0000","last_peered":"2024-03-04T08:49:43.047009+0000","last_clean":"2024-03-04T08:49:43.047009+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T08:49:43.047009+0000","last_undegraded":"2024-03-04T08:49:43.047009+0000","last_fullsized":"2024-03-04T08:49:43.047009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369747+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T08:49:42.369747+0000","last_peered":"2024-03-04T08:49:42.369747+0000","last_clean":"2024-03-04T08:49:42.369747+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T08:49:42.369747+0000","last_undegraded":"2024-03-04T08:49:42.369747+0000","last_fullsized":"2024-03-04T08:49:42.369747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326112+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T08:49:42.326112+0000","last_peered":"2024-03-04T08:49:42.326112+0000","last_clean":"2024-03-04T08:49:42.326112+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T08:49:42.326112+0000","last_undegraded":"2024-03-04T08:49:42.326112+0000","last_fullsized":"2024-03-04T08:49:42.326112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276449+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T08:49:43.276449+0000","last_peered":"2024-03-04T08:49:43.276449+0000","last_clean":"2024-03-04T08:49:43.276449+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T08:49:43.276449+0000","last_undegraded":"2024-03-04T08:49:43.276449+0000","last_fullsized":"2024-03-04T08:49:43.276449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.861881+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T08:49:51.861881+0000","last_peered":"2024-03-04T08:49:51.861881+0000","last_clean":"2024-03-04T08:49:51.861881+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T08:49:51.861881+0000","last_undegraded":"2024-03-04T08:49:51.861881+0000","last_fullsized":"2024-03-04T08:49:51.861881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275984+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T08:49:43.275984+0000","last_peered":"2024-03-04T08:49:43.275984+0000","last_clean":"2024-03-04T08:49:43.275984+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T08:49:43.275984+0000","last_undegraded":"2024-03-04T08:49:43.275984+0000","last_fullsized":"2024-03-04T08:49:43.275984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.616085+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T08:49:43.616085+0000","last_peered":"2024-03-04T08:49:43.616085+0000","last_clean":"2024-03-04T08:49:43.616085+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T08:49:43.616085+0000","last_undegraded":"2024-03-04T08:49:43.616085+0000","last_fullsized":"2024-03-04T08:49:43.616085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276106+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T08:49:43.276106+0000","last_peered":"2024-03-04T08:49:43.276106+0000","last_clean":"2024-03-04T08:49:43.276106+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T08:49:43.276106+0000","last_undegraded":"2024-03-04T08:49:43.276106+0000","last_fullsized":"2024-03-04T08:49:43.276106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278793+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T08:49:43.278793+0000","last_peered":"2024-03-04T08:49:43.278793+0000","last_clean":"2024-03-04T08:49:43.278793+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T08:49:43.278793+0000","last_undegraded":"2024-03-04T08:49:43.278793+0000","last_fullsized":"2024-03-04T08:49:43.278793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325605+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T08:49:42.325605+0000","last_peered":"2024-03-04T08:49:42.325605+0000","last_clean":"2024-03-04T08:49:42.325605+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T08:49:42.325605+0000","last_undegraded":"2024-03-04T08:49:42.325605+0000","last_fullsized":"2024-03-04T08:49:42.325605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.204632+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T08:49:49.204632+0000","last_peered":"2024-03-04T08:49:49.204632+0000","last_clean":"2024-03-04T08:49:49.204632+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T08:49:49.204632+0000","last_undegraded":"2024-03-04T08:49:49.204632+0000","last_fullsized":"2024-03-04T08:49:49.204632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275588+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T08:49:43.275588+0000","last_peered":"2024-03-04T08:49:43.275588+0000","last_clean":"2024-03-04T08:49:43.275588+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T08:49:43.275588+0000","last_undegraded":"2024-03-04T08:49:43.275588+0000","last_fullsized":"2024-03-04T08:49:43.275588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276456+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T08:49:43.276456+0000","last_peered":"2024-03-04T08:49:43.276456+0000","last_clean":"2024-03-04T08:49:43.276456+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T08:49:43.276456+0000","last_undegraded":"2024-03-04T08:49:43.276456+0000","last_fullsized":"2024-03-04T08:49:43.276456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277053+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T08:49:43.277053+0000","last_peered":"2024-03-04T08:49:43.277053+0000","last_clean":"2024-03-04T08:49:43.277053+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T08:49:43.277053+0000","last_undegraded":"2024-03-04T08:49:43.277053+0000","last_fullsized":"2024-03-04T08:49:43.277053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.615035+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T08:49:43.615035+0000","last_peered":"2024-03-04T08:49:43.615035+0000","last_clean":"2024-03-04T08:49:43.615035+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T08:49:43.615035+0000","last_undegraded":"2024-03-04T08:49:43.615035+0000","last_fullsized":"2024-03-04T08:49:43.615035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325238+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T08:49:42.325238+0000","last_peered":"2024-03-04T08:49:42.325238+0000","last_clean":"2024-03-04T08:49:42.325238+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T08:49:42.325238+0000","last_undegraded":"2024-03-04T08:49:42.325238+0000","last_fullsized":"2024-03-04T08:49:42.325238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326038+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T08:49:42.326038+0000","last_peered":"2024-03-04T08:49:42.326038+0000","last_clean":"2024-03-04T08:49:42.326038+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T08:49:42.326038+0000","last_undegraded":"2024-03-04T08:49:42.326038+0000","last_fullsized":"2024-03-04T08:49:42.326038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.605652+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T08:49:43.605652+0000","last_peered":"2024-03-04T08:49:43.605652+0000","last_clean":"2024-03-04T08:49:43.605652+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T08:49:43.605652+0000","last_undegraded":"2024-03-04T08:49:43.605652+0000","last_fullsized":"2024-03-04T08:49:43.605652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278451+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T08:49:43.278451+0000","last_peered":"2024-03-04T08:49:43.278451+0000","last_clean":"2024-03-04T08:49:43.278451+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T08:49:43.278451+0000","last_undegraded":"2024-03-04T08:49:43.278451+0000","last_fullsized":"2024-03-04T08:49:43.278451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.603961+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T08:49:43.603961+0000","last_peered":"2024-03-04T08:49:43.603961+0000","last_clean":"2024-03-04T08:49:43.603961+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T08:49:43.603961+0000","last_undegraded":"2024-03-04T08:49:43.603961+0000","last_fullsized":"2024-03-04T08:49:43.603961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047218+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T08:49:43.047218+0000","last_peered":"2024-03-04T08:49:43.047218+0000","last_clean":"2024-03-04T08:49:43.047218+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T08:49:43.047218+0000","last_undegraded":"2024-03-04T08:49:43.047218+0000","last_fullsized":"2024-03-04T08:49:43.047218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.607240+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T08:49:43.607240+0000","last_peered":"2024-03-04T08:49:43.607240+0000","last_clean":"2024-03-04T08:49:43.607240+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T08:49:43.607240+0000","last_undegraded":"2024-03-04T08:49:43.607240+0000","last_fullsized":"2024-03-04T08:49:43.607240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047168+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T08:49:43.047168+0000","last_peered":"2024-03-04T08:49:43.047168+0000","last_clean":"2024-03-04T08:49:43.047168+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T08:49:43.047168+0000","last_undegraded":"2024-03-04T08:49:43.047168+0000","last_fullsized":"2024-03-04T08:49:43.047168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.864067+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T08:49:51.864067+0000","last_peered":"2024-03-04T08:49:51.864067+0000","last_clean":"2024-03-04T08:49:51.864067+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T08:49:51.864067+0000","last_undegraded":"2024-03-04T08:49:51.864067+0000","last_fullsized":"2024-03-04T08:49:51.864067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4488,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":8416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":84080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":85110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":831488,"data_stored":673936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":83554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":84204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":84120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":843776,"data_stored":674580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":86566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:49:53.979 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-04T08:49:53.979 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-04T08:49:53.979 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-04T08:49:53.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-04T08:49:53.980 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-04T08:49:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.208+0000 7f8e8fe00640 1 Processor -- start 2024-03-04T08:49:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.208+0000 7f8e8fe00640 1 -- start start 2024-03-04T08:49:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e900cc3b0 0x7f8e900ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e9015e400 0x7f8e900cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8fe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e900cf240 con 0x7f8e900ce1f0 2024-03-04T08:49:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8fe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e90154a00 con 0x7f8e900cc3b0 2024-03-04T08:49:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8fe00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900cf800 con 0x7f8e9015e400 2024-03-04T08:49:54.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e9015e400 0x7f8e900cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:54.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8f400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e900ce1f0 0x7f8e9006c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49626/0 (socket says 172.21.15.46:49626) 2024-03-04T08:49:54.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8f400640 1 -- 172.21.15.46:0/1496115497 learned_addr learned my addr 172.21.15.46:0/1496115497 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:54.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.210+0000 7f8e8ea00640 1 --2- 172.21.15.46:0/1496115497 >> v2:172.21.15.46:3300/0 conn(0x7f8e900cc3b0 0x7f8e900ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.213+0000 7f8e8d600640 1 -- 172.21.15.46:0/1496115497 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048294644 0 0) 0x7f8e900cf240 con 0x7f8e900ce1f0 2024-03-04T08:49:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.213+0000 7f8e8d600640 1 -- 172.21.15.46:0/1496115497 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e74003520 con 0x7f8e900ce1f0 2024-03-04T08:49:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.213+0000 7f8e8e000640 1 -- 172.21.15.46:0/1496115497 >> v2:172.21.15.46:3300/0 conn(0x7f8e900cc3b0 msgr2=0x7f8e900ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.213+0000 7f8e8e000640 1 --2- 172.21.15.46:0/1496115497 >> v2:172.21.15.46:3300/0 conn(0x7f8e900cc3b0 0x7f8e900ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.213+0000 7f8e8e000640 1 -- 172.21.15.46:0/1496115497 >> v1:172.21.15.73:6789/0 conn(0x7f8e900ce1f0 legacy=0x7f8e9006c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.213+0000 7f8e8e000640 1 -- 172.21.15.46:0/1496115497 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900cf520 con 0x7f8e9015e400 2024-03-04T08:49:54.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.215+0000 7f8e8e000640 1 --2- 172.21.15.46:0/1496115497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e9015e400 0x7f8e900cc790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097a0 tx=0x7f8e7c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e8726f3bc13171 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:54.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8d600640 1 -- 172.21.15.46:0/1496115497 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0315a0 con 0x7f8e9015e400 2024-03-04T08:49:54.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8d600640 1 -- 172.21.15.46:0/1496115497 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c037070 con 0x7f8e9015e400 2024-03-04T08:49:54.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8d600640 1 -- 172.21.15.46:0/1496115497 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c031960 con 0x7f8e9015e400 2024-03-04T08:49:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8fe00640 1 -- 172.21.15.46:0/1496115497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e9015e400 msgr2=0x7f8e900cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/1496115497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e9015e400 0x7f8e900cc790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097a0 tx=0x7f8e7c02b840 comp rx=0 tx=0).stop 2024-03-04T08:49:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8fe00640 1 -- 172.21.15.46:0/1496115497 shutdown_connections 2024-03-04T08:49:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/1496115497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e9015e400 0x7f8e900cc790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/1496115497 >> v2:172.21.15.46:3300/0 conn(0x7f8e900cc3b0 0x7f8e900ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.219+0000 7f8e8fe00640 1 -- 172.21.15.46:0/1496115497 >> 172.21.15.46:0/1496115497 conn(0x7f8e900cf9a0 msgr2=0x7f8e900cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:54.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.220+0000 7f8e8fe00640 1 -- 172.21.15.46:0/1496115497 shutdown_connections 2024-03-04T08:49:54.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.220+0000 7f8e8fe00640 1 -- 172.21.15.46:0/1496115497 wait complete. 2024-03-04T08:49:54.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.221+0000 7f8e8fe00640 1 Processor -- start 2024-03-04T08:49:54.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.221+0000 7f8e8fe00640 1 -- start start 2024-03-04T08:49:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.223+0000 7f8e8fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e900cc3b0 0x7f8e900b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.223+0000 7f8e8fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 0x7f8e9015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.223+0000 7f8e8fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e9015e400 0x7f8e9015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.223+0000 7f8e8fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9015dee0 con 0x7f8e900cc3b0 2024-03-04T08:49:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.223+0000 7f8e8fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9015dc00 con 0x7f8e9015e400 2024-03-04T08:49:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.223+0000 7f8e8fe00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900cec90 con 0x7f8e900ce1f0 2024-03-04T08:49:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.224+0000 7f8e8e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 0x7f8e9015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.224+0000 7f8e8e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 0x7f8e9015a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37742/0 (socket says 172.21.15.46:37742) 2024-03-04T08:49:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.224+0000 7f8e8e000640 1 -- 172.21.15.46:0/3951388652 learned_addr learned my addr 172.21.15.46:0/3951388652 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.225+0000 7f8e8f400640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e9015e400 0x7f8e9015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.225+0000 7f8e8ea00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e900cc3b0 0x7f8e900b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.228+0000 7f8e8e000640 1 -- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e9015e400 msgr2=0x7f8e9015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.228+0000 7f8e8e000640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e9015e400 0x7f8e9015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.228+0000 7f8e8e000640 1 -- 172.21.15.46:0/3951388652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e900cc3b0 msgr2=0x7f8e900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.228+0000 7f8e8e000640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e900cc3b0 0x7f8e900b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.228+0000 7f8e8e000640 1 -- 172.21.15.46:0/3951388652 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e901f0be0 con 0x7f8e900ce1f0 2024-03-04T08:49:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.230+0000 7f8e8e000640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 0x7f8e9015a710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0098c0 tx=0x7f8e7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.232+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c032630 con 0x7f8e900ce1f0 2024-03-04T08:49:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.232+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e90158080 con 0x7f8e900ce1f0 2024-03-04T08:49:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.232+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e90158320 con 0x7f8e900ce1f0 2024-03-04T08:49:54.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.234+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9004f330 con 0x7f8e900ce1f0 2024-03-04T08:49:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.441+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c037020 con 0x7f8e900ce1f0 2024-03-04T08:49:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.482+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c005990 con 0x7f8e900ce1f0 2024-03-04T08:49:54.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.498+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e7c0327d0 con 0x7f8e900ce1f0 2024-03-04T08:49:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.499+0000 7f8e86a00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e7006b4d0 0x7f8e7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.499+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e7c0abba0 con 0x7f8e900ce1f0 2024-03-04T08:49:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.500+0000 7f8e8ea00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e7006b4d0 0x7f8e7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.500+0000 7f8e8ea00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e7006b4d0 0x7f8e7006d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009b40 tx=0x7f8e80009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.507+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8e7c040070 con 0x7f8e900ce1f0 2024-03-04T08:49:54.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.762+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8e900c2e30 con 0x7f8e900ce1f0 2024-03-04T08:49:54.760 INFO:tasks.ceph.mds.e.smithi046.stderr:2024-03-04T08:49:54.758+0000 f5f9640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-04T08:49:54.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.914+0000 7f8e86a00640 1 -- 172.21.15.46:0/3951388652 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171784 (secure 0 0 0) 0x7f8e7c07a460 con 0x7f8e900ce1f0 2024-03-04T08:49:54.913 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:54.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e7006b4d0 msgr2=0x7f8e7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:54.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e7006b4d0 0x7f8e7006d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009b40 tx=0x7f8e80009190 comp rx=0 tx=0).stop 2024-03-04T08:49:54.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 msgr2=0x7f8e9015a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:54.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 0x7f8e9015a710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0098c0 tx=0x7f8e7c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 shutdown_connections 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8e7006b4d0 0x7f8e7006d990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e9015e400 0x7f8e9015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e900ce1f0 0x7f8e9015a710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 --2- 172.21.15.46:0/3951388652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e900cc3b0 0x7f8e900b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.919+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 >> 172.21.15.46:0/3951388652 conn(0x7f8e900cf9a0 msgr2=0x7f8e90152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.920+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 shutdown_connections 2024-03-04T08:49:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:54.920+0000 7f8e8fe00640 1 -- 172.21.15.46:0/3951388652 wait complete. 2024-03-04T08:49:54.942 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3189456460},{"type":"v1","addr":"172.21.15.73:6801","nonce":3189456460}]},"active_addr":"172.21.15.73:6801/3189456460","active_change":"2024-03-04T08:49:09.036210+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":206240126}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1936859295}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1306359741}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3557837220}]}]} 2024-03-04T08:49:54.946 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-04T08:49:54.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-04T08:49:54.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.137+0000 7f9641800640 1 Processor -- start 2024-03-04T08:49:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.138+0000 7f9641800640 1 -- start start 2024-03-04T08:49:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.139+0000 7f9641800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c0ca550 0x7f963c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.139+0000 7f9641800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f963c15db50 0x7f963c15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.139+0000 7f9641800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c06db50 con 0x7f963c154930 2024-03-04T08:49:55.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.139+0000 7f9641800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963c06cfb0 con 0x7f963c15db50 2024-03-04T08:49:55.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.139+0000 7f9641800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c06c6c0 con 0x7f963c0ca550 2024-03-04T08:49:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.190+0000 7f963b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f963c15db50 0x7f963c15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.191+0000 7f963b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f963c15db50 0x7f963c15dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43756/0 (socket says 172.21.15.46:43756) 2024-03-04T08:49:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.191+0000 7f963b400640 1 -- 172.21.15.46:0/3300951864 learned_addr learned my addr 172.21.15.46:0/3300951864 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:55.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.195+0000 7f963b400640 1 -- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c0ca550 msgr2=0x7f963c0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:55.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.195+0000 7f963b400640 1 --2- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c0ca550 0x7f963c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.195+0000 7f963b400640 1 -- 172.21.15.46:0/3300951864 >> v1:172.21.15.73:6789/0 conn(0x7f963c154930 legacy=0x7f963c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:55.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.195+0000 7f963b400640 1 -- 172.21.15.46:0/3300951864 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c154d10 con 0x7f963c15db50 2024-03-04T08:49:55.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.199+0000 7f963b400640 1 --2- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c15dfe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9634009e50 tx=0x7f963402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e2863726292c45f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:55.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.203+0000 7f9639600640 1 -- 172.21.15.46:0/3300951864 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963402ca80 con 0x7f963c15db50 2024-03-04T08:49:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.205+0000 7f9639600640 1 -- 172.21.15.46:0/3300951864 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963402cc20 con 0x7f963c15db50 2024-03-04T08:49:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.205+0000 7f9639600640 1 -- 172.21.15.46:0/3300951864 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340343f0 con 0x7f963c15db50 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 -- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 msgr2=0x7f963c15dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 --2- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c15dfe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9634009e50 tx=0x7f963402bee0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 -- 172.21.15.46:0/3300951864 shutdown_connections 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 --2- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c0ca550 0x7f963c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 --2- 172.21.15.46:0/3300951864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c15dfe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 -- 172.21.15.46:0/3300951864 >> 172.21.15.46:0/3300951864 conn(0x7f963c0b1920 msgr2=0x7f963c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 -- 172.21.15.46:0/3300951864 shutdown_connections 2024-03-04T08:49:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.206+0000 7f9641800640 1 -- 172.21.15.46:0/3300951864 wait complete. 2024-03-04T08:49:55.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.209+0000 7f9641800640 1 Processor -- start 2024-03-04T08:49:55.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.209+0000 7f9641800640 1 -- start start 2024-03-04T08:49:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f9641800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c0ca550 0x7f963c0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f9641800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c154930 0x7f963c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f9641800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c1e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f9641800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c06c960 con 0x7f963c0ca550 2024-03-04T08:49:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f9641800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0cd460 con 0x7f963c15db50 2024-03-04T08:49:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f9641800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c06cc40 con 0x7f963c154930 2024-03-04T08:49:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f963b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c1e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.211+0000 7f963a000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c154930 0x7f963c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.212+0000 7f963b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c1e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43766/0 (socket says 172.21.15.46:43766) 2024-03-04T08:49:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.212+0000 7f963b400640 1 -- 172.21.15.46:0/3617350014 learned_addr learned my addr 172.21.15.46:0/3617350014 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:55.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.217+0000 7f963b400640 1 -- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c154930 msgr2=0x7f963c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:55.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.217+0000 7f963b400640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c154930 0x7f963c0c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.217+0000 7f963b400640 1 -- 172.21.15.46:0/3617350014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c0ca550 msgr2=0x7f963c0c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:55.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.217+0000 7f963b400640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c0ca550 0x7f963c0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.217+0000 7f963b400640 1 -- 172.21.15.46:0/3617350014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c1f4290 con 0x7f963c15db50 2024-03-04T08:49:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.220+0000 7f963b400640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c1e5c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9634009e50 tx=0x7f9634004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.228+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634044020 con 0x7f963c15db50 2024-03-04T08:49:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.228+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634040690 con 0x7f963c15db50 2024-03-04T08:49:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.228+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634040a80 con 0x7f963c15db50 2024-03-04T08:49:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.228+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c1f4570 con 0x7f963c15db50 2024-03-04T08:49:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.229+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c1f4b30 con 0x7f963c15db50 2024-03-04T08:49:55.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.230+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c0731b0 con 0x7f963c15db50 2024-03-04T08:49:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.530+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9634005d10 con 0x7f963c15db50 2024-03-04T08:49:55.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.532+0000 7f9632a00640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f961c06b500 0x7f961c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:55.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.533+0000 7f963aa00640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f961c06b500 0x7f961c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:55.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.533+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9634079ec0 con 0x7f963c15db50 2024-03-04T08:49:55.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.534+0000 7f963aa00640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f961c06b500 0x7f961c06d9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f962c000f60 tx=0x7f962c0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.551+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f963c0731b0 con 0x7f963c15db50 2024-03-04T08:49:55.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.760+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f963c15e5e0 con 0x7f963c15db50 2024-03-04T08:49:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.807+0000 7f9632a00640 1 -- 172.21.15.46:0/3617350014 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f963c15e5e0 con 0x7f963c15db50 2024-03-04T08:49:55.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:55.804 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f961c06b500 msgr2=0x7f961c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f961c06b500 0x7f961c06d9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f962c000f60 tx=0x7f962c0079d0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 msgr2=0x7f963c1e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c1e5c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9634009e50 tx=0x7f9634004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 shutdown_connections 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f961c06b500 0x7f961c06d9c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963c15db50 0x7f963c1e5c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f963c154930 0x7f963c0c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 --2- 172.21.15.46:0/3617350014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c0ca550 0x7f963c0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:55.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.810+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 >> 172.21.15.46:0/3617350014 conn(0x7f963c0b1920 msgr2=0x7f963c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:55.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.811+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 shutdown_connections 2024-03-04T08:49:55.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:55.811+0000 7f9641800640 1 -- 172.21.15.46:0/3617350014 wait complete. 2024-03-04T08:49:55.832 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-04T08:49:55.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:49:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.038+0000 7fc19be00640 1 Processor -- start 2024-03-04T08:49:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.039+0000 7fc19be00640 1 -- start start 2024-03-04T08:49:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.041+0000 7fc19be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.041+0000 7fc19be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c158e20 con 0x7fc19c151f40 2024-03-04T08:49:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.041+0000 7fc19be00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c1582a0 con 0x7fc19c0c8ac0 2024-03-04T08:49:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.041+0000 7fc19be00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c15c450 con 0x7fc19c15ba80 2024-03-04T08:49:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.042+0000 7fc19b400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.042+0000 7fc19a000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc19c0c8ac0 0x7fc19c0c6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49644/0 (socket says 172.21.15.46:49644) 2024-03-04T08:49:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.042+0000 7fc19a000640 1 -- 172.21.15.46:0/3366394399 learned_addr learned my addr 172.21.15.46:0/3366394399 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:56.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.044+0000 7fc19b400640 1 -- 172.21.15.46:0/3366394399 >> v1:172.21.15.73:6789/0 conn(0x7fc19c0c8ac0 legacy=0x7fc19c0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:56.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.044+0000 7fc19b400640 1 -- 172.21.15.46:0/3366394399 >> v1:172.21.15.46:6789/0 conn(0x7fc19c151f40 legacy=0x7fc19c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:56.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.044+0000 7fc19b400640 1 -- 172.21.15.46:0/3366394399 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c158580 con 0x7fc19c15ba80 2024-03-04T08:49:56.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.047+0000 7fc19b400640 1 --2- 172.21.15.46:0/3366394399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c15bf10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc194009dc0 tx=0x7fc19402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ef110074d1edbd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.053+0000 7fc199600640 1 -- 172.21.15.46:0/3366394399 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194039070 con 0x7fc19c15ba80 2024-03-04T08:49:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.053+0000 7fc199600640 1 -- 172.21.15.46:0/3366394399 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19402ccd0 con 0x7fc19c15ba80 2024-03-04T08:49:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.053+0000 7fc199600640 1 -- 172.21.15.46:0/3366394399 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194034660 con 0x7fc19c15ba80 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.054+0000 7fc19be00640 1 -- 172.21.15.46:0/3366394399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 msgr2=0x7fc19c15bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.054+0000 7fc19be00640 1 --2- 172.21.15.46:0/3366394399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c15bf10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc194009dc0 tx=0x7fc19402bf20 comp rx=0 tx=0).stop 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.054+0000 7fc19be00640 1 -- 172.21.15.46:0/3366394399 shutdown_connections 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.054+0000 7fc19be00640 1 --2- 172.21.15.46:0/3366394399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c15bf10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.054+0000 7fc19be00640 1 -- 172.21.15.46:0/3366394399 >> 172.21.15.46:0/3366394399 conn(0x7fc19c06aff0 msgr2=0x7fc19c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.055+0000 7fc19be00640 1 -- 172.21.15.46:0/3366394399 shutdown_connections 2024-03-04T08:49:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.055+0000 7fc19be00640 1 -- 172.21.15.46:0/3366394399 wait complete. 2024-03-04T08:49:56.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.057+0000 7fc19be00640 1 Processor -- start 2024-03-04T08:49:56.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.057+0000 7fc19be00640 1 -- start start 2024-03-04T08:49:56.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.058+0000 7fc19be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc19c0c8ac0 0x7fc19c1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.058+0000 7fc19be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc19c151f40 0x7fc19c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.058+0000 7fc19be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.058+0000 7fc19be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c15b560 con 0x7fc19c0c8ac0 2024-03-04T08:49:56.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.058+0000 7fc19be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c158b40 con 0x7fc19c151f40 2024-03-04T08:49:56.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.058+0000 7fc19be00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0c7c60 con 0x7fc19c15ba80 2024-03-04T08:49:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.059+0000 7fc19b400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.059+0000 7fc19b400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c145070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37774/0 (socket says 172.21.15.46:37774) 2024-03-04T08:49:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.059+0000 7fc19b400640 1 -- 172.21.15.46:0/3059490700 learned_addr learned my addr 172.21.15.46:0/3059490700 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.059+0000 7fc19a000640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc19c151f40 0x7fc19c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.062+0000 7fc19b400640 1 -- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc19c151f40 msgr2=0x7fc19c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.062+0000 7fc19b400640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc19c151f40 0x7fc19c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.062+0000 7fc19b400640 1 -- 172.21.15.46:0/3059490700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc19c0c8ac0 msgr2=0x7fc19c1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.062+0000 7fc19b400640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc19c0c8ac0 0x7fc19c1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.062+0000 7fc19b400640 1 -- 172.21.15.46:0/3059490700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c146460 con 0x7fc19c15ba80 2024-03-04T08:49:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.065+0000 7fc19b400640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c145070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc194009ee0 tx=0x7fc194004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.069+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194044020 con 0x7fc19c15ba80 2024-03-04T08:49:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.069+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19403f470 con 0x7fc19c15ba80 2024-03-04T08:49:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.069+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194039040 con 0x7fc19c15ba80 2024-03-04T08:49:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.069+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c15ac60 con 0x7fc19c15ba80 2024-03-04T08:49:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.069+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c1efde0 con 0x7fc19c15ba80 2024-03-04T08:49:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.071+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c04f330 con 0x7fc19c15ba80 2024-03-04T08:49:56.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.331+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc194047020 con 0x7fc19c15ba80 2024-03-04T08:49:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.332+0000 7fc193400640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc17c06b550 0x7fc17c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.333+0000 7fc19aa00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc17c06b550 0x7fc17c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.333+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc194079e70 con 0x7fc19c15ba80 2024-03-04T08:49:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.334+0000 7fc19aa00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc17c06b550 0x7fc17c06da10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc18c001560 tx=0x7fc18c007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:56.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.354+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc19404e020 con 0x7fc19c15ba80 2024-03-04T08:49:56.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.559+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc19c152320 con 0x7fc19c15ba80 2024-03-04T08:49:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.598+0000 7fc193400640 1 -- 172.21.15.46:0/3059490700 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7fc19407c4d0 con 0x7fc19c15ba80 2024-03-04T08:49:56.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:49:56.595 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:49:56.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.600+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc17c06b550 msgr2=0x7fc17c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:56.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.600+0000 7fc19be00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc17c06b550 0x7fc17c06da10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc18c001560 tx=0x7fc18c007990 comp rx=0 tx=0).stop 2024-03-04T08:49:56.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.600+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 msgr2=0x7fc19c145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:56.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.600+0000 7fc19be00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c145070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc194009ee0 tx=0x7fc194004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:56.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 shutdown_connections 2024-03-04T08:49:56.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fc17c06b550 0x7fc17c06da10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc19c151f40 0x7fc19c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc19c15ba80 0x7fc19c145070 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 --2- 172.21.15.46:0/3059490700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc19c0c8ac0 0x7fc19c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 >> 172.21.15.46:0/3059490700 conn(0x7fc19c06aff0 msgr2=0x7fc19c0c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:56.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 shutdown_connections 2024-03-04T08:49:56.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.601+0000 7fc19be00640 1 -- 172.21.15.46:0/3059490700 wait complete. 2024-03-04T08:49:56.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-04T08:49:56.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-04T08:49:56.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-04T08:49:56.624 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-04T08:49:56.624 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-04T08:49:56.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-04T08:49:56.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-04T08:49:56.626 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-04T08:49:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.985+0000 7f3372e00640 1 Processor -- start 2024-03-04T08:49:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.985+0000 7f3372e00640 1 -- start start 2024-03-04T08:49:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.991+0000 7f5ea2e00640 1 Processor -- start 2024-03-04T08:49:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.991+0000 7f5ea2e00640 1 -- start start 2024-03-04T08:49:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.989+0000 7f3372e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f336c0731d0 0x7f336c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.989+0000 7f3372e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f336c0c0e80 0x7f336c0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.989+0000 7f3372e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c1590c0 con 0x7f336c0c6c80 2024-03-04T08:49:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.989+0000 7f3372e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c152810 con 0x7f336c0731d0 2024-03-04T08:49:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.989+0000 7f3372e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c0c1350 con 0x7f336c0c0e80 2024-03-04T08:49:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.993+0000 7f336b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f336c0c0e80 0x7f336c0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.993+0000 7f336b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f336c0c0e80 0x7f336c0c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43782/0 (socket says 172.21.15.46:43782) 2024-03-04T08:49:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.993+0000 7f336b400640 1 -- 172.21.15.46:0/2787229264 learned_addr learned my addr 172.21.15.46:0/2787229264 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.993+0000 7f5ea2e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5e9c0cbae0 0x7f5e9c071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.995+0000 7f336b400640 1 -- 172.21.15.46:0/2787229264 >> v2:172.21.15.46:3300/0 conn(0x7f336c0731d0 msgr2=0x7f336c158b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:49:56.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.994+0000 7f5ea1a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5e9c0cbae0 0x7f5e9c071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.994+0000 7f5ea2e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 0x7f5e9c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:56.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.995+0000 7f5ea1000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 0x7f5e9c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:56.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.996+0000 7f336b400640 1 --2- 172.21.15.46:0/2787229264 >> v2:172.21.15.46:3300/0 conn(0x7f336c0731d0 0x7f336c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:56.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.996+0000 7f336b400640 1 -- 172.21.15.46:0/2787229264 >> v1:172.21.15.46:6789/0 conn(0x7f336c0c6c80 legacy=0x7f336c0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:56.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.997+0000 7f5ea1000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 0x7f5e9c0c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37778/0 (socket says 172.21.15.46:37778) 2024-03-04T08:49:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.997+0000 7f5ea1000640 1 -- 172.21.15.46:0/3211848510 learned_addr learned my addr 172.21.15.46:0/3211848510 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.996+0000 7f336b400640 1 -- 172.21.15.46:0/2787229264 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0c1630 con 0x7f336c0c0e80 2024-03-04T08:49:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.998+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c0c6b50 con 0x7f5e9c0c7550 2024-03-04T08:49:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.998+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c8000 con 0x7f5e9c0cbae0 2024-03-04T08:49:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.998+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c82e0 con 0x7f5e9c0cbec0 2024-03-04T08:49:56.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.001+0000 7f5ea1000640 1 -- 172.21.15.46:0/3211848510 >> v2:172.21.15.46:3300/0 conn(0x7f5e9c0cbae0 msgr2=0x7f5e9c071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:56.999+0000 7f336b400640 1 --2- 172.21.15.46:0/2787229264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0c0e80 0x7f336c0c6740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3364009e50 tx=0x7f336402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9e4cef2720d492e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.003+0000 7f336aa00640 1 -- 172.21.15.46:0/2787229264 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336402cb20 con 0x7f336c0c0e80 2024-03-04T08:49:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.003+0000 7f336aa00640 1 -- 172.21.15.46:0/2787229264 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336402ccc0 con 0x7f336c0c0e80 2024-03-04T08:49:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.003+0000 7f336aa00640 1 -- 172.21.15.46:0/2787229264 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364034610 con 0x7f336c0c0e80 2024-03-04T08:49:57.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.001+0000 7f5ea1000640 1 --2- 172.21.15.46:0/3211848510 >> v2:172.21.15.46:3300/0 conn(0x7f5e9c0cbae0 0x7f5e9c071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.002+0000 7f5ea1000640 1 -- 172.21.15.46:0/3211848510 >> v1:172.21.15.46:6789/0 conn(0x7f5e9c0c7550 legacy=0x7f5e9c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.002+0000 7f5ea1000640 1 -- 172.21.15.46:0/3211848510 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0c85c0 con 0x7f5e9c0cbec0 2024-03-04T08:49:57.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.007+0000 7f3372e00640 1 -- 172.21.15.46:0/2787229264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0c0e80 msgr2=0x7f336c0c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.007+0000 7f3372e00640 1 --2- 172.21.15.46:0/2787229264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0c0e80 0x7f336c0c6740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3364009e50 tx=0x7f336402bf80 comp rx=0 tx=0).stop 2024-03-04T08:49:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.012+0000 7f3372e00640 1 -- 172.21.15.46:0/2787229264 shutdown_connections 2024-03-04T08:49:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.012+0000 7f3372e00640 1 --2- 172.21.15.46:0/2787229264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0c0e80 0x7f336c0c6740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.012+0000 7f3372e00640 1 --2- 172.21.15.46:0/2787229264 >> v2:172.21.15.46:3300/0 conn(0x7f336c0731d0 0x7f336c158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.012+0000 7f3372e00640 1 -- 172.21.15.46:0/2787229264 >> 172.21.15.46:0/2787229264 conn(0x7f336c06aff0 msgr2=0x7f336c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.014+0000 7f2402a00640 1 Processor -- start 2024-03-04T08:49:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.018+0000 7f5ea1000640 1 --2- 172.21.15.46:0/3211848510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 0x7f5e9c0c8dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009870 tx=0x7f5e8802ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422e0410ad65baf server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.014+0000 7f2402a00640 1 -- start start 2024-03-04T08:49:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.016+0000 7f2402a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbec0 0x7f23fc0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.016+0000 7f2402a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23fc0c6b80 0x7f23fc14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.020+0000 7f2401600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f23fc0cbae0 0x7f23fc156c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49650/0 (socket says 172.21.15.46:49650) 2024-03-04T08:49:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.020+0000 7f2401600640 1 -- 172.21.15.46:0/3226337294 learned_addr learned my addr 172.21.15.46:0/3226337294 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.020+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc0c3f80 con 0x7f23fc0cbae0 2024-03-04T08:49:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.021+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc0c43a0 con 0x7f23fc0c6b80 2024-03-04T08:49:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.021+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c8590 con 0x7f23fc0cbec0 2024-03-04T08:49:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.016+0000 7f3372e00640 1 -- 172.21.15.46:0/2787229264 shutdown_connections 2024-03-04T08:49:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.016+0000 7f3372e00640 1 -- 172.21.15.46:0/2787229264 wait complete. 2024-03-04T08:49:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.021+0000 7f2402000640 1 --2- 172.21.15.46:0/3226337294 >> v2:172.21.15.73:3300/0 conn(0x7f23fc0c6b80 0x7f23fc14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.019+0000 7f3372e00640 1 Processor -- start 2024-03-04T08:49:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f0013c00640 1 Processor -- start 2024-03-04T08:49:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f5e9be00640 1 -- 172.21.15.46:0/3211848510 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8802f850 con 0x7f5e9c0cbec0 2024-03-04T08:49:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f5e9be00640 1 -- 172.21.15.46:0/3211848510 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8802f9f0 con 0x7f5e9c0cbec0 2024-03-04T08:49:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f5e9be00640 1 -- 172.21.15.46:0/3211848510 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8802fe00 con 0x7f5e9c0cbec0 2024-03-04T08:49:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f3372e00640 1 -- start start 2024-03-04T08:49:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f0013c00640 1 -- start start 2024-03-04T08:49:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.022+0000 7f2400c00640 1 --2- 172.21.15.46:0/3226337294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbec0 0x7f23fc0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.023+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 msgr2=0x7f5e9c0c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.023+0000 7f5ea2e00640 1 --2- 172.21.15.46:0/3211848510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 0x7f5e9c0c8dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009870 tx=0x7f5e8802ba30 comp rx=0 tx=0).stop 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 shutdown_connections 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f5ea2e00640 1 --2- 172.21.15.46:0/3211848510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbec0 0x7f5e9c0c8dc0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009870 tx=0x7f5e8802ba30 comp rx=0 tx=0).stop 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f5ea2e00640 1 --2- 172.21.15.46:0/3211848510 >> v2:172.21.15.46:3300/0 conn(0x7f5e9c0cbae0 0x7f5e9c071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f3372e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0731d0 0x7f336c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f3372e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f336c0c0e80 0x7f336c156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f23fbe00640 1 -- 172.21.15.46:0/3226337294 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698013510 0 0) 0x7f23fc0c3f80 con 0x7f23fc0cbae0 2024-03-04T08:49:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 >> 172.21.15.46:0/3211848510 conn(0x7f5e9c06f110 msgr2=0x7f5e9c06f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f23fbe00640 1 -- 172.21.15.46:0/3226337294 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e4003520 con 0x7f23fc0cbae0 2024-03-04T08:49:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 shutdown_connections 2024-03-04T08:49:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f2400c00640 1 -- 172.21.15.46:0/3226337294 >> v2:172.21.15.73:3300/0 conn(0x7f23fc0c6b80 msgr2=0x7f23fc14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f2400c00640 1 --2- 172.21.15.46:0/3226337294 >> v2:172.21.15.73:3300/0 conn(0x7f23fc0c6b80 0x7f23fc14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f2400c00640 1 -- 172.21.15.46:0/3226337294 >> v1:172.21.15.73:6789/0 conn(0x7f23fc0cbae0 legacy=0x7f23fc156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f2400c00640 1 -- 172.21.15.46:0/3226337294 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0c70a0 con 0x7f23fc0cbec0 2024-03-04T08:49:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.025+0000 7f3372e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f336c0c6c80 0x7f336c2000c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.026+0000 7f3372e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c158660 con 0x7f336c0c0e80 2024-03-04T08:49:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.026+0000 7f3372e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c158380 con 0x7f336c0731d0 2024-03-04T08:49:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.027+0000 7f3372e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0735b0 con 0x7f336c0c6c80 2024-03-04T08:49:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.028+0000 7f336b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f336c0c0e80 0x7f336c156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.028+0000 7f336b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f336c0c0e80 0x7f336c156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47836/0 (socket says 172.21.15.46:47836) 2024-03-04T08:49:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.028+0000 7f336b400640 1 -- 172.21.15.46:0/1122088970 learned_addr learned my addr 172.21.15.46:0/1122088970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.028+0000 7f336be00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0731d0 0x7f336c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f0013c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f000c072890 0x7f000c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.029+0000 7f3370e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f336c0c6c80 0x7f336c2000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.026+0000 7f5ea2e00640 1 -- 172.21.15.46:0/3211848510 wait complete. 2024-03-04T08:49:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.029+0000 7f5ea2e00640 1 Processor -- start 2024-03-04T08:49:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f0013c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0733d0 con 0x7f000c158c00 2024-03-04T08:49:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.029+0000 7f5ea2e00640 1 -- start start 2024-03-04T08:49:57.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f0013c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c15ea40 con 0x7f000c0c7710 2024-03-04T08:49:57.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.024+0000 7f0013c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c15f800 con 0x7f000c072890 2024-03-04T08:49:57.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.031+0000 7f5ea2e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e9c0c7550 0x7f5e9c14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.031+0000 7f5ea2e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbae0 0x7f5e9c15e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.031+0000 7f5ea2e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c15ee50 0x7f5e9c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.031+0000 7f5ea2e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c6900 con 0x7f5e9c15ee50 2024-03-04T08:49:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.031+0000 7f5ea2e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c6780 con 0x7f5e9c0c7550 2024-03-04T08:49:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.031+0000 7f5ea2e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c158c60 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.032+0000 7f2400c00640 1 --2- 172.21.15.46:0/3226337294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbec0 0x7f23fc0c8a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d90 tx=0x7f23f402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ca253a257e7e2d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.033+0000 7f5ea1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e9c0c7550 0x7f5e9c14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f3370e00640 1 -- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0731d0 msgr2=0x7f336c153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f5ea1000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbae0 0x7f5e9c15e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f0011200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f000c158c00 0x7f000c161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50160/0 (socket says 172.21.15.46:50160) 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f0011200640 1 -- 172.21.15.46:0/666299710 learned_addr learned my addr 172.21.15.46:0/666299710 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f3370e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f336c0731d0 0x7f336c153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f3370e00640 1 -- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f336c0c0e80 msgr2=0x7f336c156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f3370e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f336c0c0e80 0x7f336c156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.036+0000 7f3370e00640 1 -- 172.21.15.46:0/1122088970 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c153ff0 con 0x7f336c0c6c80 2024-03-04T08:49:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.037+0000 7f0011c00640 1 --2- 172.21.15.46:0/666299710 >> v2:172.21.15.73:3300/0 conn(0x7f000c072890 0x7f000c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.037+0000 7f5ea1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e9c0c7550 0x7f5e9c14efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43822/0 (socket says 172.21.15.46:43822) 2024-03-04T08:49:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.038+0000 7f5ea1a00640 1 -- 172.21.15.46:0/323201111 learned_addr learned my addr 172.21.15.46:0/323201111 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.039+0000 7f0fa0a00640 1 Processor -- start 2024-03-04T08:49:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.040+0000 7f0fa0a00640 1 -- start start 2024-03-04T08:49:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.041+0000 7f5ea2400640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c15ee50 0x7f5e9c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.042+0000 7fa5c7400640 1 Processor -- start 2024-03-04T08:49:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.042+0000 7f0fa0a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f9c15e320 0x7f0f9c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.042+0000 7f0fa0a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0ccf10 con 0x7f0f9c15add0 2024-03-04T08:49:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.042+0000 7f0fa0a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0cfe30 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.042+0000 7f0fa0a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c15e740 con 0x7f0f9c15e320 2024-03-04T08:49:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.043+0000 7fa5c7400640 1 -- start start 2024-03-04T08:49:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.044+0000 7f000b400640 1 -- 172.21.15.46:0/666299710 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882511194 0 0) 0x7f000c0733d0 con 0x7f000c158c00 2024-03-04T08:49:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.044+0000 7f000b400640 1 -- 172.21.15.46:0/666299710 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003520 con 0x7f000c158c00 2024-03-04T08:49:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.044+0000 7fa5c7400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c0154750 0x7fa5c00cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.044+0000 7fa5c7400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00ca6d0 con 0x7fa5c00cc700 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.044+0000 7fa5c7400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00ca990 con 0x7fa5c0154b30 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.044+0000 7fa5c7400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00cac70 con 0x7fa5c0154750 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.045+0000 7f5ea1000640 1 -- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e9c0c7550 msgr2=0x7f5e9c14efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.045+0000 7f5ea1000640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e9c0c7550 0x7f5e9c14efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.045+0000 7f5ea1000640 1 -- 172.21.15.46:0/323201111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c15ee50 msgr2=0x7f5e9c1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.045+0000 7f5ea1000640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c15ee50 0x7f5e9c1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.045+0000 7f5ea1000640 1 -- 172.21.15.46:0/323201111 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c15ad70 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.047+0000 7f0011c00640 1 -- 172.21.15.46:0/666299710 >> v1:172.21.15.73:6789/0 conn(0x7f000c0c7710 legacy=0x7f000c0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.047+0000 7f0011c00640 1 -- 172.21.15.46:0/666299710 >> v1:172.21.15.46:6789/0 conn(0x7f000c158c00 legacy=0x7f000c161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.047+0000 7f0011c00640 1 -- 172.21.15.46:0/666299710 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c15ed20 con 0x7f000c072890 2024-03-04T08:49:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.047+0000 7f23fbe00640 1 -- 172.21.15.46:0/3226337294 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4039070 con 0x7f23fc0cbec0 2024-03-04T08:49:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.047+0000 7f23fbe00640 1 -- 172.21.15.46:0/3226337294 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f402cc60 con 0x7f23fc0cbec0 2024-03-04T08:49:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.047+0000 7f23fbe00640 1 -- 172.21.15.46:0/3226337294 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4034660 con 0x7f23fc0cbec0 2024-03-04T08:49:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.048+0000 7f3370e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f336c0c6c80 0x7f336c2000c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f335c00c440 tx=0x7f335c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.048+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbec0 msgr2=0x7f23fc0c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.048+0000 7f2402a00640 1 --2- 172.21.15.46:0/3226337294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbec0 0x7f23fc0c8a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d90 tx=0x7f23f402beb0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.049+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 shutdown_connections 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.049+0000 7f2402a00640 1 --2- 172.21.15.46:0/3226337294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbec0 0x7f23fc0c8a20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.049+0000 7f2402a00640 1 --2- 172.21.15.46:0/3226337294 >> v2:172.21.15.73:3300/0 conn(0x7f23fc0c6b80 0x7f23fc14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.049+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 >> 172.21.15.46:0/3226337294 conn(0x7f23fc06f110 msgr2=0x7f23fc06f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.049+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 shutdown_connections 2024-03-04T08:49:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.050+0000 7f5ea1000640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbae0 0x7f5e9c15e640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0c8460 tx=0x7f5e88004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.049+0000 7f2402a00640 1 -- 172.21.15.46:0/3226337294 wait complete. 2024-03-04T08:49:57.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.051+0000 7f2402a00640 1 Processor -- start 2024-03-04T08:49:57.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.052+0000 7f2402a00640 1 -- start start 2024-03-04T08:49:57.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.052+0000 7f0011c00640 1 --2- 172.21.15.46:0/666299710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c072cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efffc0097a0 tx=0x7efffc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3219d08b312e1fde server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.054+0000 7f2402a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23fc0c6b80 0x7f23fc1ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.054+0000 7f2402a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbae0 0x7f23fc1ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.054+0000 7f2402a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23fc0cbec0 0x7f23fc1ec530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.054+0000 7f2402a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c7f40 con 0x7f23fc0cbec0 2024-03-04T08:49:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.054+0000 7f2402a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c7c60 con 0x7f23fc0c6b80 2024-03-04T08:49:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.055+0000 7f2402a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c8220 con 0x7f23fc0cbae0 2024-03-04T08:49:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.053+0000 7f0f9a800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0f9c15add0 0x7f0f9c0cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50172/0 (socket says 172.21.15.46:50172) 2024-03-04T08:49:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.053+0000 7f0f9a800640 1 -- 172.21.15.46:0/575720988 learned_addr learned my addr 172.21.15.46:0/575720988 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.055+0000 7fa5c4a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c0154750 0x7fa5c00cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.055+0000 7fa5c4a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c0154750 0x7fa5c00cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43834/0 (socket says 172.21.15.46:43834) 2024-03-04T08:49:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.055+0000 7fa5c4a00640 1 -- 172.21.15.46:0/1137858824 learned_addr learned my addr 172.21.15.46:0/1137858824 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.056+0000 7f0f91e00640 1 --2- 172.21.15.46:0/575720988 >> v2:172.21.15.46:3300/0 conn(0x7f0f9c15e320 0x7f0f9c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.057+0000 7efe02600640 1 Processor -- start 2024-03-04T08:49:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.057+0000 7efe02600640 1 -- start start 2024-03-04T08:49:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.058+0000 7f2400c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbae0 0x7f23fc1ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.058+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88037d10 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.058+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88046070 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.058+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88041640 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.059+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c1f4260 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.059+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c151e90 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.059+0000 7f2400c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbae0 0x7f23fc1ebff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37806/0 (socket says 172.21.15.46:37806) 2024-03-04T08:49:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.059+0000 7f2400c00640 1 -- 172.21.15.46:0/2396783017 learned_addr learned my addr 172.21.15.46:0/2396783017 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.060+0000 7f2402000640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23fc0cbec0 0x7f23fc1ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.060+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e9c152ab0 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.060+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c017070 con 0x7f336c0c6c80 2024-03-04T08:49:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.060+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0035f0 con 0x7f336c0c6c80 2024-03-04T08:49:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7fb343400640 1 Processor -- start 2024-03-04T08:49:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.060+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c0039e0 con 0x7f336c0c6c80 2024-03-04T08:49:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7efe02600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 0x7efdfc0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7efe02600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0ca6d0 con 0x7efdfc154b30 2024-03-04T08:49:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7efe02600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0ca990 con 0x7efdfc154750 2024-03-04T08:49:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7efe02600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0cac70 con 0x7efdfc0cc700 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c15baf0 con 0x7f336c0c6c80 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c15aac0 con 0x7f336c0c6c80 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.062+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f336c15be90 con 0x7f336c0c6c80 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.061+0000 7fb343400640 1 -- start start 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.062+0000 7fb343400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c154750 0x7fb33c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.062+0000 7fb343400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0ca6d0 con 0x7fb33c154b30 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.062+0000 7fb343400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0ca990 con 0x7fb33c0cc700 2024-03-04T08:49:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.062+0000 7fb343400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0cac70 con 0x7fb33c154750 2024-03-04T08:49:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.066+0000 7fa5bf400640 1 -- 172.21.15.46:0/1137858824 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961575384 0 0) 0x7fa5c00ca6d0 con 0x7fa5c00cc700 2024-03-04T08:49:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.066+0000 7fa5bf400640 1 -- 172.21.15.46:0/1137858824 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a8003520 con 0x7fa5c00cc700 2024-03-04T08:49:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.066+0000 7f0f99e00640 1 -- 172.21.15.46:0/575720988 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006961359 0 0) 0x7f0f9c0ccf10 con 0x7f0f9c15add0 2024-03-04T08:49:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.066+0000 7f0f99e00640 1 -- 172.21.15.46:0/575720988 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f80003520 con 0x7f0f9c15add0 2024-03-04T08:49:57.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.071+0000 7efdfaa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efdfc154b30 0x7efdfc0ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50194/0 (socket says 172.21.15.46:50194) 2024-03-04T08:49:57.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.071+0000 7efdfaa00640 1 -- 172.21.15.46:0/4154505316 learned_addr learned my addr 172.21.15.46:0/4154505316 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.073+0000 7fb33be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb33c154b30 0x7fb33c0ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50202/0 (socket says 172.21.15.46:50202) 2024-03-04T08:49:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.073+0000 7fb33be00640 1 -- 172.21.15.46:0/2955250215 learned_addr learned my addr 172.21.15.46:0/2955250215 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.076+0000 7f0f91e00640 1 -- 172.21.15.46:0/575720988 >> v1:172.21.15.73:6789/0 conn(0x7f0f9c0cedc0 legacy=0x7f0f9c164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.076+0000 7f0f91e00640 1 -- 172.21.15.46:0/575720988 >> v1:172.21.15.46:6789/0 conn(0x7f0f9c15add0 legacy=0x7f0f9c0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.076+0000 7f0f91e00640 1 -- 172.21.15.46:0/575720988 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0d0110 con 0x7f0f9c15e320 2024-03-04T08:49:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.078+0000 7f2400c00640 1 -- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23fc0c6b80 msgr2=0x7f23fc1ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.078+0000 7f2400c00640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23fc0c6b80 0x7f23fc1ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.078+0000 7f2400c00640 1 -- 172.21.15.46:0/2396783017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23fc0cbec0 msgr2=0x7f23fc1ec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.078+0000 7f2400c00640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23fc0cbec0 0x7f23fc1ec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.078+0000 7f2400c00640 1 -- 172.21.15.46:0/2396783017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc148940 con 0x7f23fc0cbae0 2024-03-04T08:49:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.079+0000 7fa5c4a00640 1 -- 172.21.15.46:0/1137858824 >> v1:172.21.15.73:6789/0 conn(0x7fa5c0154b30 legacy=0x7fa5c00ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.079+0000 7fa5c4a00640 1 -- 172.21.15.46:0/1137858824 >> v1:172.21.15.46:6789/0 conn(0x7fa5c00cc700 legacy=0x7fa5c0164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.079+0000 7fa5c4a00640 1 -- 172.21.15.46:0/1137858824 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c015a900 con 0x7fa5c0154750 2024-03-04T08:49:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.084+0000 7f0f91e00640 1 --2- 172.21.15.46:0/575720988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c15e320 0x7f0f9c15a2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097a0 tx=0x7f0f8c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f9548bfe58f81 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.084+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781806620 0 0) 0x7efdfc0ca6d0 con 0x7efdfc154b30 2024-03-04T08:49:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.084+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde0003520 con 0x7efdfc154b30 2024-03-04T08:49:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.085+0000 7fa5c4a00640 1 --2- 172.21.15.46:0/1137858824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00cea90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009870 tx=0x7fa5b402ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=461498634bf00419 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.086+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291726374 0 0) 0x7fb33c0ca6d0 con 0x7fb33c154b30 2024-03-04T08:49:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.086+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb324003520 con 0x7fb33c154b30 2024-03-04T08:49:57.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.087+0000 7f000b400640 1 -- 172.21.15.46:0/666299710 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc034070 con 0x7f000c072890 2024-03-04T08:49:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.087+0000 7f000b400640 1 -- 172.21.15.46:0/666299710 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc030610 con 0x7f000c072890 2024-03-04T08:49:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.087+0000 7f000b400640 1 -- 172.21.15.46:0/666299710 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0309e0 con 0x7f000c072890 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.088+0000 7f0013c00640 1 -- 172.21.15.46:0/666299710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 msgr2=0x7f000c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.088+0000 7f0013c00640 1 --2- 172.21.15.46:0/666299710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c072cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efffc0097a0 tx=0x7efffc02b960 comp rx=0 tx=0).stop 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.089+0000 7f0013c00640 1 -- 172.21.15.46:0/666299710 shutdown_connections 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.089+0000 7f0013c00640 1 --2- 172.21.15.46:0/666299710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c072cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.089+0000 7f0013c00640 1 -- 172.21.15.46:0/666299710 >> 172.21.15.46:0/666299710 conn(0x7f000c06aff0 msgr2=0x7f000c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.089+0000 7f0013c00640 1 -- 172.21.15.46:0/666299710 shutdown_connections 2024-03-04T08:49:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.089+0000 7f0013c00640 1 -- 172.21.15.46:0/666299710 wait complete. 2024-03-04T08:49:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.091+0000 7f0013c00640 1 Processor -- start 2024-03-04T08:49:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.092+0000 7f0013c00640 1 -- start start 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.093+0000 7f0013c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.093+0000 7f0013c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f000c0c7710 0x7f000c1f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.093+0000 7f0013c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f000c158c00 0x7f000c1f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.093+0000 7f0013c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c158fe0 con 0x7f000c0c7710 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.093+0000 7f0013c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c15f370 con 0x7f000c072890 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.093+0000 7f0013c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c162530 con 0x7f000c158c00 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.094+0000 7fa5bf400640 1 -- 172.21.15.46:0/1137858824 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b402f870 con 0x7fa5c0154750 2024-03-04T08:49:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.094+0000 7fa5bf400640 1 -- 172.21.15.46:0/1137858824 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b402fa10 con 0x7fa5c0154750 2024-03-04T08:49:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.094+0000 7fa5bf400640 1 -- 172.21.15.46:0/1137858824 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b402fe20 con 0x7fa5c0154750 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.095+0000 7fa5c7400640 1 -- 172.21.15.46:0/1137858824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 msgr2=0x7fa5c00cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.095+0000 7fa5c7400640 1 --2- 172.21.15.46:0/1137858824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00cea90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009870 tx=0x7fa5b402ba50 comp rx=0 tx=0).stop 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.095+0000 7fa5c7400640 1 -- 172.21.15.46:0/1137858824 shutdown_connections 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.095+0000 7fa5c7400640 1 --2- 172.21.15.46:0/1137858824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00cea90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.096+0000 7fa5c7400640 1 -- 172.21.15.46:0/1137858824 >> 172.21.15.46:0/1137858824 conn(0x7fa5c0066c40 msgr2=0x7fa5c0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.096+0000 7fa5c7400640 1 -- 172.21.15.46:0/1137858824 shutdown_connections 2024-03-04T08:49:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.096+0000 7fa5c7400640 1 -- 172.21.15.46:0/1137858824 wait complete. 2024-03-04T08:49:57.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.097+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e88040070 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.097+0000 7f0011200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.098+0000 7fa5c7400640 1 Processor -- start 2024-03-04T08:49:57.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.098+0000 7f5e99600640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e7c06b520 0x7f5e7c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.098+0000 7f5ea1a00640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e7c06b520 0x7f5e7c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.098+0000 7fa5c7400640 1 -- start start 2024-03-04T08:49:57.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7f5ea1a00640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e7c06b520 0x7f5e7c06d9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e90006fd0 tx=0x7f5e90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7fa5c7400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5c00cc700 0x7fa5c01506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7fa5c7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7fa5c7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5c00b2340 0x7fa5c00b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7fa5c7400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00ce820 con 0x7fa5c00b2340 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7f0011200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c1511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43856/0 (socket says 172.21.15.46:43856) 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7f0011200640 1 -- 172.21.15.46:0/3310982911 learned_addr learned my addr 172.21.15.46:0/3310982911 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7fa5c7400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c015aec0 con 0x7fa5c0154750 2024-03-04T08:49:57.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.099+0000 7fa5c7400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c015a5b0 con 0x7fa5c00cc700 2024-03-04T08:49:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.105+0000 7f0011200640 1 -- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f000c158c00 msgr2=0x7f000c1f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.105+0000 7f0011200640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f000c158c00 0x7f000c1f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.105+0000 7f0011200640 1 -- 172.21.15.46:0/3310982911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f000c0c7710 msgr2=0x7f000c1f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.105+0000 7f0011200640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f000c0c7710 0x7f000c1f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.105+0000 7f0011200640 1 -- 172.21.15.46:0/3310982911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c14f910 con 0x7f000c072890 2024-03-04T08:49:57.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.110+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f335c01a070 con 0x7f336c0c6c80 2024-03-04T08:49:57.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.111+0000 7f3363e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f334c06b520 0x7f334c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.111+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e88079960 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.111+0000 7f0011200640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c1511a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f000400cbc0 tx=0x7f000400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275158519 0 0) 0x7efdfc0ca990 con 0x7efdfc154750 2024-03-04T08:49:57.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdfc0ca6d0 con 0x7efdfc154750 2024-03-04T08:49:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7f336be00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f334c06b520 0x7f334c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7f5e99600640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f5e7c073720 0x7f5e7c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 --> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e7c0761f0 con 0x7f5e7c073720 2024-03-04T08:49:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7f5ea2400640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f5e7c073720 0x7f5e7c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.112+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.113+0000 7f336be00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f334c06b520 0x7f334c06d9e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f33580098e0 tx=0x7f3358009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.113+0000 7f5ea2400640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f5e7c073720 0x7f5e7c075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.113+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43860/0 (socket says 172.21.15.46:43860) 2024-03-04T08:49:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.113+0000 7fa5bfe00640 1 -- 172.21.15.46:0/3313470624 learned_addr learned my addr 172.21.15.46:0/3313470624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.114+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== osd.4 v2:172.21.15.73:6818/2665089334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5e7c0761f0 con 0x7f5e7c073720 2024-03-04T08:49:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.115+0000 7f0f99e00640 1 -- 172.21.15.46:0/575720988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c02f810 con 0x7f0f9c15e320 2024-03-04T08:49:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.116+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293939891 0 0) 0x7efde0003520 con 0x7efdfc154b30 2024-03-04T08:49:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.116+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 msgr2=0x7efdfc0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.116+0000 7efdfa000640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 0x7efdfc0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.116+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 >> v1:172.21.15.73:6789/0 conn(0x7efdfc154750 legacy=0x7efdfc0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.116+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc15a900 con 0x7efdfc154b30 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2826336207 0 0) 0x7efde8001670 con 0x7efdfc154b30 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 >> v1:172.21.15.46:6789/0 conn(0x7efdfc154b30 legacy=0x7efdfc0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 0x7efde0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efde00040d0 0x7efde0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde0004db0 0x7efde0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0cac70 con 0x7efde00040d0 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde000bc20 con 0x7efde0004db0 2024-03-04T08:49:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.119+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde000be20 con 0x7efdfc0cc700 2024-03-04T08:49:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.121+0000 7f2400c00640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbae0 0x7f23fc1ebff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d90 tx=0x7f23f4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.123+0000 7fa5bfe00640 1 -- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5c00cc700 msgr2=0x7fa5c01506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.123+0000 7fa5bfe00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5c00cc700 0x7fa5c01506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.123+0000 7fa5bfe00640 1 -- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5c00b2340 msgr2=0x7fa5c00b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.123+0000 7fa5bfe00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5c00b2340 0x7fa5c00b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.123+0000 7fa5bfe00640 1 -- 172.21.15.46:0/3313470624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c00c9d10 con 0x7fa5c0154750 2024-03-04T08:49:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.126+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f335c0564e0 con 0x7f336c0c6c80 2024-03-04T08:49:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.126+0000 7f3363e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f334c073720 0x7f334c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.126+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 --> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f334c0761f0 con 0x7f334c073720 2024-03-04T08:49:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144237746 0 0) 0x7fb33c0ca990 con 0x7fb33c0cc700 2024-03-04T08:49:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c0ca6d0 con 0x7fb33c0cc700 2024-03-04T08:49:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7f336b400640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f334c073720 0x7f334c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004017070 con 0x7f000c072890 2024-03-04T08:49:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000400ace0 con 0x7f000c072890 2024-03-04T08:49:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004012600 con 0x7f000c072890 2024-03-04T08:49:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.128+0000 7f336b400640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f334c073720 0x7f334c075b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.127+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c150100 con 0x7f000c072890 2024-03-04T08:49:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.128+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c0c9b70 con 0x7f000c072890 2024-03-04T08:49:57.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.129+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e88077b60 con 0x7f5e9c0cbae0 2024-03-04T08:49:57.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.129+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f335c0546e0 con 0x7f336c0c6c80 2024-03-04T08:49:57.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.129+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f000c0c9920 con 0x7f000c072890 2024-03-04T08:49:57.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.129+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== osd.2 v2:172.21.15.46:6817/604231528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f334c0761f0 con 0x7f334c073720 2024-03-04T08:49:57.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.130+0000 7fa5bfe00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00c8e50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00b410 tx=0x7fa5ac00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291718988 0 0) 0x7fb324003520 con 0x7fb33c154b30 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c154750 msgr2=0x7fb33c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c154750 0x7fb33c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 >> v1:172.21.15.73:6789/0 conn(0x7fb33c0cc700 legacy=0x7fb33c164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c15a900 con 0x7fb33c154b30 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2826336207 0 0) 0x7fb330001670 con 0x7fb33c154b30 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 >> v1:172.21.15.46:6789/0 conn(0x7fb33c154b30 legacy=0x7fb33c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb324003b70 0x7fb324003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb324004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb324005210 0x7fb32400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0cac70 con 0x7fb324004800 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32400c090 con 0x7fb324005210 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32400c290 con 0x7fb324003b70 2024-03-04T08:49:57.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.132+0000 7efdfaa00640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efde00040d0 0x7efde0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.136+0000 7efdfb400640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 0x7efde0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.137+0000 7f0f99e00640 1 -- 172.21.15.46:0/575720988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c02f9b0 con 0x7f0f9c15e320 2024-03-04T08:49:57.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4044020 con 0x7f23fc0cbae0 2024-03-04T08:49:57.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4035e50 con 0x7f23fc0cbae0 2024-03-04T08:49:57.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4039040 con 0x7f23fc0cbae0 2024-03-04T08:49:57.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc14a410 con 0x7f23fc0cbae0 2024-03-04T08:49:57.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc14a990 con 0x7f23fc0cbae0 2024-03-04T08:49:57.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f0fa0a00640 1 -- 172.21.15.46:0/575720988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c15e320 msgr2=0x7f0f9c15a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f0f99e00640 1 -- 172.21.15.46:0/575720988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c02fd60 con 0x7f0f9c15e320 2024-03-04T08:49:57.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f0fa0a00640 1 --2- 172.21.15.46:0/575720988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c15e320 0x7f0f9c15a2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097a0 tx=0x7f0f8c02b9f0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.138+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 --> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e9c071f50 con 0x7f5e7c073720 2024-03-04T08:49:57.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f0fa0a00640 1 -- 172.21.15.46:0/575720988 shutdown_connections 2024-03-04T08:49:57.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f0fa0a00640 1 --2- 172.21.15.46:0/575720988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c15e320 0x7f0f9c15a2d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f0fa0a00640 1 -- 172.21.15.46:0/575720988 >> 172.21.15.46:0/575720988 conn(0x7f0f9c066c40 msgr2=0x7f0f9c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f5e99600640 1 -- 172.21.15.46:0/323201111 <== osd.4 v2:172.21.15.73:6818/2665089334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e9c071f50 con 0x7f5e7c073720 2024-03-04T08:49:57.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23d8001030 con 0x7f23fc0cbae0 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f5e7c073720 msgr2=0x7f5e7c075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f5ea2e00640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f5e7c073720 0x7f5e7c075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e7c06b520 msgr2=0x7f5e7c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7f5ea2e00640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e7c06b520 0x7f5e7c06d9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e90006fd0 tx=0x7f5e90008040 comp rx=0 tx=0).stop 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbae0 msgr2=0x7f5e9c15e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7f5ea2e00640 1 --2- 172.21.15.46:0/323201111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e9c0cbae0 0x7f5e9c15e640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0c8460 tx=0x7f5e88004730 comp rx=0 tx=0).stop 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f0fa0a00640 1 -- 172.21.15.46:0/575720988 shutdown_connections 2024-03-04T08:49:57.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.139+0000 7f0fa0a00640 1 -- 172.21.15.46:0/575720988 wait complete. 2024-03-04T08:49:57.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7f5ea2400640 1 -- 172.21.15.46:0/323201111 reap_dead start 2024-03-04T08:49:57.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7efdfb400640 1 -- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde0004db0 msgr2=0x7efde0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7efdfb400640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde0004db0 0x7efde0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7efdfb400640 1 -- 172.21.15.46:0/4154505316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efde00040d0 msgr2=0x7efde0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7efdfb400640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efde00040d0 0x7efde0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.140+0000 7efdfb400640 1 -- 172.21.15.46:0/4154505316 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0003520 con 0x7efdfc0cc700 2024-03-04T08:49:57.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.141+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 shutdown_connections 2024-03-04T08:49:57.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.141+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 >> 172.21.15.46:0/323201111 conn(0x7f5e9c06f110 msgr2=0x7f5e9c0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.141+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 shutdown_connections 2024-03-04T08:49:57.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.141+0000 7f5ea2e00640 1 -- 172.21.15.46:0/323201111 wait complete. 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.142+0000 7f0fa0a00640 1 Processor -- start 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.142+0000 7f0fa0a00640 1 -- start start 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.143+0000 7f0fa0a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c0cedc0 0x7f0f9c0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.143+0000 7f0fa0a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f9c15add0 0x7f0f9c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.144+0000 7f0fa0a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f9c15e320 0x7f0f9c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.144+0000 7f0fa0a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c15d840 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.144+0000 7f0fa0a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c15de90 con 0x7f0f9c15add0 2024-03-04T08:49:57.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.144+0000 7f0fa0a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c15db20 con 0x7f0f9c15e320 2024-03-04T08:49:57.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.144+0000 7fb340a00640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb324003b70 0x7fb324003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.145+0000 7efdfb400640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 0x7efde0003b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdec0018d0 tx=0x7efde0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2821f5537a5b511a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.149+0000 7f0f9b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f9c15e320 0x7f0f9c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.149+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0014f0 con 0x7efdfc0cc700 2024-03-04T08:49:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.150+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec0052d0 con 0x7efdfc0cc700 2024-03-04T08:49:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.150+0000 7efdfa000640 1 -- 172.21.15.46:0/4154505316 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec003810 con 0x7efdfc0cc700 2024-03-04T08:49:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.150+0000 7f0f9b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f9c15e320 0x7f0f9c155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37866/0 (socket says 172.21.15.46:37866) 2024-03-04T08:49:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.150+0000 7f0f9b200640 1 -- 172.21.15.46:0/2407269505 learned_addr learned my addr 172.21.15.46:0/2407269505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.150+0000 7efe02600640 1 -- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 msgr2=0x7efde0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.151+0000 7efe02600640 1 --2- 172.21.15.46:0/4154505316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0cc700 0x7efde0003b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdec0018d0 tx=0x7efde0005830 comp rx=0 tx=0).stop 2024-03-04T08:49:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.151+0000 7efdfbe00640 1 -- 172.21.15.46:0/4154505316 reap_dead start 2024-03-04T08:49:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.151+0000 7efe02600640 1 -- 172.21.15.46:0/4154505316 shutdown_connections 2024-03-04T08:49:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.151+0000 7efe02600640 1 -- 172.21.15.46:0/4154505316 >> 172.21.15.46:0/4154505316 conn(0x7efdfc066c40 msgr2=0x7efdfc067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.151+0000 7efe02600640 1 -- 172.21.15.46:0/4154505316 shutdown_connections 2024-03-04T08:49:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.152+0000 7fb33be00640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb324004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.151+0000 7efe02600640 1 -- 172.21.15.46:0/4154505316 wait complete. 2024-03-04T08:49:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.154+0000 7efe02600640 1 Processor -- start 2024-03-04T08:49:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.154+0000 7efe02600640 1 -- start start 2024-03-04T08:49:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7fb33be00640 1 -- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb324003b70 msgr2=0x7fb324003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7fb33be00640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb324003b70 0x7fb324003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7fb33be00640 1 -- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb324005210 msgr2=0x7fb32400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7fb33be00640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb324005210 0x7fb32400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7fb33be00640 1 -- 172.21.15.46:0/2955250215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c15a900 con 0x7fb324004800 2024-03-04T08:49:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7efe02600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc0c9810 0x7efdfc0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7efe02600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc0c9bf0 0x7efdfc0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7efe02600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0c4be0 0x7efdfc0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7efe02600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0ce820 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7efe02600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15aec0 con 0x7efdfc0c9810 2024-03-04T08:49:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.155+0000 7efe02600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15a5b0 con 0x7efdfc0c4be0 2024-03-04T08:49:57.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.157+0000 7f0f9a800640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c0cedc0 0x7f0f9c0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.155 INFO:teuthology.orchestra.run.smithi046.stdout:60129542156 2024-03-04T08:49:57.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T08:49:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.159+0000 7fb33be00640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb324004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c240 tx=0x7fb324005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0073bac55a3eb3d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.162+0000 7f0f9a800640 1 -- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f9c15e320 msgr2=0x7f0f9c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.162+0000 7f0f9a800640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f9c15e320 0x7f0f9c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.162+0000 7f0f9a800640 1 -- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f9c15add0 msgr2=0x7f0f9c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.162+0000 7f0f9a800640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f9c15add0 0x7f0f9c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.162+0000 7f0f9a800640 1 -- 172.21.15.46:0/2407269505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c14e510 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.164+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 --> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f336c15b8e0 con 0x7f334c073720 2024-03-04T08:49:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.165+0000 7f3363e00640 1 -- 172.21.15.46:0/1122088970 <== osd.2 v2:172.21.15.46:6817/604231528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f336c15b8e0 con 0x7f334c073720 2024-03-04T08:49:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.165+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f334c073720 msgr2=0x7f334c075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.165+0000 7f3372e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f334c073720 0x7f334c075b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f334c06b520 msgr2=0x7f334c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f334c06b520 0x7f334c06d9e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f33580098e0 tx=0x7f3358009060 comp rx=0 tx=0).stop 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f336c0c6c80 msgr2=0x7f336c2000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 --2- 172.21.15.46:0/1122088970 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f336c0c6c80 0x7f336c2000c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f335c00c440 tx=0x7f335c00c900 comp rx=0 tx=0).stop 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3370e00640 1 -- 172.21.15.46:0/1122088970 reap_dead start 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 shutdown_connections 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 >> 172.21.15.46:0/1122088970 conn(0x7f336c06aff0 msgr2=0x7f336c1ea220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 shutdown_connections 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.166+0000 7f3372e00640 1 -- 172.21.15.46:0/1122088970 wait complete. 2024-03-04T08:49:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.168+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f000401a070 con 0x7f000c072890 2024-03-04T08:49:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.169+0000 7f0008c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7effec06b520 0x7effec06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.169+0000 7f000be00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7effec06b520 0x7effec06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.170+0000 7f000be00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7effec06b520 0x7effec06d9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f000c0c5f90 tx=0x7efff8007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.172+0000 7efdfaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc0c9bf0 0x7efdfc0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.173+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0004057100 con 0x7f000c072890 2024-03-04T08:49:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.173+0000 7f0008c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7effec073720 0x7effec075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.173+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 --> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effec0761f0 con 0x7effec073720 2024-03-04T08:49:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.173+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0004055300 con 0x7f000c072890 2024-03-04T08:49:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.173+0000 7f0011c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7effec073720 0x7effec075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.174+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330007d30 con 0x7fb324004800 2024-03-04T08:49:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.174+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330030070 con 0x7fb324004800 2024-03-04T08:49:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.174+0000 7fb33b400640 1 -- 172.21.15.46:0/2955250215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330005d30 con 0x7fb324004800 2024-03-04T08:49:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7f0011c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7effec073720 0x7effec075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7fb343400640 1 -- 172.21.15.46:0/2955250215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 msgr2=0x7fb324004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7fb343400640 1 --2- 172.21.15.46:0/2955250215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb324004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c240 tx=0x7fb324005830 comp rx=0 tx=0).stop 2024-03-04T08:49:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7efdfaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc0c9bf0 0x7efdfc0c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47892/0 (socket says 172.21.15.46:47892) 2024-03-04T08:49:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7fb341400640 1 -- 172.21.15.46:0/2955250215 reap_dead start 2024-03-04T08:49:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7efdfaa00640 1 -- 172.21.15.46:0/3891918447 learned_addr learned my addr 172.21.15.46:0/3891918447 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7fb343400640 1 -- 172.21.15.46:0/2955250215 shutdown_connections 2024-03-04T08:49:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.175+0000 7fb343400640 1 -- 172.21.15.46:0/2955250215 >> 172.21.15.46:0/2955250215 conn(0x7fb33c066c40 msgr2=0x7fb33c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.176+0000 7fb343400640 1 -- 172.21.15.46:0/2955250215 shutdown_connections 2024-03-04T08:49:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.176+0000 7fb343400640 1 -- 172.21.15.46:0/2955250215 wait complete. 2024-03-04T08:49:57.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.176+0000 7f0f9a800640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c0cedc0 0x7f0f9c0b0270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c430 tx=0x7f0f8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.176+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== osd.5 v2:172.21.15.73:6819/4224855400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7effec0761f0 con 0x7effec073720 2024-03-04T08:49:57.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.178+0000 7fb343400640 1 Processor -- start 2024-03-04T08:49:57.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.179+0000 7fb343400640 1 -- start start 2024-03-04T08:49:57.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7fb343400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb33c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7fb343400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c0c8150 0x7fb33c1fda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7fb343400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c0c7cc0 0x7fb33c0c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7fb343400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0ce820 con 0x7fb324004800 2024-03-04T08:49:57.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7fb343400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c15aec0 con 0x7fb33c0c7cc0 2024-03-04T08:49:57.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7fb343400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c15a5b0 con 0x7fb33c0c8150 2024-03-04T08:49:57.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.180+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f23f4005d10 con 0x7f23fc0cbae0 2024-03-04T08:49:57.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.182+0000 7f23f9600640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23dc06b520 0x7f23dc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.182+0000 7efdfb400640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc0c9810 0x7efdfc0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.183+0000 7efdfaa00640 1 -- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0c4be0 msgr2=0x7efdfc0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.183+0000 7efdfaa00640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc0c4be0 0x7efdfc0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.183+0000 7efdfaa00640 1 -- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc0c9810 msgr2=0x7efdfc0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.183+0000 7efdfaa00640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc0c9810 0x7efdfc0af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.183+0000 7efdfaa00640 1 -- 172.21.15.46:0/3891918447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0c3880 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.182+0000 7f2401600640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23dc06b520 0x7f23dc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.184+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23f4079b70 con 0x7f23fc0cbae0 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.184+0000 7f2401600640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23dc06b520 0x7f23dc06d9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.184+0000 7f23f9600640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7f23dc073720 0x7f23dc075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.185+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 --> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23f402cc60 con 0x7f23dc073720 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.185+0000 7f2402000640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7f23dc073720 0x7f23dc075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.185+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23f4077d70 con 0x7f23fc0cbae0 2024-03-04T08:49:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.186+0000 7f2402000640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7f23dc073720 0x7f23dc075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.187+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac015020 con 0x7fa5c0154750 2024-03-04T08:49:57.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.187+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac011830 con 0x7fa5c0154750 2024-03-04T08:49:57.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.187+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac011c20 con 0x7fa5c0154750 2024-03-04T08:49:57.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.187+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c00c9f80 con 0x7fa5c0154750 2024-03-04T08:49:57.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.187+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00b0970 con 0x7fa5c0154750 2024-03-04T08:49:57.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.188+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5c00b5bc0 con 0x7fa5c0154750 2024-03-04T08:49:57.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.188+0000 7fb33be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c0c8150 0x7fb33c1fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.188+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== osd.7 v2:172.21.15.73:6802/2569604158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f23f402cc60 con 0x7f23dc073720 2024-03-04T08:49:57.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.189+0000 7fb341400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c0c7cc0 0x7fb33c0c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.190+0000 7fb341400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c0c7cc0 0x7fb33c0c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43930/0 (socket says 172.21.15.46:43930) 2024-03-04T08:49:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.190+0000 7fb341400640 1 -- 172.21.15.46:0/3302693241 learned_addr learned my addr 172.21.15.46:0/3302693241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.191+0000 7fb340a00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb33c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.189 INFO:teuthology.orchestra.run.smithi046.stdout:64424509452 2024-03-04T08:49:57.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T08:49:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.192+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84017070 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.193+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84005ce0 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.193+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840072d0 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.193+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0b1f70 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.193+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c157540 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.194+0000 7efdfaa00640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc0c9bf0 0x7efdfc0c6f40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efde80072e0 tx=0x7efde80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.195+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f74001030 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.198+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800fa80 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.198+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0c3b40 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.199+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc0c4100 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.196+0000 7fb33be00640 1 -- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c0c7cc0 msgr2=0x7fb33c0c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.196+0000 7fb33be00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c0c7cc0 0x7fb33c0c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.196+0000 7fb33be00640 1 -- 172.21.15.46:0/3302693241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 msgr2=0x7fb33c0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.196+0000 7fb33be00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb324004800 0x7fb33c0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.196+0000 7fb33be00640 1 -- 172.21.15.46:0/3302693241 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c1fdf50 con 0x7fb33c0c8150 2024-03-04T08:49:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.201+0000 7fb33be00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c0c8150 0x7fb33c1fda10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb330031000 tx=0x7fb330001970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.202+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdfc0ca290 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.206+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330045070 con 0x7fb33c0c8150 2024-03-04T08:49:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.207+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330004bf0 con 0x7fb33c0c8150 2024-03-04T08:49:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.207+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330045070 con 0x7fb33c0c8150 2024-03-04T08:49:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.207+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c0c6f40 con 0x7fb33c0c8150 2024-03-04T08:49:57.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.208+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c0c3b40 con 0x7fb33c0c8150 2024-03-04T08:49:57.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.210+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 --> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f000c0680b0 con 0x7effec073720 2024-03-04T08:49:57.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.211+0000 7f0008c00640 1 -- 172.21.15.46:0/3310982911 <== osd.5 v2:172.21.15.73:6819/4224855400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f000c0680b0 con 0x7effec073720 2024-03-04T08:49:57.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.211+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb33c0aedc0 con 0x7fb33c0c8150 2024-03-04T08:49:57.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 --> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23d8002dd0 con 0x7f23dc073720 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7effec073720 msgr2=0x7effec075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7effec073720 0x7effec075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7effec06b520 msgr2=0x7effec06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7effec06b520 0x7effec06d9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f000c0c5f90 tx=0x7efff8007990 comp rx=0 tx=0).stop 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 msgr2=0x7f000c1511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 --2- 172.21.15.46:0/3310982911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f000c072890 0x7f000c1511a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f000400cbc0 tx=0x7f000400a430 comp rx=0 tx=0).stop 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0011c00640 1 -- 172.21.15.46:0/3310982911 reap_dead start 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 shutdown_connections 2024-03-04T08:49:57.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 >> 172.21.15.46:0/3310982911 conn(0x7f000c06aff0 msgr2=0x7f000c0c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.212+0000 7f23f9600640 1 -- 172.21.15.46:0/2396783017 <== osd.7 v2:172.21.15.73:6802/2569604158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23d8002dd0 con 0x7f23dc073720 2024-03-04T08:49:57.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.213+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 shutdown_connections 2024-03-04T08:49:57.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.213+0000 7f0013c00640 1 -- 172.21.15.46:0/3310982911 wait complete. 2024-03-04T08:49:57.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.213+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7f23dc073720 msgr2=0x7f23dc075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.213+0000 7f2402a00640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7f23dc073720 0x7f23dc075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23dc06b520 msgr2=0x7f23dc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402a00640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23dc06b520 0x7f23dc06d9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0007970 comp rx=0 tx=0).stop 2024-03-04T08:49:57.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbae0 msgr2=0x7f23fc1ebff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402a00640 1 --2- 172.21.15.46:0/2396783017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23fc0cbae0 0x7f23fc1ebff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d90 tx=0x7f23f4004a40 comp rx=0 tx=0).stop 2024-03-04T08:49:57.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402000640 1 -- 172.21.15.46:0/2396783017 reap_dead start 2024-03-04T08:49:57.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 shutdown_connections 2024-03-04T08:49:57.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.214+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 >> 172.21.15.46:0/2396783017 conn(0x7f23fc06f110 msgr2=0x7f23fc155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.215+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 shutdown_connections 2024-03-04T08:49:57.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.219+0000 7f2402a00640 1 -- 172.21.15.46:0/2396783017 wait complete. 2024-03-04T08:49:57.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.232+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa5ac018020 con 0x7fa5c0154750 2024-03-04T08:49:57.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.233+0000 7fa5bcc00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa5a006b520 0x7fa5a006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.235+0000 7fa5c4a00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa5a006b520 0x7fa5a006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.235+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5ac057000 con 0x7fa5c0154750 2024-03-04T08:49:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.235+0000 7fa5bcc00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7fa5a00736c0 0x7fa5a0075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.236+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 --> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5ac00ce50 con 0x7fa5a00736c0 2024-03-04T08:49:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.237+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5ac055200 con 0x7fa5c0154750 2024-03-04T08:49:57.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.237+0000 7fa5c5400640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7fa5a00736c0 0x7fa5a0075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.238+0000 7fa5c5400640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7fa5a00736c0 0x7fa5a0075ae0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.236+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb330007070 con 0x7fb33c0c8150 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.238+0000 7fb338c00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb31c06b700 0x7fb31c06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.238+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3300ab920 con 0x7fb33c0c8150 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.238+0000 7fb338c00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7fb31c073920 0x7fb31c075d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.238+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 --> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb330009eb0 con 0x7fb31c073920 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.238+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3300abd10 con 0x7fb33c0c8150 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.240+0000 7fb340a00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb31c06b700 0x7fb31c06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.240+0000 7fb341400640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7fb31c073920 0x7fb31c075d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.240+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== osd.1 v2:172.21.15.46:6800/2230640805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa5ac00ce50 con 0x7fa5a00736c0 2024-03-04T08:49:57.237 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-03-04T08:49:57.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T08:49:57.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.240+0000 7fa5c4a00640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa5a006b520 0x7fa5a006d9e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4036000 tx=0x7fa5b4039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.242+0000 7fb340a00640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb31c06b700 0x7fb31c06dbc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb33c08cf10 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.242+0000 7fb341400640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7fb31c073920 0x7fb31c075d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.243+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== osd.6 v2:172.21.15.73:6810/1918032406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb330009eb0 con 0x7fb31c073920 2024-03-04T08:49:57.247 INFO:teuthology.orchestra.run.smithi046.stdout:60129542156 2024-03-04T08:49:57.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T08:49:57.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.273+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 --> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5c00680b0 con 0x7fa5a00736c0 2024-03-04T08:49:57.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.275+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0f8401a070 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.277+0000 7f0f93400640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0f7806b520 0x7f0f7806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.277+0000 7f0f91e00640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0f7806b520 0x7f0f7806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.278+0000 7f0f91e00640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0f7806b520 0x7f0f7806d9e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c036000 tx=0x7f0f8c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.275+0000 7fa5bcc00640 1 -- 172.21.15.46:0/3313470624 <== osd.1 v2:172.21.15.46:6800/2230640805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5c00680b0 con 0x7fa5a00736c0 2024-03-04T08:49:57.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7fa5a00736c0 msgr2=0x7fa5a0075ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c7400640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7fa5a00736c0 0x7fa5a0075ae0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa5a006b520 msgr2=0x7fa5a006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c7400640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa5a006b520 0x7fa5a006d9e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4036000 tx=0x7fa5b4039040 comp rx=0 tx=0).stop 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 msgr2=0x7fa5c00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c7400640 1 --2- 172.21.15.46:0/3313470624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c0154750 0x7fa5c00c8e50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00b410 tx=0x7fa5ac00b8d0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fa5c5400640 1 -- 172.21.15.46:0/3313470624 reap_dead start 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.276+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 --> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb33c0731b0 con 0x7fb31c073920 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.276+0000 7fb338c00640 1 -- 172.21.15.46:0/3302693241 <== osd.6 v2:172.21.15.73:6810/1918032406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb33c0731b0 con 0x7fb31c073920 2024-03-04T08:49:57.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.277+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7fb31c073920 msgr2=0x7fb31c075d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.278+0000 7fb343400640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7fb31c073920 0x7fb31c075d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.278+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb31c06b700 msgr2=0x7fb31c06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.278+0000 7fb343400640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb31c06b700 0x7fb31c06dbc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb33c08cf10 tx=0x7fb328008040 comp rx=0 tx=0).stop 2024-03-04T08:49:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c0c8150 msgr2=0x7fb33c1fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.279+0000 7fb343400640 1 --2- 172.21.15.46:0/3302693241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb33c0c8150 0x7fb33c1fda10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb330031000 tx=0x7fb330001970 comp rx=0 tx=0).stop 2024-03-04T08:49:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.281+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f84056520 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.282+0000 7fb341400640 1 -- 172.21.15.46:0/3302693241 reap_dead start 2024-03-04T08:49:57.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.282+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 shutdown_connections 2024-03-04T08:49:57.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.282+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 >> 172.21.15.46:0/3302693241 conn(0x7fb33c066c40 msgr2=0x7fb33c1f35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.282+0000 7f0f93400640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7f0f78073720 0x7f0f78075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.283+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 shutdown_connections 2024-03-04T08:49:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.283+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 >> 172.21.15.46:0/3313470624 conn(0x7fa5c0066c40 msgr2=0x7fa5c014e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.282+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 --> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f8401fe50 con 0x7f0f78073720 2024-03-04T08:49:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.283+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f84054720 con 0x7f0f9c0cedc0 2024-03-04T08:49:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.283+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 shutdown_connections 2024-03-04T08:49:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.284+0000 7fa5c7400640 1 -- 172.21.15.46:0/3313470624 wait complete. 2024-03-04T08:49:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.284+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 shutdown_connections 2024-03-04T08:49:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.284+0000 7f0f9b200640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7f0f78073720 0x7f0f78075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.285+0000 7fb343400640 1 -- 172.21.15.46:0/3302693241 wait complete. 2024-03-04T08:49:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.286+0000 7f0f9b200640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7f0f78073720 0x7f0f78075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.288+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== osd.0 v2:172.21.15.46:6807/873994847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0f8401fe50 con 0x7f0f78073720 2024-03-04T08:49:57.310 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:49:57.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T08:49:57.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.319+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0ca290 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.317 INFO:teuthology.orchestra.run.smithi046.stdout:60129542156 2024-03-04T08:49:57.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T08:49:57.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.323+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800fe20 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.324+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 --> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f74002dd0 con 0x7f0f78073720 2024-03-04T08:49:57.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.326+0000 7f0f93400640 1 -- 172.21.15.46:0/2407269505 <== osd.0 v2:172.21.15.46:6807/873994847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f74002dd0 con 0x7f0f78073720 2024-03-04T08:49:57.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.328+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7f0f78073720 msgr2=0x7f0f78075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.328+0000 7f0fa0a00640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7f0f78073720 0x7f0f78075b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.328+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0f7806b520 msgr2=0x7f0f7806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.328+0000 7f0fa0a00640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0f7806b520 0x7f0f7806d9e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c036000 tx=0x7f0f8c030000 comp rx=0 tx=0).stop 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.328+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c0cedc0 msgr2=0x7f0f9c0b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.328+0000 7f0fa0a00640 1 --2- 172.21.15.46:0/2407269505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f9c0cedc0 0x7f0f9c0b0270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c430 tx=0x7f0f8400c8f0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.329+0000 7f0f9b200640 1 -- 172.21.15.46:0/2407269505 reap_dead start 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.331+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 shutdown_connections 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.331+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 >> 172.21.15.46:0/2407269505 conn(0x7f0f9c066c40 msgr2=0x7f0f9c15b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.331+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 shutdown_connections 2024-03-04T08:49:57.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.331+0000 7f0fa0a00640 1 -- 172.21.15.46:0/2407269505 wait complete. 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.326+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efde801d460 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.329+0000 7efdf3400640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efddc06b700 0x7efddc06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.329+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efde800fc20 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.329+0000 7efdfb400640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efddc06b700 0x7efddc06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.330+0000 7efdf3400640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7efddc073900 0x7efddc075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.330+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 --> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efde8006eb0 con 0x7efddc073900 2024-03-04T08:49:57.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.330+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde808b010 con 0x7efdfc0c9bf0 2024-03-04T08:49:57.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.330+0000 7efdfbe00640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7efddc073900 0x7efddc075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.333+0000 7efdfbe00640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7efddc073900 0x7efddc075d20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.334+0000 7efdfb400640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efddc06b700 0x7efddc06dbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efdec034000 tx=0x7efdec031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.336+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== osd.3 v2:172.21.15.46:6816/3736261078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efde8006eb0 con 0x7efddc073900 2024-03-04T08:49:57.360 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:49:57.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T08:49:57.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.367+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 --> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efdfc153f40 con 0x7efddc073900 2024-03-04T08:49:57.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.368+0000 7efdf3400640 1 -- 172.21.15.46:0/3891918447 <== osd.3 v2:172.21.15.46:6816/3736261078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efdfc153f40 con 0x7efddc073900 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.369+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7efddc073900 msgr2=0x7efddc075d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.369+0000 7efe02600640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7efddc073900 0x7efddc075d20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.369+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efddc06b700 msgr2=0x7efddc06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.369+0000 7efe02600640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efddc06b700 0x7efddc06dbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efdec034000 tx=0x7efdec031000 comp rx=0 tx=0).stop 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.369+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc0c9bf0 msgr2=0x7efdfc0c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.369+0000 7efe02600640 1 --2- 172.21.15.46:0/3891918447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc0c9bf0 0x7efdfc0c6f40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efde80072e0 tx=0x7efde80077a0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.372+0000 7efdfbe00640 1 -- 172.21.15.46:0/3891918447 reap_dead start 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.373+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 shutdown_connections 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.373+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 >> 172.21.15.46:0/3891918447 conn(0x7efdfc066c40 msgr2=0x7efdfc153630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.373+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 shutdown_connections 2024-03-04T08:49:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.373+0000 7efe02600640 1 -- 172.21.15.46:0/3891918447 wait complete. 2024-03-04T08:49:57.407 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:49:57.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T08:49:57.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.495+0000 7fe9e7000640 1 Processor -- start 2024-03-04T08:49:57.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.495+0000 7fe9e7000640 1 -- start start 2024-03-04T08:49:57.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.497+0000 7fe9e7000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e00cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.497+0000 7fe9e7000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe9e0154b30 0x7fe9e00ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.498+0000 7fe9e7000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00ca6d0 con 0x7fe9e00ce650 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.498+0000 7fe9e7000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e00ca990 con 0x7fe9e0154b30 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.498+0000 7fe9e7000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00cac70 con 0x7fe9e0154750 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.498+0000 7fe9dfe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e00cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.498+0000 7fe9dfe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e00cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37898/0 (socket says 172.21.15.46:37898) 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.498+0000 7fe9dfe00640 1 -- 172.21.15.46:0/2124895420 learned_addr learned my addr 172.21.15.46:0/2124895420 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.500+0000 7fe9df400640 1 --2- 172.21.15.46:0/2124895420 >> v2:172.21.15.73:3300/0 conn(0x7fe9e0154b30 0x7fe9e00ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.500+0000 7fe9dfe00640 1 -- 172.21.15.46:0/2124895420 >> v2:172.21.15.73:3300/0 conn(0x7fe9e0154b30 msgr2=0x7fe9e00ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.500+0000 7fe9dfe00640 1 --2- 172.21.15.46:0/2124895420 >> v2:172.21.15.73:3300/0 conn(0x7fe9e0154b30 0x7fe9e00ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.500+0000 7fe9dfe00640 1 -- 172.21.15.46:0/2124895420 >> v1:172.21.15.46:6789/0 conn(0x7fe9e00ce650 legacy=0x7fe9e00cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.501+0000 7fe9dfe00640 1 -- 172.21.15.46:0/2124895420 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e015a900 con 0x7fe9e0154750 2024-03-04T08:49:57.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.503+0000 7fe9dfe00640 1 --2- 172.21.15.46:0/2124895420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e00cea90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0013db0 tx=0x7fe9d00341b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45f78df7e735fe68 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.505+0000 7fe9dea00640 1 -- 172.21.15.46:0/2124895420 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0012ae0 con 0x7fe9e0154750 2024-03-04T08:49:57.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.507+0000 7fe9dea00640 1 -- 172.21.15.46:0/2124895420 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d0012c80 con 0x7fe9e0154750 2024-03-04T08:49:57.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.508+0000 7fe9e7000640 1 -- 172.21.15.46:0/2124895420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 msgr2=0x7fe9e00cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.512+0000 7fe9dea00640 1 -- 172.21.15.46:0/2124895420 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0012ae0 con 0x7fe9e0154750 2024-03-04T08:49:57.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.512+0000 7fe9e7000640 1 --2- 172.21.15.46:0/2124895420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e00cea90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0013db0 tx=0x7fe9d00341b0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.512+0000 7fe9e7000640 1 -- 172.21.15.46:0/2124895420 shutdown_connections 2024-03-04T08:49:57.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.512+0000 7fe9e7000640 1 --2- 172.21.15.46:0/2124895420 >> v2:172.21.15.73:3300/0 conn(0x7fe9e0154b30 0x7fe9e00ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.512+0000 7fe9e7000640 1 --2- 172.21.15.46:0/2124895420 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e00cea90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.512+0000 7fe9e7000640 1 -- 172.21.15.46:0/2124895420 >> 172.21.15.46:0/2124895420 conn(0x7fe9e0066c40 msgr2=0x7fe9e0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.514+0000 7fe9e7000640 1 -- 172.21.15.46:0/2124895420 shutdown_connections 2024-03-04T08:49:57.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.514+0000 7fe9e7000640 1 -- 172.21.15.46:0/2124895420 wait complete. 2024-03-04T08:49:57.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.524+0000 7fe9e7000640 1 Processor -- start 2024-03-04T08:49:57.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.524+0000 7fe9e7000640 1 -- start start 2024-03-04T08:49:57.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.530+0000 7fe9e7000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9e00ce650 0x7fe9e00cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.530+0000 7fe9e7000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.530+0000 7fe9e7000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9e00afce0 0x7fe9e014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.531+0000 7fe9e7000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015a5b0 con 0x7fe9e00afce0 2024-03-04T08:49:57.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.531+0000 7fe9e7000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015aec0 con 0x7fe9e00ce650 2024-03-04T08:49:57.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.531+0000 7fe9e7000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015b3e0 con 0x7fe9e0154750 2024-03-04T08:49:57.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.531+0000 7fe9df400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.532+0000 7fe9df400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e014dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37902/0 (socket says 172.21.15.46:37902) 2024-03-04T08:49:57.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.532+0000 7fe9df400640 1 -- 172.21.15.46:0/4136522771 learned_addr learned my addr 172.21.15.46:0/4136522771 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.533+0000 7fe9dfe00640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9e00ce650 0x7fe9e00cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.537+0000 7fe9df400640 1 -- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9e00ce650 msgr2=0x7fe9e00cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.537+0000 7fe9df400640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9e00ce650 0x7fe9e00cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.537+0000 7fe9df400640 1 -- 172.21.15.46:0/4136522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9e00afce0 msgr2=0x7fe9e014e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.537+0000 7fe9df400640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9e00afce0 0x7fe9e014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.537+0000 7fe9df400640 1 -- 172.21.15.46:0/4136522771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00c9be0 con 0x7fe9e0154750 2024-03-04T08:49:57.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.543+0000 7fe9df400640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e014dff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d620 tx=0x7fe9cc00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.547+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00b620 con 0x7fe9e0154750 2024-03-04T08:49:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.547+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc019070 con 0x7fe9e0154750 2024-03-04T08:49:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.547+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00ba00 con 0x7fe9e0154750 2024-03-04T08:49:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.548+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e01ef800 con 0x7fe9e0154750 2024-03-04T08:49:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.548+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00c9900 con 0x7fe9e0154750 2024-03-04T08:49:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.550+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e00680b0 con 0x7fe9e0154750 2024-03-04T08:49:57.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.556+0000 7fcfc5600640 1 Processor -- start 2024-03-04T08:49:57.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.556+0000 7fcfc5600640 1 -- start start 2024-03-04T08:49:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.558+0000 7fcfc5600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc01545d0 0x7fcfc00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.559+0000 7fcfc5600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc006fc60 0x7fcfc015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.559+0000 7fcfc5600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc0071770 con 0x7fcfc00c65c0 2024-03-04T08:49:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.559+0000 7fcfc5600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc0071520 con 0x7fcfc01545d0 2024-03-04T08:49:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.559+0000 7fcfc5600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00c6a10 con 0x7fcfc006fc60 2024-03-04T08:49:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.563+0000 7fcfbfe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc01545d0 0x7fcfc00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.568+0000 7fcfbfe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc01545d0 0x7fcfc00b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43950/0 (socket says 172.21.15.46:43950) 2024-03-04T08:49:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.568+0000 7fcfbfe00640 1 -- 172.21.15.46:0/1397357348 learned_addr learned my addr 172.21.15.46:0/1397357348 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.573+0000 7fcfbfe00640 1 -- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc006fc60 msgr2=0x7fcfc015e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.573+0000 7fcfbfe00640 1 --2- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc006fc60 0x7fcfc015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.573+0000 7fcfbfe00640 1 -- 172.21.15.46:0/1397357348 >> v1:172.21.15.73:6789/0 conn(0x7fcfc00c65c0 legacy=0x7fcfc00cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.573+0000 7fcfbfe00640 1 -- 172.21.15.46:0/1397357348 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc015d8f0 con 0x7fcfc01545d0 2024-03-04T08:49:57.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.578+0000 7fcfbfe00640 1 --2- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc01545d0 0x7fcfc00b0b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009870 tx=0x7fcfb002ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8851d2b746a7b89 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.583+0000 7fcfbea00640 1 -- 172.21.15.46:0/1397357348 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002f870 con 0x7fcfc01545d0 2024-03-04T08:49:57.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.584+0000 7fcfbea00640 1 -- 172.21.15.46:0/1397357348 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb002fa10 con 0x7fcfc01545d0 2024-03-04T08:49:57.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.585+0000 7fcfbea00640 1 -- 172.21.15.46:0/1397357348 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002fe20 con 0x7fcfc01545d0 2024-03-04T08:49:57.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.586+0000 7fed9e000640 1 Processor -- start 2024-03-04T08:49:57.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.586+0000 7fed9e000640 1 -- start start 2024-03-04T08:49:57.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.588+0000 7fcfc5600640 1 -- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc01545d0 msgr2=0x7fcfc00b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.588+0000 7fcfc5600640 1 --2- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc01545d0 0x7fcfc00b0b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009870 tx=0x7fcfb002ba50 comp rx=0 tx=0).stop 2024-03-04T08:49:57.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.588+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9cc00bba0 con 0x7fe9e0154750 2024-03-04T08:49:57.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.590+0000 7fcfc5600640 1 -- 172.21.15.46:0/1397357348 shutdown_connections 2024-03-04T08:49:57.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.590+0000 7fcfc5600640 1 --2- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc006fc60 0x7fcfc015e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.590+0000 7fe9d7e00640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9c006b520 0x7fe9c006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.590+0000 7fcfc5600640 1 --2- 172.21.15.46:0/1397357348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc01545d0 0x7fcfc00b0b90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.588+0000 7fed9e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed980c11f0 0x7fed9815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.588+0000 7fed9e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed980c8850 0x7fed980c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.590+0000 7fcfc5600640 1 -- 172.21.15.46:0/1397357348 >> 172.21.15.46:0/1397357348 conn(0x7fcfc006b1d0 msgr2=0x7fcfc006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.590+0000 7fed9e000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed980735b0 con 0x7fed98154530 2024-03-04T08:49:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fed9e000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed98072d10 con 0x7fed980c11f0 2024-03-04T08:49:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fed9e000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed98072ff0 con 0x7fed980c8850 2024-03-04T08:49:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fed97e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed980c8850 0x7fed980c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fed97e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed980c8850 0x7fed980c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43966/0 (socket says 172.21.15.46:43966) 2024-03-04T08:49:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fcfc5600640 1 -- 172.21.15.46:0/1397357348 shutdown_connections 2024-03-04T08:49:57.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.592+0000 7fe9dfe00640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9c006b520 0x7fe9c006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fed97e00640 1 -- 172.21.15.46:0/3833324794 learned_addr learned my addr 172.21.15.46:0/3833324794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.591+0000 7fcfc5600640 1 -- 172.21.15.46:0/1397357348 wait complete. 2024-03-04T08:49:57.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.594+0000 7fcfc5600640 1 Processor -- start 2024-03-04T08:49:57.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.595+0000 7fed96a00640 1 --2- 172.21.15.46:0/3833324794 >> v2:172.21.15.46:3300/0 conn(0x7fed980c11f0 0x7fed9815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.595+0000 7fcfc5600640 1 -- start start 2024-03-04T08:49:57.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.597+0000 7fed97e00640 1 -- 172.21.15.46:0/3833324794 >> v2:172.21.15.46:3300/0 conn(0x7fed980c11f0 msgr2=0x7fed9815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.597+0000 7fed97e00640 1 --2- 172.21.15.46:0/3833324794 >> v2:172.21.15.46:3300/0 conn(0x7fed980c11f0 0x7fed9815e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.597+0000 7fed97e00640 1 -- 172.21.15.46:0/3833324794 >> v1:172.21.15.73:6789/0 conn(0x7fed98154530 legacy=0x7fed980c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.597+0000 7fed97e00640 1 -- 172.21.15.46:0/3833324794 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed980732d0 con 0x7fed980c8850 2024-03-04T08:49:57.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.601+0000 7fe9dfe00640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9c006b520 0x7fe9c006d9e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9d003d000 tx=0x7fe9d0038000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.603+0000 7fcfc5600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc006fc60 0x7fcfc00c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.603+0000 7fcfc5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 0x7fcfc015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.604+0000 7fcfc5600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc01545d0 0x7fcfc01fd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.604+0000 7fcfc5600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0071a50 con 0x7fcfc00c65c0 2024-03-04T08:49:57.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.604+0000 7fcfc5600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015deb0 con 0x7fcfc006fc60 2024-03-04T08:49:57.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.604+0000 7fcfc5600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01549b0 con 0x7fcfc01545d0 2024-03-04T08:49:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.626+0000 7f8dce400640 1 Processor -- start 2024-03-04T08:49:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.626+0000 7f8dce400640 1 -- start start 2024-03-04T08:49:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.629+0000 7f8dce400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dc8150130 0x7f8dc8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.628+0000 7fcfbf400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 0x7fcfc015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.629+0000 7f8dce400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dc815a4e0 0x7f8dc80c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.629+0000 7fcfbf400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 0x7fcfc015c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47924/0 (socket says 172.21.15.46:47924) 2024-03-04T08:49:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.630+0000 7fcfbf400640 1 -- 172.21.15.46:0/862283078 learned_addr learned my addr 172.21.15.46:0/862283078 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.630+0000 7f8dce400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc8156780 con 0x7f8dc81561b0 2024-03-04T08:49:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.630+0000 7f8dce400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc8159b10 con 0x7f8dc8150130 2024-03-04T08:49:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.630+0000 7f8dce400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8156a60 con 0x7f8dc815a4e0 2024-03-04T08:49:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.649+0000 7fcfbf400640 1 -- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc01545d0 msgr2=0x7fcfc01fd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.649+0000 7fcfbf400640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc01545d0 0x7fcfc01fd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.649+0000 7fcfbf400640 1 -- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc006fc60 msgr2=0x7fcfc00c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.649+0000 7fcfbf400640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc006fc60 0x7fcfc00c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.649+0000 7fcfbf400640 1 -- 172.21.15.46:0/862283078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00c74f0 con 0x7fcfc00c65c0 2024-03-04T08:49:57.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.673+0000 7f8dc7e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8dc81561b0 0x7f8dc80c8410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49714/0 (socket says 172.21.15.46:49714) 2024-03-04T08:49:57.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.673+0000 7fed97e00640 1 --2- 172.21.15.46:0/3833324794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed980c8850 0x7fed980c8c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed98157f50 tx=0x7fed8802ba80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eebadae6a01d77e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.673+0000 7f8dc7e00640 1 -- 172.21.15.46:0/2965591873 learned_addr learned my addr 172.21.15.46:0/2965591873 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.682+0000 7fed96000640 1 -- 172.21.15.46:0/3833324794 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8802d840 con 0x7fed980c8850 2024-03-04T08:49:57.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.682+0000 7fed96000640 1 -- 172.21.15.46:0/3833324794 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8802d9e0 con 0x7fed980c8850 2024-03-04T08:49:57.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.682+0000 7fed96000640 1 -- 172.21.15.46:0/3833324794 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8802ddf0 con 0x7fed980c8850 2024-03-04T08:49:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.683+0000 7fed9e000640 1 -- 172.21.15.46:0/3833324794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed980c8850 msgr2=0x7fed980c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.683+0000 7fed9e000640 1 --2- 172.21.15.46:0/3833324794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed980c8850 0x7fed980c8c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed98157f50 tx=0x7fed8802ba80 comp rx=0 tx=0).stop 2024-03-04T08:49:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.683+0000 7fed9e000640 1 -- 172.21.15.46:0/3833324794 shutdown_connections 2024-03-04T08:49:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.683+0000 7fed9e000640 1 --2- 172.21.15.46:0/3833324794 >> v2:172.21.15.46:3300/0 conn(0x7fed980c11f0 0x7fed9815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.683+0000 7fed9e000640 1 --2- 172.21.15.46:0/3833324794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed980c8850 0x7fed980c8c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.683+0000 7fed9e000640 1 -- 172.21.15.46:0/3833324794 >> 172.21.15.46:0/3833324794 conn(0x7fed9806aff0 msgr2=0x7fed9806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.684+0000 7fed9e000640 1 -- 172.21.15.46:0/3833324794 shutdown_connections 2024-03-04T08:49:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.684+0000 7fed9e000640 1 -- 172.21.15.46:0/3833324794 wait complete. 2024-03-04T08:49:57.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.687+0000 7fed9e000640 1 Processor -- start 2024-03-04T08:49:57.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.687+0000 7fed9e000640 1 -- start start 2024-03-04T08:49:57.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.690+0000 7fed9e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed980c11f0 0x7fed980c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.690+0000 7fed9e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed980c8850 0x7fed981fc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.691+0000 7fed9e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 0x7fed981fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.691+0000 7fed9e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9815a360 con 0x7fed980c11f0 2024-03-04T08:49:57.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.691+0000 7fed9e000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9815dcd0 con 0x7fed98154530 2024-03-04T08:49:57.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.692+0000 7fed9e000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9815a4e0 con 0x7fed980c8850 2024-03-04T08:49:57.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.692+0000 7fe872400640 1 Processor -- start 2024-03-04T08:49:57.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.692+0000 7fcfbf400640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 0x7fcfc015c5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00b4d0 tx=0x7fcfac00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.693+0000 7fe872400640 1 -- start start 2024-03-04T08:49:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.693+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185753292 0 0) 0x7f8dc8156780 con 0x7f8dc81561b0 2024-03-04T08:49:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.693+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003520 con 0x7f8dc81561b0 2024-03-04T08:49:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.694+0000 7fe872400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c154750 0x7fe86c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.695+0000 7fe872400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe86c154b30 0x7fe86c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.695+0000 7fed97e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 0x7fed981fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.695+0000 7fe872400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe86c0ce650 0x7fe86c0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.695+0000 7fe872400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c0ca6d0 con 0x7fe86c0ce650 2024-03-04T08:49:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.695+0000 7fe872400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c0ca990 con 0x7fe86c154b30 2024-03-04T08:49:57.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.695+0000 7fe872400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0cac70 con 0x7fe86c154750 2024-03-04T08:49:57.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7fed97e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 0x7fed981fcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43978/0 (socket says 172.21.15.46:43978) 2024-03-04T08:49:57.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7fed97e00640 1 -- 172.21.15.46:0/2155508361 learned_addr learned my addr 172.21.15.46:0/2155508361 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943871111 0 0) 0x7f8dac003520 con 0x7f8dc81561b0 2024-03-04T08:49:57.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dc815a4e0 msgr2=0x7f8dc80c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dc815a4e0 0x7f8dc80c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 >> v2:172.21.15.46:3300/0 conn(0x7f8dc8150130 msgr2=0x7f8dc8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 --2- 172.21.15.46:0/2965591873 >> v2:172.21.15.46:3300/0 conn(0x7f8dc8150130 0x7f8dc8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8156d40 con 0x7f8dc81561b0 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2826336207 0 0) 0x7f8dc00019f0 con 0x7f8dc81561b0 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 >> v1:172.21.15.73:6789/0 conn(0x7f8dc81561b0 legacy=0x7f8dc80c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dac003a20 0x7f8dac003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.702+0000 7f8dc6000640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dc815a4e0 0x7f8dac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.703+0000 7f8dc6000640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac004e60 0x7f8dac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.703+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8159b10 con 0x7f8dac003a20 2024-03-04T08:49:57.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.703+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8156a60 con 0x7f8dac004e60 2024-03-04T08:49:57.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.703+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac005670 con 0x7f8dc815a4e0 2024-03-04T08:49:57.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.705+0000 7fed97400640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed980c11f0 0x7fed980c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.705+0000 7fe86aa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe86c154b30 0x7fe86c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.705+0000 7fe86aa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe86c154b30 0x7fe86c0ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43986/0 (socket says 172.21.15.46:43986) 2024-03-04T08:49:57.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.705+0000 7fe86aa00640 1 -- 172.21.15.46:0/3651887144 learned_addr learned my addr 172.21.15.46:0/3651887144 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.709+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac014070 con 0x7fcfc00c65c0 2024-03-04T08:49:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.709+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac010870 con 0x7fcfc00c65c0 2024-03-04T08:49:57.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7f8dc7400640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dac003a20 0x7f8dac003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fe86be00640 1 --2- 172.21.15.46:0/3651887144 >> v2:172.21.15.46:3300/0 conn(0x7fe86c0ce650 0x7fe86c0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fe86aa00640 1 -- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c154750 msgr2=0x7fe86c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fe86aa00640 1 --2- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c154750 0x7fe86c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fe86aa00640 1 -- 172.21.15.46:0/3651887144 >> v2:172.21.15.46:3300/0 conn(0x7fe86c0ce650 msgr2=0x7fe86c0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fe86aa00640 1 --2- 172.21.15.46:0/3651887144 >> v2:172.21.15.46:3300/0 conn(0x7fe86c0ce650 0x7fe86c0cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fe86aa00640 1 -- 172.21.15.46:0/3651887144 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c15a900 con 0x7fe86c154b30 2024-03-04T08:49:57.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.710+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac014070 con 0x7fcfc00c65c0 2024-03-04T08:49:57.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.711+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc00c77d0 con 0x7fcfc00c65c0 2024-03-04T08:49:57.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.711+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc01edd50 con 0x7fcfc00c65c0 2024-03-04T08:49:57.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.713+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc01ee460 con 0x7fcfc00c65c0 2024-03-04T08:49:57.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.714+0000 7fed97e00640 1 -- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed980c8850 msgr2=0x7fed981fc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.714+0000 7fed97e00640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed980c8850 0x7fed981fc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.714+0000 7fed97e00640 1 -- 172.21.15.46:0/2155508361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed980c11f0 msgr2=0x7fed980c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.714+0000 7fed97e00640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed980c11f0 0x7fed980c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.714+0000 7fed97e00640 1 -- 172.21.15.46:0/2155508361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98200ab0 con 0x7fed98154530 2024-03-04T08:49:57.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.719+0000 7fe86aa00640 1 --2- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c154b30 0x7fe86c0ce110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe86c08ce20 tx=0x7fe85c02b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564f445702e3a547 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.721+0000 7f347be00640 1 Processor -- start 2024-03-04T08:49:57.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.721+0000 7f347be00640 1 -- start start 2024-03-04T08:49:57.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.721+0000 7fed97e00640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 0x7fed981fcf20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fed8802c090 tx=0x7fed88004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.723+0000 7f347be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c15e320 0x7f347c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.723+0000 7f347be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f347c0cedc0 0x7f347c0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.723+0000 7f347be00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347c0ccf10 con 0x7f347c15add0 2024-03-04T08:49:57.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.723+0000 7f347be00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347c15e740 con 0x7f347c0cedc0 2024-03-04T08:49:57.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.723+0000 7f347be00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15de90 con 0x7f347c15e320 2024-03-04T08:49:57.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.726+0000 7f8dc7e00640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac004e60 0x7f8dac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.726+0000 7f8dc7400640 1 -- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dc815a4e0 msgr2=0x7f8dac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.726+0000 7f8dc7400640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dc815a4e0 0x7f8dac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.726+0000 7f8dc7400640 1 -- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac004e60 msgr2=0x7f8dac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.726+0000 7f8dc7400640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac004e60 0x7f8dac00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.726+0000 7f8dc7400640 1 -- 172.21.15.46:0/2965591873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8156d40 con 0x7f8dac003a20 2024-03-04T08:49:57.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.727+0000 7fe86a000640 1 -- 172.21.15.46:0/3651887144 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c034070 con 0x7fe86c154b30 2024-03-04T08:49:57.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.727+0000 7fe86a000640 1 -- 172.21.15.46:0/3651887144 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c030850 con 0x7fe86c154b30 2024-03-04T08:49:57.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.727+0000 7fe86a000640 1 -- 172.21.15.46:0/3651887144 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c030c20 con 0x7fe86c154b30 2024-03-04T08:49:57.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7f347aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f347c15add0 0x7f347c0cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49726/0 (socket says 172.21.15.46:49726) 2024-03-04T08:49:57.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7f347aa00640 1 -- 172.21.15.46:0/3907775340 learned_addr learned my addr 172.21.15.46:0/3907775340 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:57.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 -- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c154b30 msgr2=0x7fe86c0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 --2- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c154b30 0x7fe86c0ce110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe86c08ce20 tx=0x7fe85c02b990 comp rx=0 tx=0).stop 2024-03-04T08:49:57.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 -- 172.21.15.46:0/3651887144 shutdown_connections 2024-03-04T08:49:57.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 --2- 172.21.15.46:0/3651887144 >> v2:172.21.15.46:3300/0 conn(0x7fe86c0ce650 0x7fe86c0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 --2- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c154b30 0x7fe86c0ce110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 --2- 172.21.15.46:0/3651887144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c154750 0x7fe86c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 -- 172.21.15.46:0/3651887144 >> 172.21.15.46:0/3651887144 conn(0x7fe86c066c40 msgr2=0x7fe86c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 -- 172.21.15.46:0/3651887144 shutdown_connections 2024-03-04T08:49:57.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.728+0000 7fe872400640 1 -- 172.21.15.46:0/3651887144 wait complete. 2024-03-04T08:49:57.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.730+0000 7fe872400640 1 Processor -- start 2024-03-04T08:49:57.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.731+0000 7fe872400640 1 -- start start 2024-03-04T08:49:57.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.732+0000 7fe872400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c0ce650 0x7fe86c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.732+0000 7fe872400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c154750 0x7fe86c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.732+0000 7fe872400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 0x7fe86c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.732+0000 7fe872400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c15a5b0 con 0x7fe86c154750 2024-03-04T08:49:57.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.732+0000 7fe872400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c15aec0 con 0x7fe86c156df0 2024-03-04T08:49:57.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.732+0000 7fe872400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c15b3e0 con 0x7fe86c0ce650 2024-03-04T08:49:57.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.734+0000 7faa66c00640 1 Processor -- start 2024-03-04T08:49:57.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.734+0000 7faa66c00640 1 -- start start 2024-03-04T08:49:57.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.736+0000 7faa66c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa600ca5e0 0x7faa600caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.736+0000 7faa66c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6015a8a0 con 0x7faa60154770 2024-03-04T08:49:57.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.736+0000 7faa66c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6015ab80 con 0x7faa600cca10 2024-03-04T08:49:57.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.736+0000 7faa66c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6015b420 con 0x7faa600ca5e0 2024-03-04T08:49:57.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88047070 con 0x7fed98154530 2024-03-04T08:49:57.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88037a40 con 0x7fed98154530 2024-03-04T08:49:57.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88037e10 con 0x7fed98154530 2024-03-04T08:49:57.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed980aaa20 con 0x7fed98154530 2024-03-04T08:49:57.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7f3479600640 1 -- 172.21.15.46:0/3907775340 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794669284 0 0) 0x7f347c0ccf10 con 0x7f347c15add0 2024-03-04T08:49:57.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7f3479600640 1 -- 172.21.15.46:0/3907775340 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3460003520 con 0x7f347c15add0 2024-03-04T08:49:57.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.739+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed981fff30 con 0x7fed98154530 2024-03-04T08:49:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.740+0000 7fe86be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 0x7fe86c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.740+0000 7fe86be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 0x7fe86c14dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:44016/0 (socket says 172.21.15.46:44016) 2024-03-04T08:49:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.740+0000 7fe86be00640 1 -- 172.21.15.46:0/1611388332 learned_addr learned my addr 172.21.15.46:0/1611388332 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.740+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed980680b0 con 0x7fed98154530 2024-03-04T08:49:57.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.741+0000 7faa5f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa600ca5e0 0x7faa600caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.741+0000 7faa5f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa600ca5e0 0x7faa600caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:44026/0 (socket says 172.21.15.46:44026) 2024-03-04T08:49:57.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.741+0000 7faa5f400640 1 -- 172.21.15.46:0/3900453317 learned_addr learned my addr 172.21.15.46:0/3900453317 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.745+0000 7fe86be00640 1 -- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c0ce650 msgr2=0x7fe86c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.745+0000 7fe86be00640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c0ce650 0x7fe86c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.745+0000 7fe86be00640 1 -- 172.21.15.46:0/1611388332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c154750 msgr2=0x7fe86c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.745+0000 7fe86be00640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c154750 0x7fe86c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.745+0000 7fe86be00640 1 -- 172.21.15.46:0/1611388332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c1576e0 con 0x7fe86c156df0 2024-03-04T08:49:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.747+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfac017070 con 0x7fcfc00c65c0 2024-03-04T08:49:57.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.748+0000 7fcfb7e00640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa006b700 0x7fcfa006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.749+0000 7fcfbfe00640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa006b700 0x7fcfa006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.749+0000 7faa5f400640 1 -- 172.21.15.46:0/3900453317 >> v1:172.21.15.73:6789/0 conn(0x7faa600cca10 legacy=0x7faa600ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.749+0000 7faa5f400640 1 -- 172.21.15.46:0/3900453317 >> v1:172.21.15.46:6789/0 conn(0x7faa60154770 legacy=0x7faa600ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.749+0000 7faa5f400640 1 -- 172.21.15.46:0/3900453317 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6015ae60 con 0x7faa600ca5e0 2024-03-04T08:49:57.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.749+0000 7fcfbfe00640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa006b700 0x7fcfa006dbc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036000 tx=0x7fcfb0039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.757+0000 7fe86be00640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 0x7fe86c14dff0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe86400cc30 tx=0x7fe86400a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.758+0000 7faa5f400640 1 --2- 172.21.15.46:0/3900453317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 0x7faa600caa50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3209779bcef21db8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.768+0000 7efc22800640 1 Processor -- start 2024-03-04T08:49:57.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.768+0000 7efc22800640 1 -- start start 2024-03-04T08:49:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.769+0000 7efc22800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc1c151f70 0x7efc1c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.770+0000 7efc22800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c06fe10 con 0x7efc1c152350 2024-03-04T08:49:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.770+0000 7efc22800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0c10b0 con 0x7efc1c15b700 2024-03-04T08:49:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.770+0000 7efc22800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0c0e80 con 0x7efc1c151f70 2024-03-04T08:49:57.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.859+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9cc0578d0 con 0x7fe9e0154750 2024-03-04T08:49:57.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.870+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe9cc059f30 con 0x7fe9e0154750 2024-03-04T08:49:57.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.876+0000 7f347a000640 1 --2- 172.21.15.46:0/3907775340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c15e320 0x7f347c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.883+0000 7f347a000640 1 -- 172.21.15.46:0/3907775340 >> v2:172.21.15.46:3300/0 conn(0x7f347c0cedc0 msgr2=0x7f347c0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:57.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.883+0000 7f347a000640 1 --2- 172.21.15.46:0/3907775340 >> v2:172.21.15.46:3300/0 conn(0x7f347c0cedc0 0x7f347c0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.883+0000 7f347a000640 1 -- 172.21.15.46:0/3907775340 >> v1:172.21.15.73:6789/0 conn(0x7f347c15add0 legacy=0x7f347c0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.884+0000 7f347a000640 1 -- 172.21.15.46:0/3907775340 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c0cfe30 con 0x7f347c15e320 2024-03-04T08:49:57.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.887+0000 7f347a000640 1 --2- 172.21.15.46:0/3907775340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c15e320 0x7f347c15a2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34680097a0 tx=0x7f346802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=713fcc4661fadc4a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.971+0000 7f3479600640 1 -- 172.21.15.46:0/3907775340 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468034070 con 0x7f347c15e320 2024-03-04T08:49:57.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.971+0000 7f3479600640 1 -- 172.21.15.46:0/3907775340 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3468030800 con 0x7f347c15e320 2024-03-04T08:49:57.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.971+0000 7f3479600640 1 -- 172.21.15.46:0/3907775340 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468030bd0 con 0x7f347c15e320 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.972+0000 7f347be00640 1 -- 172.21.15.46:0/3907775340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c15e320 msgr2=0x7f347c15a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.972+0000 7f347be00640 1 --2- 172.21.15.46:0/3907775340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c15e320 0x7f347c15a2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34680097a0 tx=0x7f346802b940 comp rx=0 tx=0).stop 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.973+0000 7f347be00640 1 -- 172.21.15.46:0/3907775340 shutdown_connections 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.973+0000 7f347be00640 1 --2- 172.21.15.46:0/3907775340 >> v2:172.21.15.46:3300/0 conn(0x7f347c0cedc0 0x7f347c0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.973+0000 7f347be00640 1 --2- 172.21.15.46:0/3907775340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c15e320 0x7f347c15a2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.973+0000 7f347be00640 1 -- 172.21.15.46:0/3907775340 >> 172.21.15.46:0/3907775340 conn(0x7f347c066c40 msgr2=0x7f347c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.973+0000 7f347be00640 1 -- 172.21.15.46:0/3907775340 shutdown_connections 2024-03-04T08:49:57.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.973+0000 7f347be00640 1 -- 172.21.15.46:0/3907775340 wait complete. 2024-03-04T08:49:57.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.976+0000 7f347be00640 1 Processor -- start 2024-03-04T08:49:57.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.976+0000 7f347be00640 1 -- start start 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.977+0000 7f347be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 0x7f347c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.977+0000 7f347be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347c15add0 0x7f347c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.977+0000 7f347be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f347c15e320 0x7f347c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.977+0000 7f347be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15d840 con 0x7f347c15add0 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.977+0000 7f347be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0d03f0 con 0x7f347c15e320 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.977+0000 7f347be00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15db20 con 0x7f347c0cedc0 2024-03-04T08:49:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.978+0000 7f347aa00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 0x7f347c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:57.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.978+0000 7f347aa00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 0x7f347c0b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37986/0 (socket says 172.21.15.46:37986) 2024-03-04T08:49:57.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.978+0000 7f347aa00640 1 -- 172.21.15.46:0/1769707403 learned_addr learned my addr 172.21.15.46:0/1769707403 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.981+0000 7f347aa00640 1 -- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f347c15e320 msgr2=0x7f347c15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.981+0000 7f347aa00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f347c15e320 0x7f347c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.981+0000 7f347aa00640 1 -- 172.21.15.46:0/1769707403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347c15add0 msgr2=0x7f347c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.981+0000 7f347aa00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347c15add0 0x7f347c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.982+0000 7f347aa00640 1 -- 172.21.15.46:0/1769707403 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c0b1b90 con 0x7f347c0cedc0 2024-03-04T08:49:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.985+0000 7f347aa00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 0x7f347c0b1430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f346c00c530 tx=0x7f346c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:57.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.989+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c017070 con 0x7f347c0cedc0 2024-03-04T08:49:57.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.989+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c005ce0 con 0x7f347c0cedc0 2024-03-04T08:49:57.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.989+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c0072b0 con 0x7f347c0cedc0 2024-03-04T08:49:57.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.990+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c0b1e80 con 0x7f347c0cedc0 2024-03-04T08:49:57.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.990+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c0af870 con 0x7f347c0cedc0 2024-03-04T08:49:57.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:57.992+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c0682c0 con 0x7f347c0cedc0 2024-03-04T08:49:58.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.015+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f346c01a070 con 0x7f347c0cedc0 2024-03-04T08:49:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.016+0000 7f3472a00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f345c06b520 0x7f345c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.017+0000 7f347a000640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f345c06b520 0x7f345c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.017+0000 7f347a000640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f345c06b520 0x7f345c06d9e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3468036000 tx=0x7f3468030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.018+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f346c056330 con 0x7f347c0cedc0 2024-03-04T08:49:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.026+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfac056840 con 0x7fcfc00c65c0 2024-03-04T08:49:58.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.027+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcfac058ea0 con 0x7fcfc00c65c0 2024-03-04T08:49:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.034+0000 7f8dc7400640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dac003a20 0x7f8dac003e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009890 tx=0x7f8dac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8d0278f3097199 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.037+0000 7efc1b400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc1c151f70 0x7efc1c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.041+0000 7efc1b400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc1c151f70 0x7efc1c158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47962/0 (socket says 172.21.15.46:47962) 2024-03-04T08:49:58.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.041+0000 7efc1b400640 1 -- 172.21.15.46:0/2430718603 learned_addr learned my addr 172.21.15.46:0/2430718603 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:58.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.050+0000 7efc1b400640 1 -- 172.21.15.46:0/2430718603 >> v1:172.21.15.73:6789/0 conn(0x7efc1c15b700 legacy=0x7efc1c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:58.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.050+0000 7efc1b400640 1 -- 172.21.15.46:0/2430718603 >> v1:172.21.15.46:6789/0 conn(0x7efc1c152350 legacy=0x7efc1c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:58.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.050+0000 7efc1b400640 1 -- 172.21.15.46:0/2430718603 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0c5040 con 0x7efc1c151f70 2024-03-04T08:49:58.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.055+0000 7efc1b400640 1 --2- 172.21.15.46:0/2430718603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c158b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c99d0 tx=0x7efc0c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13f11b9c250b4e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.065+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4037070 con 0x7f8dac003a20 2024-03-04T08:49:58.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.065+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db4032620 con 0x7f8dac003a20 2024-03-04T08:49:58.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.065+0000 7f8dc6000640 1 -- 172.21.15.46:0/2965591873 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4009460 con 0x7f8dac003a20 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.066+0000 7f8dce400640 1 -- 172.21.15.46:0/2965591873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dac003a20 msgr2=0x7f8dac003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.066+0000 7f8dce400640 1 --2- 172.21.15.46:0/2965591873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dac003a20 0x7f8dac003e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009890 tx=0x7f8dac005830 comp rx=0 tx=0).stop 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.066+0000 7f8dc7e00640 1 -- 172.21.15.46:0/2965591873 reap_dead start 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.066+0000 7f8dce400640 1 -- 172.21.15.46:0/2965591873 shutdown_connections 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.066+0000 7f8dce400640 1 -- 172.21.15.46:0/2965591873 >> 172.21.15.46:0/2965591873 conn(0x7f8dc806aff0 msgr2=0x7f8dc806b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.067+0000 7f8dce400640 1 -- 172.21.15.46:0/2965591873 shutdown_connections 2024-03-04T08:49:58.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.067+0000 7f8dce400640 1 -- 172.21.15.46:0/2965591873 wait complete. 2024-03-04T08:49:58.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.068+0000 7efc1a000640 1 -- 172.21.15.46:0/2430718603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c034070 con 0x7efc1c151f70 2024-03-04T08:49:58.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.068+0000 7efc1a000640 1 -- 172.21.15.46:0/2430718603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c030840 con 0x7efc1c151f70 2024-03-04T08:49:58.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.068+0000 7efc1a000640 1 -- 172.21.15.46:0/2430718603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c030c10 con 0x7efc1c151f70 2024-03-04T08:49:58.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.068+0000 7efc22800640 1 -- 172.21.15.46:0/2430718603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 msgr2=0x7efc1c158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.068+0000 7efc22800640 1 --2- 172.21.15.46:0/2430718603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c158b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c99d0 tx=0x7efc0c02b980 comp rx=0 tx=0).stop 2024-03-04T08:49:58.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.069+0000 7efc22800640 1 -- 172.21.15.46:0/2430718603 shutdown_connections 2024-03-04T08:49:58.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.069+0000 7efc22800640 1 --2- 172.21.15.46:0/2430718603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c158b20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.069+0000 7efc22800640 1 -- 172.21.15.46:0/2430718603 >> 172.21.15.46:0/2430718603 conn(0x7efc1c06aff0 msgr2=0x7efc1c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.069+0000 7efc22800640 1 -- 172.21.15.46:0/2430718603 shutdown_connections 2024-03-04T08:49:58.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.069+0000 7efc22800640 1 -- 172.21.15.46:0/2430718603 wait complete. 2024-03-04T08:49:58.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.069+0000 7f8dce400640 1 Processor -- start 2024-03-04T08:49:58.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.070+0000 7f8dce400640 1 -- start start 2024-03-04T08:49:58.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.071+0000 7f8dce400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dac003a20 0x7f8dc8147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.071+0000 7f8dce400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 0x7f8dc81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.071+0000 7f8dce400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dc814f4a0 0x7f8dc8154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.072+0000 7f8dce400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c43a0 con 0x7f8dc80c7110 2024-03-04T08:49:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.072+0000 7f8dce400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81597a0 con 0x7f8dc814f4a0 2024-03-04T08:49:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.072+0000 7efc22800640 1 Processor -- start 2024-03-04T08:49:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.072+0000 7efc22800640 1 -- start start 2024-03-04T08:49:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.072+0000 7f8dce400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8150510 con 0x7f8dac003a20 2024-03-04T08:49:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.072+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 0x7f8dc81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 0x7f8dc81544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47980/0 (socket says 172.21.15.46:47980) 2024-03-04T08:49:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7efc22800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7efc22800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1c152350 0x7efc1c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7efc22800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc1c15b700 0x7efc1c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7efc22800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0c1930 con 0x7efc1c151f70 2024-03-04T08:49:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7efc22800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0c1650 con 0x7efc1c152350 2024-03-04T08:49:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7efc22800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c158320 con 0x7efc1c15b700 2024-03-04T08:49:58.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.073+0000 7f8dc6a00640 1 -- 172.21.15.46:0/306055556 learned_addr learned my addr 172.21.15.46:0/306055556 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:58.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.074+0000 7efc1b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.078+0000 7f8dc6a00640 1 -- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dac003a20 msgr2=0x7f8dc8147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.078+0000 7f8dc6a00640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dac003a20 0x7f8dc8147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.078+0000 7f8dc6a00640 1 -- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dc814f4a0 msgr2=0x7f8dc8154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.078+0000 7f8dc6a00640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dc814f4a0 0x7f8dc8154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.079+0000 7f8dc6a00640 1 -- 172.21.15.46:0/306055556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc81ec5f0 con 0x7f8dc80c7110 2024-03-04T08:49:58.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.080+0000 7efc1b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47990/0 (socket says 172.21.15.46:47990) 2024-03-04T08:49:58.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.080+0000 7efc1b400640 1 -- 172.21.15.46:0/3546878762 learned_addr learned my addr 172.21.15.46:0/3546878762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:58.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.083+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe9e0155470 con 0x7fe9e0154750 2024-03-04T08:49:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.086+0000 7efc1b400640 1 -- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc1c15b700 msgr2=0x7efc1c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.086+0000 7efc1b400640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc1c15b700 0x7efc1c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.086+0000 7efc1b400640 1 -- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1c152350 msgr2=0x7efc1c0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.086+0000 7efc1b400640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1c152350 0x7efc1c0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.086+0000 7efc1b400640 1 -- 172.21.15.46:0/3546878762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0c9c70 con 0x7efc1c151f70 2024-03-04T08:49:58.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.087+0000 7f8dc6a00640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 0x7f8dc81544e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8db800b4a0 tx=0x7f8db800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.089+0000 7efc1b400640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c152a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009960 tx=0x7efc0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.095+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8014070 con 0x7f8dc80c7110 2024-03-04T08:49:58.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.095+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db8010610 con 0x7f8dc80c7110 2024-03-04T08:49:58.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.095+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db80109e0 con 0x7f8dc80c7110 2024-03-04T08:49:58.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.095+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc81592c0 con 0x7f8dc80c7110 2024-03-04T08:49:58.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.095+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc8148040 con 0x7f8dc80c7110 2024-03-04T08:49:58.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.096+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc8157af0 con 0x7f8dc80c7110 2024-03-04T08:49:58.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.099+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c034040 con 0x7efc1c151f70 2024-03-04T08:49:58.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.099+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c039d90 con 0x7efc1c151f70 2024-03-04T08:49:58.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.099+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0435f0 con 0x7efc1c151f70 2024-03-04T08:49:58.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.099+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c0c9f50 con 0x7efc1c151f70 2024-03-04T08:49:58.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.099+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c149d80 con 0x7efc1c151f70 2024-03-04T08:49:58.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.101+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c0680b0 con 0x7efc1c151f70 2024-03-04T08:49:58.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.152+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed8804a070 con 0x7fed98154530 2024-03-04T08:49:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.153+0000 7fed8f400640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed7806b520 0x7fed7806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.154+0000 7fed97400640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed7806b520 0x7fed7806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.154+0000 7fed97400640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed7806b520 0x7fed7806d9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed90001f10 tx=0x7fed90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.159+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed88078c70 con 0x7fed98154530 2024-03-04T08:49:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.178+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed88051020 con 0x7fed98154530 2024-03-04T08:49:58.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.189+0000 7faa5ea00640 1 -- 172.21.15.46:0/3900453317 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c02e070 con 0x7faa600ca5e0 2024-03-04T08:49:58.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.189+0000 7faa5ea00640 1 -- 172.21.15.46:0/3900453317 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c037070 con 0x7faa600ca5e0 2024-03-04T08:49:58.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.189+0000 7faa5ea00640 1 -- 172.21.15.46:0/3900453317 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c031a00 con 0x7faa600ca5e0 2024-03-04T08:49:58.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 -- 172.21.15.46:0/3900453317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 msgr2=0x7faa600caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 --2- 172.21.15.46:0/3900453317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 0x7faa600caa50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c02b880 comp rx=0 tx=0).stop 2024-03-04T08:49:58.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 -- 172.21.15.46:0/3900453317 shutdown_connections 2024-03-04T08:49:58.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 --2- 172.21.15.46:0/3900453317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 0x7faa600caa50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 -- 172.21.15.46:0/3900453317 >> 172.21.15.46:0/3900453317 conn(0x7faa600b1790 msgr2=0x7faa600b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 -- 172.21.15.46:0/3900453317 shutdown_connections 2024-03-04T08:49:58.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.190+0000 7faa66c00640 1 -- 172.21.15.46:0/3900453317 wait complete. 2024-03-04T08:49:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.191+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86400ce40 con 0x7fe86c156df0 2024-03-04T08:49:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.191+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864003990 con 0x7fe86c156df0 2024-03-04T08:49:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.191+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864003d60 con 0x7fe86c156df0 2024-03-04T08:49:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.191+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c1579c0 con 0x7fe86c156df0 2024-03-04T08:49:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.192+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c0c5020 con 0x7fe86c156df0 2024-03-04T08:49:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.193+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c0680b0 con 0x7fe86c156df0 2024-03-04T08:49:58.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.193+0000 7faa66c00640 1 Processor -- start 2024-03-04T08:49:58.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.194+0000 7faa66c00640 1 -- start start 2024-03-04T08:49:58.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.195+0000 7faa66c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 0x7faa6014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.195+0000 7faa66c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 0x7faa6014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.195+0000 7faa66c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa60154770 0x7faa600c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.195+0000 7faa66c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa600ce000 con 0x7faa60154770 2024-03-04T08:49:58.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.195+0000 7faa66c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa600cc4f0 con 0x7faa600ca5e0 2024-03-04T08:49:58.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.195+0000 7faa66c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa60154b50 con 0x7faa600cca10 2024-03-04T08:49:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.319+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f346c021020 con 0x7f347c0cedc0 2024-03-04T08:49:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.331+0000 7fe9d7e00640 1 -- 172.21.15.46:0/4136522771 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9cc059830 con 0x7fe9e0154750 2024-03-04T08:49:58.327 INFO:teuthology.orchestra.run.smithi046.stdout:60129542155 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9c006b520 msgr2=0x7fe9c006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9c006b520 0x7fe9c006d9e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9d003d000 tx=0x7fe9d0038000 comp rx=0 tx=0).stop 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 msgr2=0x7fe9e014dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e014dff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d620 tx=0x7fe9cc00dae0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 shutdown_connections 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe9c006b520 0x7fe9c006d9e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9e00afce0 0x7fe9e014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9e0154750 0x7fe9e014dff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 --2- 172.21.15.46:0/4136522771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9e00ce650 0x7fe9e00cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.334+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 >> 172.21.15.46:0/4136522771 conn(0x7fe9e0066c40 msgr2=0x7fe9e0067020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.335+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 shutdown_connections 2024-03-04T08:49:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.335+0000 7fe9e7000640 1 -- 172.21.15.46:0/4136522771 wait complete. 2024-03-04T08:49:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.337+0000 7faa5f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 0x7faa6014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.337+0000 7faa5f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 0x7faa6014c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38012/0 (socket says 172.21.15.46:38012) 2024-03-04T08:49:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.337+0000 7faa5f400640 1 -- 172.21.15.46:0/2595848003 learned_addr learned my addr 172.21.15.46:0/2595848003 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.342+0000 7faa5f400640 1 -- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 msgr2=0x7faa6014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.342+0000 7faa5f400640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 0x7faa6014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.342+0000 7faa5f400640 1 -- 172.21.15.46:0/2595848003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa60154770 msgr2=0x7faa600c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.342+0000 7faa5f400640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa60154770 0x7faa600c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.342+0000 7faa5f400640 1 -- 172.21.15.46:0/2595848003 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600c9600 con 0x7faa600cca10 2024-03-04T08:49:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.345+0000 7faa5f400640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 0x7faa6014c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.349+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c031ed0 con 0x7faa600cca10 2024-03-04T08:49:58.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.349+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c032880 con 0x7faa600cca10 2024-03-04T08:49:58.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.350+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c032c70 con 0x7faa600cca10 2024-03-04T08:49:58.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.351+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa600c98a0 con 0x7faa600cca10 2024-03-04T08:49:58.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.351+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa600c9e60 con 0x7faa600cca10 2024-03-04T08:49:58.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.353+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa60074df0 con 0x7faa600cca10 2024-03-04T08:49:58.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.4 2024-03-04T08:49:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.364+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfc004f3a0 con 0x7fcfc00c65c0 2024-03-04T08:49:58.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.441+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8db8017070 con 0x7f8dc80c7110 2024-03-04T08:49:58.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.442+0000 7f8dbf400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8da806b500 0x7f8da806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.442+0000 7f8dc7400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8da806b500 0x7f8da806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.443+0000 7f8dc7400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8da806b500 0x7f8da806d9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8db4034000 tx=0x7f8db402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.449+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fed980c74b0 con 0x7fed98154530 2024-03-04T08:49:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.456+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8db8056870 con 0x7f8dc80c7110 2024-03-04T08:49:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.456+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8dc8157af0 con 0x7f8dc80c7110 2024-03-04T08:49:58.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.584+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f347c0af2a0 con 0x7f347c0cedc0 2024-03-04T08:49:58.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.619+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe864003f00 con 0x7fe86c156df0 2024-03-04T08:49:58.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.620+0000 7fe863400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe84806b520 0x7fe84806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.621+0000 7fe86b400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe84806b520 0x7fe84806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.622+0000 7fe86b400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe84806b520 0x7fe84806d9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe854009710 tx=0x7fe854006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.624+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8640572e0 con 0x7fe86c156df0 2024-03-04T08:49:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.637+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faa4c04d3f0 con 0x7faa600cca10 2024-03-04T08:49:58.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.638+0000 7faa57e00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7faa4006b550 0x7faa4006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.639+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa4c077390 con 0x7faa600cca10 2024-03-04T08:49:58.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.639+0000 7faa5fe00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7faa4006b550 0x7faa4006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.639+0000 7faa5fe00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7faa4006b550 0x7faa4006da10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa50001560 tx=0x7faa50007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.650+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faa4c040070 con 0x7faa600cca10 2024-03-04T08:49:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.655+0000 7f3472a00640 1 -- 172.21.15.46:0/1769707403 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f346c058990 con 0x7f347c0cedc0 2024-03-04T08:49:58.652 INFO:teuthology.orchestra.run.smithi046.stdout:64424509450 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f345c06b520 msgr2=0x7f345c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f345c06b520 0x7f345c06d9e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3468036000 tx=0x7f3468030000 comp rx=0 tx=0).stop 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 msgr2=0x7f347c0b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 0x7f347c0b1430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f346c00c530 tx=0x7f346c00c9f0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 shutdown_connections 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f345c06b520 0x7f345c06d9e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f347c15e320 0x7f347c15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347c15add0 0x7f347c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 --2- 172.21.15.46:0/1769707403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f347c0cedc0 0x7f347c0b1430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 >> 172.21.15.46:0/1769707403 conn(0x7f347c066c40 msgr2=0x7f347c067020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.659+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 shutdown_connections 2024-03-04T08:49:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.660+0000 7f347be00640 1 -- 172.21.15.46:0/1769707403 wait complete. 2024-03-04T08:49:58.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.668+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe864014030 con 0x7fe86c156df0 2024-03-04T08:49:58.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-03-04T08:49:58.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.691+0000 7fed8f400640 1 -- 172.21.15.46:0/2155508361 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed8807abd0 con 0x7fed98154530 2024-03-04T08:49:58.688 INFO:teuthology.orchestra.run.smithi046.stdout:60129542155 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed7806b520 msgr2=0x7fed7806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed7806b520 0x7fed7806d9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed90001f10 tx=0x7fed90009040 comp rx=0 tx=0).stop 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 msgr2=0x7fed981fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 0x7fed981fcf20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fed8802c090 tx=0x7fed88004730 comp rx=0 tx=0).stop 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 shutdown_connections 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed7806b520 0x7fed7806d9e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed98154530 0x7fed981fcf20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed980c8850 0x7fed981fc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 --2- 172.21.15.46:0/2155508361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed980c11f0 0x7fed980c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.695+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 >> 172.21.15.46:0/2155508361 conn(0x7fed9806aff0 msgr2=0x7fed980caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.696+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 shutdown_connections 2024-03-04T08:49:58.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.696+0000 7fed9e000640 1 -- 172.21.15.46:0/2155508361 wait complete. 2024-03-04T08:49:58.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542155 for osd.5 2024-03-04T08:49:58.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.747+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8dc804f3a0 con 0x7f8dc80c7110 2024-03-04T08:49:58.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.799+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc0c037070 con 0x7efc1c151f70 2024-03-04T08:49:58.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.800+0000 7efc13400640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efbfc06b550 0x7efbfc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:58.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.800+0000 7efc1aa00640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efbfc06b550 0x7efbfc06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:58.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.801+0000 7efc1aa00640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efbfc06b550 0x7efbfc06da10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c5010 tx=0x7efc08007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:58.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.831+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc0c079200 con 0x7efc1c151f70 2024-03-04T08:49:58.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.832+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efc0c03e070 con 0x7efc1c151f70 2024-03-04T08:49:58.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.867+0000 7f8dbf400640 1 -- 172.21.15.46:0/306055556 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8db8058ed0 con 0x7f8dc80c7110 2024-03-04T08:49:58.865 INFO:teuthology.orchestra.run.smithi046.stdout:60129542154 2024-03-04T08:49:58.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8da806b500 msgr2=0x7f8da806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8da806b500 0x7f8da806d9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8db4034000 tx=0x7f8db402f000 comp rx=0 tx=0).stop 2024-03-04T08:49:58.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 msgr2=0x7f8dc81544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 0x7f8dc81544e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8db800b4a0 tx=0x7f8db800b960 comp rx=0 tx=0).stop 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 shutdown_connections 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8da806b500 0x7f8da806d9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dc814f4a0 0x7f8dc8154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dc80c7110 0x7f8dc81544e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 --2- 172.21.15.46:0/306055556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8dac003a20 0x7f8dc8147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.871+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 >> 172.21.15.46:0/306055556 conn(0x7f8dc806aff0 msgr2=0x7f8dc81482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.872+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 shutdown_connections 2024-03-04T08:49:58.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.872+0000 7f8dce400640 1 -- 172.21.15.46:0/306055556 wait complete. 2024-03-04T08:49:58.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.7 2024-03-04T08:49:58.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.898+0000 7fcfb7e00640 1 -- 172.21.15.46:0/862283078 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfac0587a0 con 0x7fcfc00c65c0 2024-03-04T08:49:58.895 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:49:58.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa006b700 msgr2=0x7fcfa006dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa006b700 0x7fcfa006dbc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036000 tx=0x7fcfb0039040 comp rx=0 tx=0).stop 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 msgr2=0x7fcfc015c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 0x7fcfc015c5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00b4d0 tx=0x7fcfac00b990 comp rx=0 tx=0).stop 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 shutdown_connections 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa006b700 0x7fcfa006dbc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc01545d0 0x7fcfc01fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc00c65c0 0x7fcfc015c5f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 --2- 172.21.15.46:0/862283078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc006fc60 0x7fcfc00c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 >> 172.21.15.46:0/862283078 conn(0x7fcfc006b1d0 msgr2=0x7fcfc0151230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 shutdown_connections 2024-03-04T08:49:58.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.903+0000 7fcfc5600640 1 -- 172.21.15.46:0/862283078 wait complete. 2024-03-04T08:49:58.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2024-03-04T08:49:58.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.957+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faa60074df0 con 0x7faa600cca10 2024-03-04T08:49:58.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.961+0000 7faa57e00640 1 -- 172.21.15.46:0/2595848003 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa4c07ad20 con 0x7faa600cca10 2024-03-04T08:49:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:60129542154 2024-03-04T08:49:58.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.963+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7faa4006b550 msgr2=0x7faa4006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.963+0000 7faa66c00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7faa4006b550 0x7faa4006da10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa50001560 tx=0x7faa50007990 comp rx=0 tx=0).stop 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.963+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 msgr2=0x7faa6014c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.963+0000 7faa66c00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 0x7faa6014c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.963+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 shutdown_connections 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7faa4006b550 0x7faa4006da10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa60154770 0x7faa600c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa600cca10 0x7faa6014c270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 --2- 172.21.15.46:0/2595848003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa600ca5e0 0x7faa6014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 >> 172.21.15.46:0/2595848003 conn(0x7faa600b1790 msgr2=0x7faa6006c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 shutdown_connections 2024-03-04T08:49:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:58.964+0000 7faa66c00640 1 -- 172.21.15.46:0/2595848003 wait complete. 2024-03-04T08:49:58.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.6 2024-03-04T08:49:59.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.070+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe86c157420 con 0x7fe86c156df0 2024-03-04T08:49:59.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.119+0000 7fe863400640 1 -- 172.21.15.46:0/1611388332 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe864059940 con 0x7fe86c156df0 2024-03-04T08:49:59.117 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:49:59.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe84806b520 msgr2=0x7fe84806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe84806b520 0x7fe84806d9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe854009710 tx=0x7fe854006c90 comp rx=0 tx=0).stop 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 msgr2=0x7fe86c14dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 0x7fe86c14dff0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe86400cc30 tx=0x7fe86400a5c0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 shutdown_connections 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fe84806b520 0x7fe84806d9e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86c156df0 0x7fe86c14dff0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c154750 0x7fe86c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 --2- 172.21.15.46:0/1611388332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86c0ce650 0x7fe86c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 >> 172.21.15.46:0/1611388332 conn(0x7fe86c066c40 msgr2=0x7fe86c151e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:59.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 shutdown_connections 2024-03-04T08:49:59.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.123+0000 7fe872400640 1 -- 172.21.15.46:0/1611388332 wait complete. 2024-03-04T08:49:59.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-03-04T08:49:59.137 DEBUG:teuthology.parallel:result is None 2024-03-04T08:49:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.165+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc1c0c6950 con 0x7efc1c151f70 2024-03-04T08:49:59.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.217+0000 7efc13400640 1 -- 172.21.15.46:0/3546878762 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc0c07b860 con 0x7efc1c151f70 2024-03-04T08:49:59.214 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efbfc06b550 msgr2=0x7efbfc06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efbfc06b550 0x7efbfc06da10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c5010 tx=0x7efc08007990 comp rx=0 tx=0).stop 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 msgr2=0x7efc1c152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c152a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009960 tx=0x7efc0c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 shutdown_connections 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efbfc06b550 0x7efbfc06da10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1c152350 0x7efc1c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc1c15b700 0x7efc1c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 --2- 172.21.15.46:0/3546878762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc1c151f70 0x7efc1c152a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 >> 172.21.15.46:0/3546878762 conn(0x7efc1c06aff0 msgr2=0x7efc1c157180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:59.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 shutdown_connections 2024-03-04T08:49:59.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.220+0000 7efc22800640 1 -- 172.21.15.46:0/3546878762 wait complete. 2024-03-04T08:49:59.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-03-04T08:49:59.234 DEBUG:teuthology.parallel:result is None 2024-03-04T08:49:59.357 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T08:49:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.561+0000 7f610e800640 1 Processor -- start 2024-03-04T08:49:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.561+0000 7f610e800640 1 -- start start 2024-03-04T08:49:59.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.563+0000 7f610e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6108154b30 0x7f61080ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.563+0000 7f610e800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 0x7f61080cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.563+0000 7f610e800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61080ca6d0 con 0x7f6108154750 2024-03-04T08:49:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.563+0000 7f610e800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080ca990 con 0x7f6108154b30 2024-03-04T08:49:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.563+0000 7f610e800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080cac70 con 0x7f61080ce650 2024-03-04T08:49:59.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.564+0000 7f6107e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 0x7f61080cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.564+0000 7f6106a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6108154b30 0x7f61080ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.564+0000 7f6107e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 0x7f61080cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38028/0 (socket says 172.21.15.46:38028) 2024-03-04T08:49:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.564+0000 7f6107e00640 1 -- 172.21.15.46:0/3163287464 learned_addr learned my addr 172.21.15.46:0/3163287464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.567+0000 7f6107e00640 1 -- 172.21.15.46:0/3163287464 >> v2:172.21.15.46:3300/0 conn(0x7f6108154b30 msgr2=0x7f61080ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.567+0000 7f6107e00640 1 --2- 172.21.15.46:0/3163287464 >> v2:172.21.15.46:3300/0 conn(0x7f6108154b30 0x7f61080ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.567+0000 7f6107e00640 1 -- 172.21.15.46:0/3163287464 >> v1:172.21.15.46:6789/0 conn(0x7f6108154750 legacy=0x7f61080cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.567+0000 7f6107e00640 1 -- 172.21.15.46:0/3163287464 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610815a900 con 0x7f61080ce650 2024-03-04T08:49:59.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.571+0000 7f6107e00640 1 --2- 172.21.15.46:0/3163287464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 0x7f61080cc700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6100009e50 tx=0x7f610002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d8c3917abc1e407 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.575+0000 7f6106000640 1 -- 172.21.15.46:0/3163287464 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610002cb90 con 0x7f61080ce650 2024-03-04T08:49:59.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.575+0000 7f6106000640 1 -- 172.21.15.46:0/3163287464 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610002cd30 con 0x7f61080ce650 2024-03-04T08:49:59.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.575+0000 7f6106000640 1 -- 172.21.15.46:0/3163287464 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100034610 con 0x7f61080ce650 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.575+0000 7f610e800640 1 -- 172.21.15.46:0/3163287464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 msgr2=0x7f61080cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.575+0000 7f610e800640 1 --2- 172.21.15.46:0/3163287464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 0x7f61080cc700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6100009e50 tx=0x7f610002bff0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.576+0000 7f610e800640 1 -- 172.21.15.46:0/3163287464 shutdown_connections 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.576+0000 7f610e800640 1 --2- 172.21.15.46:0/3163287464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080ce650 0x7f61080cc700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.576+0000 7f610e800640 1 --2- 172.21.15.46:0/3163287464 >> v2:172.21.15.46:3300/0 conn(0x7f6108154b30 0x7f61080ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.576+0000 7f610e800640 1 -- 172.21.15.46:0/3163287464 >> 172.21.15.46:0/3163287464 conn(0x7f6108066c40 msgr2=0x7f6108067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.576+0000 7f610e800640 1 -- 172.21.15.46:0/3163287464 shutdown_connections 2024-03-04T08:49:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.576+0000 7f610e800640 1 -- 172.21.15.46:0/3163287464 wait complete. 2024-03-04T08:49:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.577+0000 7f610e800640 1 Processor -- start 2024-03-04T08:49:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.577+0000 7f610e800640 1 -- start start 2024-03-04T08:49:59.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.578+0000 7f610e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61080ce650 0x7f610814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.578+0000 7f610e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 0x7f61080b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.578+0000 7f610e800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080b2400 0x7f61080b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.578+0000 7f610e800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610815a5b0 con 0x7f6108154750 2024-03-04T08:49:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.578+0000 7f610e800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610815aec0 con 0x7f61080ce650 2024-03-04T08:49:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.578+0000 7f610e800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610815b3e0 con 0x7f61080b2400 2024-03-04T08:49:59.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.579+0000 7f6107e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080b2400 0x7f61080b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.579+0000 7f6106a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 0x7f61080b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.579+0000 7f6107400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61080ce650 0x7f610814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.579+0000 7f6106a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 0x7f61080b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48024/0 (socket says 172.21.15.46:48024) 2024-03-04T08:49:59.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.579+0000 7f6106a00640 1 -- 172.21.15.46:0/2500559177 learned_addr learned my addr 172.21.15.46:0/2500559177 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.583+0000 7f6106a00640 1 -- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080b2400 msgr2=0x7f61080b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.583+0000 7f6106a00640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080b2400 0x7f61080b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.583+0000 7f6106a00640 1 -- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61080ce650 msgr2=0x7f610814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.583+0000 7f6106a00640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61080ce650 0x7f610814fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.583+0000 7f6106a00640 1 -- 172.21.15.46:0/2500559177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61081f0b40 con 0x7f6108154750 2024-03-04T08:49:59.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.585+0000 7f6106a00640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 0x7f61080b00f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60f400e870 tx=0x7f60f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.591+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4017070 con 0x7f6108154750 2024-03-04T08:49:59.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.591+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f400c940 con 0x7f6108154750 2024-03-04T08:49:59.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.591+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400cd30 con 0x7f6108154750 2024-03-04T08:49:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.591+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61081f0e20 con 0x7f6108154750 2024-03-04T08:49:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.591+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61080b1c90 con 0x7f6108154750 2024-03-04T08:49:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.592+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61080680b0 con 0x7f6108154750 2024-03-04T08:49:59.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.624+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60f401a070 con 0x7f6108154750 2024-03-04T08:49:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.625+0000 7f60ff400640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f60e806b520 0x7f60e806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.626+0000 7f6107400640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f60e806b520 0x7f60e806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.626+0000 7f6107400640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f60e806b520 0x7f60e806d9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60f8001780 tx=0x7f60f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.629+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60f4057090 con 0x7f6108154750 2024-03-04T08:49:59.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T08:49:59.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T08:49:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.891+0000 7f380ce00640 1 Processor -- start 2024-03-04T08:49:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.891+0000 7f380ce00640 1 -- start start 2024-03-04T08:49:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.893+0000 7f380ce00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f380815a3c0 0x7f38080cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.893+0000 7f380ce00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f38080cb3a0 0x7f380806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.893+0000 7f380ce00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380815a870 con 0x7f3808154600 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.893+0000 7f380ce00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080cb8f0 con 0x7f38080cb3a0 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.893+0000 7f380ce00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38080cb190 con 0x7f380815a3c0 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.894+0000 7f3807400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3808154600 0x7f38080cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49748/0 (socket says 172.21.15.46:49748) 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.894+0000 7f3807400640 1 -- 172.21.15.46:0/1114759202 learned_addr learned my addr 172.21.15.46:0/1114759202 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.894+0000 7f3806a00640 1 --2- 172.21.15.46:0/1114759202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f380815a3c0 0x7f38080cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.897+0000 7f3806a00640 1 -- 172.21.15.46:0/1114759202 >> v2:172.21.15.46:3300/0 conn(0x7f38080cb3a0 msgr2=0x7f380806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.897+0000 7f3806a00640 1 --2- 172.21.15.46:0/1114759202 >> v2:172.21.15.46:3300/0 conn(0x7f38080cb3a0 0x7f380806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.897+0000 7f3806a00640 1 -- 172.21.15.46:0/1114759202 >> v1:172.21.15.73:6789/0 conn(0x7f3808154600 legacy=0x7f38080cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.897+0000 7f3806a00640 1 -- 172.21.15.46:0/1114759202 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380815ab50 con 0x7f380815a3c0 2024-03-04T08:49:59.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T08:49:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.900+0000 7f3806a00640 1 --2- 172.21.15.46:0/1114759202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f380815a3c0 0x7f38080cac50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097a0 tx=0x7f37f402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae296049846468 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.903+0000 7f3806000640 1 -- 172.21.15.46:0/1114759202 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4034070 con 0x7f380815a3c0 2024-03-04T08:49:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.903+0000 7f3806000640 1 -- 172.21.15.46:0/1114759202 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4030800 con 0x7f380815a3c0 2024-03-04T08:49:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.903+0000 7f3806000640 1 -- 172.21.15.46:0/1114759202 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4030bd0 con 0x7f380815a3c0 2024-03-04T08:49:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.904+0000 7f380ce00640 1 -- 172.21.15.46:0/1114759202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f380815a3c0 msgr2=0x7f38080cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.904+0000 7f380ce00640 1 --2- 172.21.15.46:0/1114759202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f380815a3c0 0x7f38080cac50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097a0 tx=0x7f37f402b940 comp rx=0 tx=0).stop 2024-03-04T08:49:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.905+0000 7f380ce00640 1 -- 172.21.15.46:0/1114759202 shutdown_connections 2024-03-04T08:49:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.905+0000 7f380ce00640 1 --2- 172.21.15.46:0/1114759202 >> v2:172.21.15.46:3300/0 conn(0x7f38080cb3a0 0x7f380806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.905+0000 7f380ce00640 1 --2- 172.21.15.46:0/1114759202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f380815a3c0 0x7f38080cac50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.905+0000 7f380ce00640 1 -- 172.21.15.46:0/1114759202 >> 172.21.15.46:0/1114759202 conn(0x7f38080b17c0 msgr2=0x7f38080b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.905+0000 7f380ce00640 1 -- 172.21.15.46:0/1114759202 shutdown_connections 2024-03-04T08:49:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.905+0000 7f380ce00640 1 -- 172.21.15.46:0/1114759202 wait complete. 2024-03-04T08:49:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.907+0000 7f380ce00640 1 Processor -- start 2024-03-04T08:49:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.907+0000 7f380ce00640 1 -- start start 2024-03-04T08:49:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.909+0000 7f380ce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38080cb3a0 0x7f380815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.909+0000 7f380ce00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 0x7f380815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.909+0000 7f380ce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38080b5380 0x7f380815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.909+0000 7f380ce00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080cd9d0 con 0x7f38080cb3a0 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.909+0000 7f380ce00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380815b110 con 0x7f38080b5380 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.909+0000 7f380ce00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38081549e0 con 0x7f3808154600 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.910+0000 7f3806a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 0x7f380815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.910+0000 7f3807e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38080b5380 0x7f380815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.910+0000 7f3806a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 0x7f380815c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38070/0 (socket says 172.21.15.46:38070) 2024-03-04T08:49:59.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.910+0000 7f3806a00640 1 -- 172.21.15.46:0/3715731184 learned_addr learned my addr 172.21.15.46:0/3715731184 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.914+0000 7f3806a00640 1 -- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38080b5380 msgr2=0x7f380815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.914+0000 7f3806a00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38080b5380 0x7f380815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.914+0000 7f3806a00640 1 -- 172.21.15.46:0/3715731184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38080cb3a0 msgr2=0x7f380815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.914+0000 7f3806a00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38080cb3a0 0x7f380815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.914+0000 7f3806a00640 1 -- 172.21.15.46:0/3715731184 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38081f1240 con 0x7f3808154600 2024-03-04T08:49:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.914+0000 7f3807e00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38080b5380 0x7f380815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:49:59.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.917+0000 7f3806a00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 0x7f380815c380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098c0 tx=0x7f37f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.921+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4034040 con 0x7f3808154600 2024-03-04T08:49:59.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.921+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4030600 con 0x7f3808154600 2024-03-04T08:49:59.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.921+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40423f0 con 0x7f3808154600 2024-03-04T08:49:59.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.923+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38081e5c10 con 0x7f3808154600 2024-03-04T08:49:59.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.923+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38081505d0 con 0x7f3808154600 2024-03-04T08:49:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.924+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3808075240 con 0x7f3808154600 2024-03-04T08:49:59.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T08:49:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.938+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f60f4058ff0 con 0x7f6108154750 2024-03-04T08:49:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.954+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37f4037070 con 0x7f3808154600 2024-03-04T08:49:59.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.956+0000 7f37ff400640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f37e806b550 0x7f37e806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.956+0000 7f3807400640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f37e806b550 0x7f37e806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.958+0000 7f3807400640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f37e806b550 0x7f37e806da10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37f8001550 tx=0x7f37f8007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.969+0000 7fb2a5a00640 1 Processor -- start 2024-03-04T08:49:59.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.969+0000 7fb2a5a00640 1 -- start start 2024-03-04T08:49:59.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.970+0000 7fb2a5a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2a0154b30 0x7fb2a00ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.971+0000 7fb2a5a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb2a00ce650 0x7fb2a00cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.971+0000 7fb2a5a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a00ca6d0 con 0x7fb2a0154750 2024-03-04T08:49:59.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.971+0000 7fb2a5a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00ca990 con 0x7fb2a00ce650 2024-03-04T08:49:59.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.971+0000 7fb2a5a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00cac70 con 0x7fb2a0154b30 2024-03-04T08:49:59.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.971+0000 7fb29ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb2a0154750 0x7fb2a00cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49764/0 (socket says 172.21.15.46:49764) 2024-03-04T08:49:59.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.971+0000 7fb29ea00640 1 -- 172.21.15.46:0/3123847093 learned_addr learned my addr 172.21.15.46:0/3123847093 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:49:59.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.972+0000 7fb29f400640 1 --2- 172.21.15.46:0/3123847093 >> v2:172.21.15.46:3300/0 conn(0x7fb2a00ce650 0x7fb2a00cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.972+0000 7fb29e000640 1 --2- 172.21.15.46:0/3123847093 >> v2:172.21.15.73:3300/0 conn(0x7fb2a0154b30 0x7fb2a00ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.974+0000 7fb29f400640 1 -- 172.21.15.46:0/3123847093 >> v2:172.21.15.73:3300/0 conn(0x7fb2a0154b30 msgr2=0x7fb2a00ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:49:59.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.974+0000 7fb29f400640 1 --2- 172.21.15.46:0/3123847093 >> v2:172.21.15.73:3300/0 conn(0x7fb2a0154b30 0x7fb2a00ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.974+0000 7fb29f400640 1 -- 172.21.15.46:0/3123847093 >> v1:172.21.15.73:6789/0 conn(0x7fb2a0154750 legacy=0x7fb2a00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.975+0000 7fb29d600640 1 -- 172.21.15.46:0/3123847093 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259495814 0 0) 0x7fb2a00ca6d0 con 0x7fb2a0154750 2024-03-04T08:49:59.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.975+0000 7fb29f400640 1 -- 172.21.15.46:0/3123847093 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a015a900 con 0x7fb2a00ce650 2024-03-04T08:49:59.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.977+0000 7fb29f400640 1 --2- 172.21.15.46:0/3123847093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a00ce650 0x7fb2a00cc700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2a008d890 tx=0x7fb29802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fa0224095fd242 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.982+0000 7fb29d600640 1 -- 172.21.15.46:0/3123847093 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298039070 con 0x7fb2a00ce650 2024-03-04T08:49:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.982+0000 7fb29d600640 1 -- 172.21.15.46:0/3123847093 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29802cd10 con 0x7fb2a00ce650 2024-03-04T08:49:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.982+0000 7fb29d600640 1 -- 172.21.15.46:0/3123847093 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298034660 con 0x7fb2a00ce650 2024-03-04T08:49:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.982+0000 7fb2a5a00640 1 -- 172.21.15.46:0/3123847093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a00ce650 msgr2=0x7fb2a00cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.982+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/3123847093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a00ce650 0x7fb2a00cc700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2a008d890 tx=0x7fb29802bf60 comp rx=0 tx=0).stop 2024-03-04T08:49:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.983+0000 7fb2a5a00640 1 -- 172.21.15.46:0/3123847093 shutdown_connections 2024-03-04T08:49:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.983+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/3123847093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a00ce650 0x7fb2a00cc700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.983+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/3123847093 >> v2:172.21.15.73:3300/0 conn(0x7fb2a0154b30 0x7fb2a00ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.983+0000 7fb2a5a00640 1 -- 172.21.15.46:0/3123847093 >> 172.21.15.46:0/3123847093 conn(0x7fb2a0066c40 msgr2=0x7fb2a0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:49:59.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T08:49:59.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.983+0000 7fb2a5a00640 1 -- 172.21.15.46:0/3123847093 shutdown_connections 2024-03-04T08:49:59.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.983+0000 7fb2a5a00640 1 -- 172.21.15.46:0/3123847093 wait complete. 2024-03-04T08:49:59.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.986+0000 7fb2a5a00640 1 Processor -- start 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.987+0000 7fb2a5a00640 1 -- start start 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.988+0000 7fb2a5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 0x7fb2a00c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.988+0000 7fb2a5a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0154750 0x7fb2a00b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.988+0000 7fb2a5a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2a00b0c30 0x7fb2a01f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.988+0000 7fb2a5a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a015a5b0 con 0x7fb2a0154750 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.988+0000 7fb2a5a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a015aec0 con 0x7fb2a00ce650 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.988+0000 7fb2a5a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a015b3e0 con 0x7fb2a00b0c30 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.989+0000 7fb29ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 0x7fb2a00c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.989+0000 7fb29ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 0x7fb2a00c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:44098/0 (socket says 172.21.15.46:44098) 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.989+0000 7fb29ea00640 1 -- 172.21.15.46:0/4139203782 learned_addr learned my addr 172.21.15.46:0/4139203782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:49:59.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.989+0000 7fb29e000640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0154750 0x7fb2a00b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:49:59.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.995+0000 7fb29ea00640 1 -- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2a00b0c30 msgr2=0x7fb2a01f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.995+0000 7fb29ea00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2a00b0c30 0x7fb2a01f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.995+0000 7fb29ea00640 1 -- 172.21.15.46:0/4139203782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0154750 msgr2=0x7fb2a00b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:49:59.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.995+0000 7fb29ea00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0154750 0x7fb2a00b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:49:59.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.995+0000 7fb29ea00640 1 -- 172.21.15.46:0/4139203782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00c9e90 con 0x7fb2a00ce650 2024-03-04T08:49:59.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:49:59.996+0000 7fb29ea00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 0x7fb2a00c39e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c4d0 tx=0x7fb29000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:49:59.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.001+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290018070 con 0x7fb2a00ce650 2024-03-04T08:49:59.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.001+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2900074e0 con 0x7fb2a00ce650 2024-03-04T08:49:59.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.001+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290018070 con 0x7fb2a00ce650 2024-03-04T08:49:59.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.002+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00c7260 con 0x7fb2a00ce650 2024-03-04T08:49:59.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.003+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a00c77a0 con 0x7fb2a00ce650 2024-03-04T08:50:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.004+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a00680b0 con 0x7fb2a00ce650 2024-03-04T08:50:00.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.037+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2900047e0 con 0x7fb2a00ce650 2024-03-04T08:50:00.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.038+0000 7fb296a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb28006b6d0 0x7fb28006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.039+0000 7fb29e000640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb28006b6d0 0x7fb28006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.040+0000 7fb29e000640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb28006b6d0 0x7fb28006db90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0079a0 tx=0x7fb28c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.098 INFO:tasks.ceph.mds.e.smithi046.stderr:2024-03-04T08:50:00.097+0000 f5f9640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-03-04T08:50:00.098 INFO:tasks.ceph.mds.e.smithi046.stderr:2024-03-04T08:50:00.097+0000 f5f9640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-04T08:50:00.098 INFO:tasks.ceph.mds.e.smithi046.stderr:2024-03-04T08:50:00.097+0000 f5f9640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-04T08:50:00.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.146+0000 7f19a2400640 1 Processor -- start 2024-03-04T08:50:00.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.146+0000 7f19a2400640 1 -- start start 2024-03-04T08:50:00.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.149+0000 7f19a2400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f199c158c90 0x7f199c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.149+0000 7f19a2400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f199c0732a0 0x7f199c06ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.149+0000 7f19a2400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c6c80 con 0x7f199c0c1420 2024-03-04T08:50:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.149+0000 7f19a2400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0c6f20 con 0x7f199c0732a0 2024-03-04T08:50:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.149+0000 7f19a2400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c15e940 con 0x7f199c158c90 2024-03-04T08:50:00.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.152+0000 7f199be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f199c0732a0 0x7f199c06ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.153+0000 7f199aa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f199c0c1420 0x7f199c0c8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50248/0 (socket says 172.21.15.46:50248) 2024-03-04T08:50:00.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.153+0000 7f199aa00640 1 -- 172.21.15.46:0/789521714 learned_addr learned my addr 172.21.15.46:0/789521714 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:00.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.162+0000 7f199be00640 1 -- 172.21.15.46:0/789521714 >> v2:172.21.15.73:3300/0 conn(0x7f199c158c90 msgr2=0x7f199c15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:00.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.162+0000 7f199be00640 1 --2- 172.21.15.46:0/789521714 >> v2:172.21.15.73:3300/0 conn(0x7f199c158c90 0x7f199c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.162+0000 7f199be00640 1 -- 172.21.15.46:0/789521714 >> v1:172.21.15.46:6789/0 conn(0x7f199c0c1420 legacy=0x7f199c0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.162+0000 7f199be00640 1 -- 172.21.15.46:0/789521714 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c15ec20 con 0x7f199c0732a0 2024-03-04T08:50:00.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.169+0000 7f199be00640 1 --2- 172.21.15.46:0/789521714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c06ed90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f199c06bcc0 tx=0x7f199402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f69048c51af97fc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.176+0000 7f199a000640 1 -- 172.21.15.46:0/789521714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994039070 con 0x7f199c0732a0 2024-03-04T08:50:00.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.177+0000 7f199a000640 1 -- 172.21.15.46:0/789521714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199402cc90 con 0x7f199c0732a0 2024-03-04T08:50:00.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.177+0000 7f199a000640 1 -- 172.21.15.46:0/789521714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994034640 con 0x7f199c0732a0 2024-03-04T08:50:00.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.178+0000 7f19a2400640 1 -- 172.21.15.46:0/789521714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 msgr2=0x7f199c06ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.178+0000 7f19a2400640 1 --2- 172.21.15.46:0/789521714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c06ed90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f199c06bcc0 tx=0x7f199402bee0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.180+0000 7f19a2400640 1 -- 172.21.15.46:0/789521714 shutdown_connections 2024-03-04T08:50:00.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.180+0000 7f19a2400640 1 --2- 172.21.15.46:0/789521714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c06ed90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.180+0000 7f19a2400640 1 --2- 172.21.15.46:0/789521714 >> v2:172.21.15.73:3300/0 conn(0x7f199c158c90 0x7f199c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.180+0000 7f19a2400640 1 -- 172.21.15.46:0/789521714 >> 172.21.15.46:0/789521714 conn(0x7f199c06aff0 msgr2=0x7f199c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.180+0000 7f19a2400640 1 -- 172.21.15.46:0/789521714 shutdown_connections 2024-03-04T08:50:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.180+0000 7f19a2400640 1 -- 172.21.15.46:0/789521714 wait complete. 2024-03-04T08:50:00.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.183+0000 7f19a2400640 1 Processor -- start 2024-03-04T08:50:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.184+0000 7f19a2400640 1 -- start start 2024-03-04T08:50:00.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.186+0000 7f19a2400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.187+0000 7f19a2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c0c1420 0x7f199c200a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.187+0000 7f19a2400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f199c158c90 0x7f199c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.188+0000 7f19a2400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c8f10 con 0x7f199c0732a0 2024-03-04T08:50:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.188+0000 7f19a2400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c7200 con 0x7f199c0c1420 2024-03-04T08:50:00.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.188+0000 7f19a2400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c9090 con 0x7f199c158c90 2024-03-04T08:50:00.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.189+0000 7f199b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.190+0000 7f199b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c1503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48078/0 (socket says 172.21.15.46:48078) 2024-03-04T08:50:00.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.190+0000 7f199b400640 1 -- 172.21.15.46:0/3860547729 learned_addr learned my addr 172.21.15.46:0/3860547729 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:00.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.198+0000 7f199b400640 1 -- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f199c158c90 msgr2=0x7f199c14dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.198+0000 7f199b400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f199c158c90 0x7f199c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.199+0000 7f199b400640 1 -- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c0c1420 msgr2=0x7f199c200a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.199+0000 7f199b400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c0c1420 0x7f199c200a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.199+0000 7f199b400640 1 -- 172.21.15.46:0/3860547729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c1e9710 con 0x7f199c0732a0 2024-03-04T08:50:00.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.201+0000 7f199b400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c1503a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f198800b410 tx=0x7f198800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.208+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988015020 con 0x7f199c0732a0 2024-03-04T08:50:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.208+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c151e00 con 0x7f199c0732a0 2024-03-04T08:50:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.208+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1e9f90 con 0x7f199c0732a0 2024-03-04T08:50:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.208+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988011830 con 0x7f199c0732a0 2024-03-04T08:50:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.208+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988015020 con 0x7f199c0732a0 2024-03-04T08:50:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.210+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1974005290 con 0x7f199c0732a0 2024-03-04T08:50:00.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.238+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f40307b0 con 0x7f3808154600 2024-03-04T08:50:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.245+0000 7fcd49e00640 1 Processor -- start 2024-03-04T08:50:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.247+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f37f407bc90 con 0x7f3808154600 2024-03-04T08:50:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.248+0000 7fcd49e00640 1 -- start start 2024-03-04T08:50:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.250+0000 7fcd49e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c045810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.251+0000 7fcd49e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcd3c0deca0 0x7fcd3c046890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.251+0000 7fcd49e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd3c046dd0 0x7fcd3c04b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.251+0000 7fcd49e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c045d50 con 0x7fcd3c0deca0 2024-03-04T08:50:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.251+0000 7fcd49e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c046400 con 0x7fcd3c046dd0 2024-03-04T08:50:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.251+0000 7fcd49e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0df450 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.263+0000 7fcd48a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c045810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.263+0000 7fcd48a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c045810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38100/0 (socket says 172.21.15.46:38100) 2024-03-04T08:50:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.263+0000 7fcd48a00640 1 -- 172.21.15.46:0/210317822 learned_addr learned my addr 172.21.15.46:0/210317822 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:00.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.266+0000 7fcd48a00640 1 -- 172.21.15.46:0/210317822 >> v2:172.21.15.73:3300/0 conn(0x7fcd3c046dd0 msgr2=0x7fcd3c04b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.266+0000 7fcd48a00640 1 --2- 172.21.15.46:0/210317822 >> v2:172.21.15.73:3300/0 conn(0x7fcd3c046dd0 0x7fcd3c04b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.266+0000 7fcd48a00640 1 -- 172.21.15.46:0/210317822 >> v2:172.21.15.46:3300/0 conn(0x7fcd3c0deca0 msgr2=0x7fcd3c046890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.266+0000 7fcd48a00640 1 --2- 172.21.15.46:0/210317822 >> v2:172.21.15.46:3300/0 conn(0x7fcd3c0deca0 0x7fcd3c046890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.266+0000 7fcd48a00640 1 -- 172.21.15.46:0/210317822 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0df730 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.269+0000 7fcd48a00640 1 --2- 172.21.15.46:0/210317822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c045810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0089b0 tx=0x7fcd3002b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425a77ae79662e9a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.273+0000 7f3cd4c00640 1 Processor -- start 2024-03-04T08:50:00.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.273+0000 7f3cd4c00640 1 -- start start 2024-03-04T08:50:00.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.274+0000 7fcd43400640 1 -- 172.21.15.46:0/210317822 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30034070 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.274+0000 7fcd43400640 1 -- 172.21.15.46:0/210317822 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30030890 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.274+0000 7fcd43400640 1 -- 172.21.15.46:0/210317822 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30030ca0 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 -- 172.21.15.46:0/210317822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 msgr2=0x7fcd3c045810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 --2- 172.21.15.46:0/210317822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c045810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0089b0 tx=0x7fcd3002b9d0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 -- 172.21.15.46:0/210317822 shutdown_connections 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 --2- 172.21.15.46:0/210317822 >> v2:172.21.15.73:3300/0 conn(0x7fcd3c046dd0 0x7fcd3c04b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 --2- 172.21.15.46:0/210317822 >> v2:172.21.15.46:3300/0 conn(0x7fcd3c0deca0 0x7fcd3c046890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 --2- 172.21.15.46:0/210317822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c045810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7f3cd4c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3cd0154600 0x7f3cd00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 -- 172.21.15.46:0/210317822 >> 172.21.15.46:0/210317822 conn(0x7fcd3c0505d0 msgr2=0x7fcd3c0509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 -- 172.21.15.46:0/210317822 shutdown_connections 2024-03-04T08:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7f3cd4c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 0x7f3cd00cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7f3cd4c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd015a870 con 0x7f3cd00cb3a0 2024-03-04T08:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7f3cd4c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00cb8f0 con 0x7f3cd0154600 2024-03-04T08:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7f3cd4c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00cb190 con 0x7f3cd015a3c0 2024-03-04T08:50:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.275+0000 7fcd49e00640 1 -- 172.21.15.46:0/210317822 wait complete. 2024-03-04T08:50:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.277+0000 7f3ccea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 0x7f3cd00cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.277+0000 7f3ccea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 0x7f3cd00cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38110/0 (socket says 172.21.15.46:38110) 2024-03-04T08:50:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.277+0000 7f3ccea00640 1 -- 172.21.15.46:0/2153617075 learned_addr learned my addr 172.21.15.46:0/2153617075 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.278+0000 7fcd49e00640 1 Processor -- start 2024-03-04T08:50:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.278+0000 7fcd49e00640 1 -- start start 2024-03-04T08:50:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7fcd49e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c046dd0 0x7fcd3c0de010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7fcd49e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c049920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7fcd49e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c0deca0 0x7fcd3c049e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.281+0000 7fcd49e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c006330 con 0x7fcd3c0deca0 2024-03-04T08:50:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.281+0000 7fcd49e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c046090 con 0x7fcd3c046dd0 2024-03-04T08:50:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.281+0000 7fcd49e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0d9320 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7f3ccea00640 1 -- 172.21.15.46:0/2153617075 >> v2:172.21.15.73:3300/0 conn(0x7f3cd0154600 msgr2=0x7f3cd00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7f3ccea00640 1 --2- 172.21.15.46:0/2153617075 >> v2:172.21.15.73:3300/0 conn(0x7f3cd0154600 0x7f3cd00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7f3ccea00640 1 -- 172.21.15.46:0/2153617075 >> v1:172.21.15.46:6789/0 conn(0x7f3cd00cb3a0 legacy=0x7f3cd006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.280+0000 7f3ccea00640 1 -- 172.21.15.46:0/2153617075 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd015ab50 con 0x7f3cd015a3c0 2024-03-04T08:50:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.286+0000 7f3ccea00640 1 --2- 172.21.15.46:0/2153617075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 0x7f3cd00cdef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009870 tx=0x7f3cbc02b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621adb1c99e4989d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.291+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c049920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.292+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c049920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38112/0 (socket says 172.21.15.46:38112) 2024-03-04T08:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.292+0000 7fcd43e00640 1 -- 172.21.15.46:0/2361404009 learned_addr learned my addr 172.21.15.46:0/2361404009 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.292+0000 7f3cce000640 1 -- 172.21.15.46:0/2153617075 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc034070 con 0x7f3cd015a3c0 2024-03-04T08:50:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.292+0000 7f3cce000640 1 -- 172.21.15.46:0/2153617075 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc030860 con 0x7f3cd015a3c0 2024-03-04T08:50:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.292+0000 7f3cce000640 1 -- 172.21.15.46:0/2153617075 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc030c70 con 0x7f3cd015a3c0 2024-03-04T08:50:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 -- 172.21.15.46:0/2153617075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 msgr2=0x7f3cd00cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/2153617075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 0x7f3cd00cdef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009870 tx=0x7f3cbc02b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 -- 172.21.15.46:0/2153617075 shutdown_connections 2024-03-04T08:50:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/2153617075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd015a3c0 0x7f3cd00cdef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/2153617075 >> v2:172.21.15.73:3300/0 conn(0x7f3cd0154600 0x7f3cd00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 -- 172.21.15.46:0/2153617075 >> 172.21.15.46:0/2153617075 conn(0x7f3cd00b17c0 msgr2=0x7f3cd00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 -- 172.21.15.46:0/2153617075 shutdown_connections 2024-03-04T08:50:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.294+0000 7f3cd4c00640 1 -- 172.21.15.46:0/2153617075 wait complete. 2024-03-04T08:50:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.297+0000 7f3cd4c00640 1 Processor -- start 2024-03-04T08:50:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.297+0000 7f3cd4c00640 1 -- start start 2024-03-04T08:50:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7fcd43e00640 1 -- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c046dd0 msgr2=0x7fcd3c0de010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7fcd43e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c046dd0 0x7fcd3c0de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7fcd43e00640 1 -- 172.21.15.46:0/2361404009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c0deca0 msgr2=0x7fcd3c049e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7fcd43e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c0deca0 0x7fcd3c049e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7fcd43e00640 1 -- 172.21.15.46:0/2361404009 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c04f120 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7f3cd4c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd00cb3a0 0x7f3cd014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7f3cd4c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 0x7f3cd01f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7f3cd4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd015a3c0 0x7f3cd014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.298+0000 7f3cd4c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00cd9d0 con 0x7f3cd00cb3a0 2024-03-04T08:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.299+0000 7f3cd4c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd015b110 con 0x7f3cd015a3c0 2024-03-04T08:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.299+0000 7f3cd4c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01549e0 con 0x7f3cd0154600 2024-03-04T08:50:00.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.300+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1988018020 con 0x7f199c0732a0 2024-03-04T08:50:00.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.301+0000 7f1993400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f197c06b6d0 0x7f197c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.302+0000 7f199aa00640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f197c06b6d0 0x7f197c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.303+0000 7f199aa00640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f197c06b6d0 0x7f197c06db90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f199c1fe5e0 tx=0x7f198c007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.303+0000 7f3ccea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 0x7f3cd01f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.304+0000 7f3ccea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 0x7f3cd01f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:38126/0 (socket says 172.21.15.46:38126) 2024-03-04T08:50:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.304+0000 7f3ccea00640 1 -- 172.21.15.46:0/561836555 learned_addr learned my addr 172.21.15.46:0/561836555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.304+0000 7fcd43e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c049920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b440 tx=0x7fcd3800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.308+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38015020 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.308+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c048830 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.309+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c04ede0 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.310+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c050080 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.311+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f61080cd260 con 0x7f6108154750 2024-03-04T08:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.313+0000 7f3ccea00640 1 -- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd015a3c0 msgr2=0x7f3cd014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.313+0000 7f3ccea00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd015a3c0 0x7f3cd014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.313+0000 7f3ccea00640 1 -- 172.21.15.46:0/561836555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd00cb3a0 msgr2=0x7f3cd014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.313+0000 7f3ccea00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd00cb3a0 0x7f3cd014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.313+0000 7f3ccea00640 1 -- 172.21.15.46:0/561836555 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00c7050 con 0x7f3cd0154600 2024-03-04T08:50:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.319+0000 7f3ccea00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 0x7f3cd01f3fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009990 tx=0x7f3cbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.385+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb290055cb0 con 0x7fb2a00ce650 2024-03-04T08:50:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.425+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb290021080 con 0x7fb2a00ce650 2024-03-04T08:50:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.521+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f380804f410 con 0x7f3808154600 2024-03-04T08:50:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.529+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1988056b00 con 0x7f199c0732a0 2024-03-04T08:50:00.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.578+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f198801f020 con 0x7f199c0732a0 2024-03-04T08:50:00.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.616+0000 7f60ff400640 1 -- 172.21.15.46:0/2500559177 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60f405d090 con 0x7f6108154750 2024-03-04T08:50:00.613 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f60e806b520 msgr2=0x7f60e806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f60e806b520 0x7f60e806d9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60f8001780 tx=0x7f60f8009040 comp rx=0 tx=0).stop 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 msgr2=0x7f61080b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 0x7f61080b00f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60f400e870 tx=0x7f60f400ed30 comp rx=0 tx=0).stop 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 shutdown_connections 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f60e806b520 0x7f60e806d9e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61080b2400 0x7f61080b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6108154750 0x7f61080b00f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 --2- 172.21.15.46:0/2500559177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61080ce650 0x7f610814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.619+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 >> 172.21.15.46:0/2500559177 conn(0x7f6108066c40 msgr2=0x7f61081534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.620+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 shutdown_connections 2024-03-04T08:50:00.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.620+0000 7f610e800640 1 -- 172.21.15.46:0/2500559177 wait complete. 2024-03-04T08:50:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.627+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38011890 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.627+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38009210 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.628+0000 7f37ff400640 1 -- 172.21.15.46:0/3715731184 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37f407b590 con 0x7f3808154600 2024-03-04T08:50:00.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.630+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd38018020 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.629 INFO:teuthology.orchestra.run.smithi046.stdout:64424509451 2024-03-04T08:50:00.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.633+0000 7fcd40c00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcd2406b4d0 0x7fcd2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.633+0000 7fcd48a00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcd2406b4d0 0x7fcd2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f37e806b550 msgr2=0x7f37e806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f37e806b550 0x7f37e806da10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37f8001550 tx=0x7f37f8007a40 comp rx=0 tx=0).stop 2024-03-04T08:50:00.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 msgr2=0x7f380815c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 0x7f380815c380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098c0 tx=0x7f37f40046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 shutdown_connections 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f37e806b550 0x7f37e806da10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38080b5380 0x7f380815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3808154600 0x7f380815c380 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098c0 tx=0x7f37f40046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 --2- 172.21.15.46:0/3715731184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38080cb3a0 0x7f380815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 >> 172.21.15.46:0/3715731184 conn(0x7f38080b17c0 msgr2=0x7f38080cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 shutdown_connections 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7f380ce00640 1 -- 172.21.15.46:0/3715731184 wait complete. 2024-03-04T08:50:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.634+0000 7fcd48a00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcd2406b4d0 0x7fcd2406d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd30036000 tx=0x7fcd3003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.636+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd380571a0 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542157 for osd.4 2024-03-04T08:50:00.636 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:00.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.654+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcd3801f020 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2024-03-04T08:50:00.655 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:00.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.660+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc034040 con 0x7f3cd0154600 2024-03-04T08:50:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.660+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0433f0 con 0x7f3cd0154600 2024-03-04T08:50:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.660+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0437e0 con 0x7f3cd0154600 2024-03-04T08:50:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.661+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00c7330 con 0x7f3cd0154600 2024-03-04T08:50:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.661+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00c78f0 con 0x7f3cd0154600 2024-03-04T08:50:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.663+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd0068590 con 0x7f3cd0154600 2024-03-04T08:50:00.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.740+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb2a0151aa0 con 0x7fb2a00ce650 2024-03-04T08:50:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.746+0000 7fb296a00640 1 -- 172.21.15.46:0/4139203782 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb290057c10 con 0x7fb2a00ce650 2024-03-04T08:50:00.743 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb28006b6d0 msgr2=0x7fb28006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb28006b6d0 0x7fb28006db90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0079a0 tx=0x7fb28c008040 comp rx=0 tx=0).stop 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 msgr2=0x7fb2a00c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 0x7fb2a00c39e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c4d0 tx=0x7fb29000c990 comp rx=0 tx=0).stop 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 shutdown_connections 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb28006b6d0 0x7fb28006db90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2a00b0c30 0x7fb2a01f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0154750 0x7fb2a00b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 --2- 172.21.15.46:0/4139203782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2a00ce650 0x7fb2a00c39e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 >> 172.21.15.46:0/4139203782 conn(0x7fb2a0066c40 msgr2=0x7fb2a0151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 shutdown_connections 2024-03-04T08:50:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.750+0000 7fb2a5a00640 1 -- 172.21.15.46:0/4139203782 wait complete. 2024-03-04T08:50:00.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.5 2024-03-04T08:50:00.773 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.853+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1974005850 con 0x7f199c0732a0 2024-03-04T08:50:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.858+0000 7f1993400640 1 -- 172.21.15.46:0/3860547729 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1988059160 con 0x7f199c0732a0 2024-03-04T08:50:00.854 INFO:teuthology.orchestra.run.smithi046.stdout:60129542156 2024-03-04T08:50:00.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f197c06b6d0 msgr2=0x7f197c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f197c06b6d0 0x7f197c06db90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f199c1fe5e0 tx=0x7f198c007a40 comp rx=0 tx=0).stop 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 msgr2=0x7f199c1503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c1503a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f198800b410 tx=0x7f198800b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 shutdown_connections 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f197c06b6d0 0x7f197c06db90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c0c1420 0x7f199c200a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f199c158c90 0x7f199c14dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 --2- 172.21.15.46:0/3860547729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f199c0732a0 0x7f199c1503a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 >> 172.21.15.46:0/3860547729 conn(0x7f199c06aff0 msgr2=0x7f199c15c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 shutdown_connections 2024-03-04T08:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.861+0000 7f19a2400640 1 -- 172.21.15.46:0/3860547729 wait complete. 2024-03-04T08:50:00.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.7 2024-03-04T08:50:00.874 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:00.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.909+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd3c005710 con 0x7fcd3c0d8f40 2024-03-04T08:50:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.984+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3cbc04a060 con 0x7f3cd0154600 2024-03-04T08:50:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.987+0000 7f3cc7400640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3cb006b520 0x7f3cb006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.987+0000 7f3ccf400640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3cb006b520 0x7f3cb006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.988+0000 7f3ccf400640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3cb006b520 0x7f3cb006d9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009710 tx=0x7f3cc0006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:00.991+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cbc04be70 con 0x7f3cd0154600 2024-03-04T08:50:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.006+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3cbc03e070 con 0x7f3cd0154600 2024-03-04T08:50:01.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.016+0000 7fcd40c00640 1 -- 172.21.15.46:0/2361404009 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd3800d040 con 0x7fcd3c0d8f40 2024-03-04T08:50:01.013 INFO:teuthology.orchestra.run.smithi046.stdout:64424509452 2024-03-04T08:50:01.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcd2406b4d0 msgr2=0x7fcd2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcd2406b4d0 0x7fcd2406d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd30036000 tx=0x7fcd3003b040 comp rx=0 tx=0).stop 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 msgr2=0x7fcd3c049920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c049920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b440 tx=0x7fcd3800b900 comp rx=0 tx=0).stop 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 shutdown_connections 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcd2406b4d0 0x7fcd2406d990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c0deca0 0x7fcd3c049e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c0d8f40 0x7fcd3c049920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 --2- 172.21.15.46:0/2361404009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c046dd0 0x7fcd3c0de010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 >> 172.21.15.46:0/2361404009 conn(0x7fcd3c0505d0 msgr2=0x7fcd3c0351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 shutdown_connections 2024-03-04T08:50:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.020+0000 7fcd49e00640 1 -- 172.21.15.46:0/2361404009 wait complete. 2024-03-04T08:50:01.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.2 2024-03-04T08:50:01.041 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:01.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.221+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3cd0075240 con 0x7f3cd0154600 2024-03-04T08:50:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.227+0000 7f3cc7400640 1 -- 172.21.15.46:0/561836555 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cbc07b7f0 con 0x7f3cd0154600 2024-03-04T08:50:01.223 INFO:teuthology.orchestra.run.smithi046.stdout:60129542156 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3cb006b520 msgr2=0x7f3cb006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3cb006b520 0x7f3cb006d9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009710 tx=0x7f3cc0006c90 comp rx=0 tx=0).stop 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 msgr2=0x7f3cd01f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 0x7f3cd01f3fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009990 tx=0x7f3cbc0046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 shutdown_connections 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3cb006b520 0x7f3cb006d9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd015a3c0 0x7f3cd014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd0154600 0x7f3cd01f3fd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 --2- 172.21.15.46:0/561836555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd00cb3a0 0x7f3cd014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 >> 172.21.15.46:0/561836555 conn(0x7f3cd00b17c0 msgr2=0x7f3cd00cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 shutdown_connections 2024-03-04T08:50:01.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.229+0000 7f3cd4c00640 1 -- 172.21.15.46:0/561836555 wait complete. 2024-03-04T08:50:01.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.6 2024-03-04T08:50:01.245 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:01.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T08:50:01.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.445+0000 7f1da6a00640 1 Processor -- start 2024-03-04T08:50:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.445+0000 7f1da6a00640 1 -- start start 2024-03-04T08:50:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1da6a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1da00ca550 0x7f1da00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1da6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1da015db50 0x7f1da015dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1da6a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da006db50 con 0x7f1da0154930 2024-03-04T08:50:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1da6a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da006cfb0 con 0x7f1da00ca550 2024-03-04T08:50:01.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1da6a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da006c6c0 con 0x7f1da015db50 2024-03-04T08:50:01.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1d9fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1da0154930 0x7f1da006d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49774/0 (socket says 172.21.15.46:49774) 2024-03-04T08:50:01.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.447+0000 7f1d9fe00640 1 -- 172.21.15.46:0/172294954 learned_addr learned my addr 172.21.15.46:0/172294954 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:01.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.450+0000 7f1da4a00640 1 --2- 172.21.15.46:0/172294954 >> v2:172.21.15.73:3300/0 conn(0x7f1da015db50 0x7f1da015dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:01.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.450+0000 7f1d9ea00640 1 -- 172.21.15.46:0/172294954 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158206956 0 0) 0x7f1da006db50 con 0x7f1da0154930 2024-03-04T08:50:01.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.450+0000 7f1d9ea00640 1 -- 172.21.15.46:0/172294954 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d84003520 con 0x7f1da0154930 2024-03-04T08:50:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.455+0000 7f1da4a00640 1 -- 172.21.15.46:0/172294954 >> v2:172.21.15.46:3300/0 conn(0x7f1da00ca550 msgr2=0x7f1da00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.455+0000 7f1da4a00640 1 --2- 172.21.15.46:0/172294954 >> v2:172.21.15.46:3300/0 conn(0x7f1da00ca550 0x7f1da00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.455+0000 7f1da4a00640 1 -- 172.21.15.46:0/172294954 >> v1:172.21.15.73:6789/0 conn(0x7f1da0154930 legacy=0x7f1da006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.455+0000 7f1da4a00640 1 -- 172.21.15.46:0/172294954 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0154d10 con 0x7f1da015db50 2024-03-04T08:50:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.458+0000 7f1da4a00640 1 --2- 172.21.15.46:0/172294954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da015db50 0x7f1da015dfe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1da008d870 tx=0x7f1d9802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce072781377e154 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1d9ea00640 1 -- 172.21.15.46:0/172294954 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98039070 con 0x7f1da015db50 2024-03-04T08:50:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1d9ea00640 1 -- 172.21.15.46:0/172294954 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9802cbf0 con 0x7f1da015db50 2024-03-04T08:50:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1d9ea00640 1 -- 172.21.15.46:0/172294954 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98034440 con 0x7f1da015db50 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1da6a00640 1 -- 172.21.15.46:0/172294954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da015db50 msgr2=0x7f1da015dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1da6a00640 1 --2- 172.21.15.46:0/172294954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da015db50 0x7f1da015dfe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1da008d870 tx=0x7f1d9802be40 comp rx=0 tx=0).stop 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1da6a00640 1 -- 172.21.15.46:0/172294954 shutdown_connections 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1da6a00640 1 --2- 172.21.15.46:0/172294954 >> v2:172.21.15.46:3300/0 conn(0x7f1da00ca550 0x7f1da00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1da6a00640 1 --2- 172.21.15.46:0/172294954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da015db50 0x7f1da015dfe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.462+0000 7f1da6a00640 1 -- 172.21.15.46:0/172294954 >> 172.21.15.46:0/172294954 conn(0x7f1da00b1920 msgr2=0x7f1da00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.463+0000 7f1da6a00640 1 -- 172.21.15.46:0/172294954 shutdown_connections 2024-03-04T08:50:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.463+0000 7f1da6a00640 1 -- 172.21.15.46:0/172294954 wait complete. 2024-03-04T08:50:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.464+0000 7f1da6a00640 1 Processor -- start 2024-03-04T08:50:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.464+0000 7f1da6a00640 1 -- start start 2024-03-04T08:50:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.465+0000 7f1da6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 0x7f1da015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.465+0000 7f1da6a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0154930 0x7f1da0149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.465+0000 7f1da6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da015db50 0x7f1da0147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.465+0000 7f1da6a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da006c960 con 0x7f1da015db50 2024-03-04T08:50:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.465+0000 7f1da6a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00cd460 con 0x7f1da00ca550 2024-03-04T08:50:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.465+0000 7f1da6a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da006cc40 con 0x7f1da0154930 2024-03-04T08:50:01.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.466+0000 7f1d9fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 0x7f1da015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:01.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.466+0000 7f1d9fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 0x7f1da015cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:44178/0 (socket says 172.21.15.46:44178) 2024-03-04T08:50:01.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.466+0000 7f1d9fe00640 1 -- 172.21.15.46:0/1398600103 learned_addr learned my addr 172.21.15.46:0/1398600103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:01.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.466+0000 7f1d9f400640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0154930 0x7f1da0149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.470+0000 7f1d9fe00640 1 -- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0154930 msgr2=0x7f1da0149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.470+0000 7f1d9fe00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0154930 0x7f1da0149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.470+0000 7f1d9fe00640 1 -- 172.21.15.46:0/1398600103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da015db50 msgr2=0x7f1da0147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.470+0000 7f1d9fe00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da015db50 0x7f1da0147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.470+0000 7f1d9fe00640 1 -- 172.21.15.46:0/1398600103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da01f4000 con 0x7f1da00ca550 2024-03-04T08:50:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.475+0000 7f1d9fe00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 0x7f1da015cc10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000c410 tx=0x7f1d9000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:01.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.479+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90017070 con 0x7f1da00ca550 2024-03-04T08:50:01.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.479+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90005ce0 con 0x7f1da00ca550 2024-03-04T08:50:01.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.479+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da01f42e0 con 0x7f1da00ca550 2024-03-04T08:50:01.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.479+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900072f0 con 0x7f1da00ca550 2024-03-04T08:50:01.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.480+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da0148fd0 con 0x7f1da00ca550 2024-03-04T08:50:01.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.481+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da015e5e0 con 0x7f1da00ca550 2024-03-04T08:50:01.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.505+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d9001a070 con 0x7f1da00ca550 2024-03-04T08:50:01.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.506+0000 7f1d97e00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d8006b550 0x7f1d8006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.507+0000 7f1d9f400640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d8006b550 0x7f1d8006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.507+0000 7f1d9f400640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d8006b550 0x7f1d8006da10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da01f0ff0 tx=0x7f1d8c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:01.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.509+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d900563d0 con 0x7f1da00ca550 2024-03-04T08:50:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.767+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1da015e5e0 con 0x7f1da00ca550 2024-03-04T08:50:01.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.975+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1da00680b0 con 0x7f1d8006b550 2024-03-04T08:50:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.988+0000 7f1d97e00640 1 -- 172.21.15.46:0/1398600103 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251934 (secure 0 0 0) 0x7f1da00680b0 con 0x7f1d8006b550 2024-03-04T08:50:01.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d8006b550 msgr2=0x7f1d8006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d8006b550 0x7f1d8006da10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da01f0ff0 tx=0x7f1d8c009060 comp rx=0 tx=0).stop 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 msgr2=0x7f1da015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 0x7f1da015cc10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000c410 tx=0x7f1d9000c8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 shutdown_connections 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d8006b550 0x7f1d8006da10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da015db50 0x7f1da0147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0154930 0x7f1da0149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 --2- 172.21.15.46:0/1398600103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da00ca550 0x7f1da015cc10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 >> 172.21.15.46:0/1398600103 conn(0x7f1da00b1920 msgr2=0x7f1da00ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 shutdown_connections 2024-03-04T08:50:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:01.993+0000 7f1da6a00640 1 -- 172.21.15.46:0/1398600103 wait complete. 2024-03-04T08:50:02.007 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-03-04T08:50:01.434016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":363,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":295,"ondisk_log_size":295,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235988,"kb_used_data":3220,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738732,"statfs":{"total":773094113280,"available":772852461568,"internally_reserved":0,"allocated":3297280,"data_stored":1863976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002581"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281486+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T08:49:43.281486+0000","last_peered":"2024-03-04T08:49:43.281486+0000","last_clean":"2024-03-04T08:49:43.281486+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T08:49:43.281486+0000","last_undegraded":"2024-03-04T08:49:43.281486+0000","last_fullsized":"2024-03-04T08:49:43.281486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047094+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T08:49:43.047094+0000","last_peered":"2024-03-04T08:49:43.047094+0000","last_clean":"2024-03-04T08:49:43.047094+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T08:49:43.047094+0000","last_undegraded":"2024-03-04T08:49:43.047094+0000","last_fullsized":"2024-03-04T08:49:43.047094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047069+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T08:49:43.047069+0000","last_peered":"2024-03-04T08:49:43.047069+0000","last_clean":"2024-03-04T08:49:43.047069+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T08:49:43.047069+0000","last_undegraded":"2024-03-04T08:49:43.047069+0000","last_fullsized":"2024-03-04T08:49:43.047069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369960+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T08:49:42.369960+0000","last_peered":"2024-03-04T08:49:42.369960+0000","last_clean":"2024-03-04T08:49:42.369960+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T08:49:42.369960+0000","last_undegraded":"2024-03-04T08:49:42.369960+0000","last_fullsized":"2024-03-04T08:49:42.369960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280132+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T08:49:43.280132+0000","last_peered":"2024-03-04T08:49:43.280132+0000","last_clean":"2024-03-04T08:49:43.280132+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T08:49:43.280132+0000","last_undegraded":"2024-03-04T08:49:43.280132+0000","last_fullsized":"2024-03-04T08:49:43.280132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369716+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T08:49:42.369716+0000","last_peered":"2024-03-04T08:49:42.369716+0000","last_clean":"2024-03-04T08:49:42.369716+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T08:49:42.369716+0000","last_undegraded":"2024-03-04T08:49:42.369716+0000","last_fullsized":"2024-03-04T08:49:42.369716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279556+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T08:49:43.279556+0000","last_peered":"2024-03-04T08:49:43.279556+0000","last_clean":"2024-03-04T08:49:43.279556+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T08:49:43.279556+0000","last_undegraded":"2024-03-04T08:49:43.279556+0000","last_fullsized":"2024-03-04T08:49:43.279556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280535+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T08:49:43.280535+0000","last_peered":"2024-03-04T08:49:43.280535+0000","last_clean":"2024-03-04T08:49:43.280535+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T08:49:43.280535+0000","last_undegraded":"2024-03-04T08:49:43.280535+0000","last_fullsized":"2024-03-04T08:49:43.280535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281592+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T08:49:43.281592+0000","last_peered":"2024-03-04T08:49:43.281592+0000","last_clean":"2024-03-04T08:49:43.281592+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T08:49:43.281592+0000","last_undegraded":"2024-03-04T08:49:43.281592+0000","last_fullsized":"2024-03-04T08:49:43.281592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280787+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T08:49:43.280787+0000","last_peered":"2024-03-04T08:49:43.280787+0000","last_clean":"2024-03-04T08:49:43.280787+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T08:49:43.280787+0000","last_undegraded":"2024-03-04T08:49:43.280787+0000","last_fullsized":"2024-03-04T08:49:43.280787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280684+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T08:49:43.280684+0000","last_peered":"2024-03-04T08:49:43.280684+0000","last_clean":"2024-03-04T08:49:43.280684+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T08:49:43.280684+0000","last_undegraded":"2024-03-04T08:49:43.280684+0000","last_fullsized":"2024-03-04T08:49:43.280684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276060+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T08:49:43.276060+0000","last_peered":"2024-03-04T08:49:43.276060+0000","last_clean":"2024-03-04T08:49:43.276060+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T08:49:43.276060+0000","last_undegraded":"2024-03-04T08:49:43.276060+0000","last_fullsized":"2024-03-04T08:49:43.276060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276313+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T08:49:43.276313+0000","last_peered":"2024-03-04T08:49:43.276313+0000","last_clean":"2024-03-04T08:49:43.276313+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T08:49:43.276313+0000","last_undegraded":"2024-03-04T08:49:43.276313+0000","last_fullsized":"2024-03-04T08:49:43.276313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046770+0000","last_change":"2024-03-04T08:49:40.146477+0000","last_active":"2024-03-04T08:49:43.046770+0000","last_peered":"2024-03-04T08:49:43.046770+0000","last_clean":"2024-03-04T08:49:43.046770+0000","last_became_active":"2024-03-04T08:49:40.146170+0000","last_became_peered":"2024-03-04T08:49:40.146170+0000","last_unstale":"2024-03-04T08:49:43.046770+0000","last_undegraded":"2024-03-04T08:49:43.046770+0000","last_fullsized":"2024-03-04T08:49:43.046770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:53:13.937230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325117+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T08:49:42.325117+0000","last_peered":"2024-03-04T08:49:42.325117+0000","last_clean":"2024-03-04T08:49:42.325117+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T08:49:42.325117+0000","last_undegraded":"2024-03-04T08:49:42.325117+0000","last_fullsized":"2024-03-04T08:49:42.325117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325919+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T08:49:42.325919+0000","last_peered":"2024-03-04T08:49:42.325919+0000","last_clean":"2024-03-04T08:49:42.325919+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T08:49:42.325919+0000","last_undegraded":"2024-03-04T08:49:42.325919+0000","last_fullsized":"2024-03-04T08:49:42.325919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277148+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T08:49:43.277148+0000","last_peered":"2024-03-04T08:49:43.277148+0000","last_clean":"2024-03-04T08:49:43.277148+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T08:49:43.277148+0000","last_undegraded":"2024-03-04T08:49:43.277148+0000","last_fullsized":"2024-03-04T08:49:43.277148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326173+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T08:49:42.326173+0000","last_peered":"2024-03-04T08:49:42.326173+0000","last_clean":"2024-03-04T08:49:42.326173+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T08:49:42.326173+0000","last_undegraded":"2024-03-04T08:49:42.326173+0000","last_fullsized":"2024-03-04T08:49:42.326173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280559+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T08:49:43.280559+0000","last_peered":"2024-03-04T08:49:43.280559+0000","last_clean":"2024-03-04T08:49:43.280559+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T08:49:43.280559+0000","last_undegraded":"2024-03-04T08:49:43.280559+0000","last_fullsized":"2024-03-04T08:49:43.280559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276042+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T08:49:43.276042+0000","last_peered":"2024-03-04T08:49:43.276042+0000","last_clean":"2024-03-04T08:49:43.276042+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T08:49:43.276042+0000","last_undegraded":"2024-03-04T08:49:43.276042+0000","last_fullsized":"2024-03-04T08:49:43.276042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277967+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T08:49:43.277967+0000","last_peered":"2024-03-04T08:49:43.277967+0000","last_clean":"2024-03-04T08:49:43.277967+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T08:49:43.277967+0000","last_undegraded":"2024-03-04T08:49:43.277967+0000","last_fullsized":"2024-03-04T08:49:43.277967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046777+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T08:49:43.046777+0000","last_peered":"2024-03-04T08:49:43.046777+0000","last_clean":"2024-03-04T08:49:43.046777+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T08:49:43.046777+0000","last_undegraded":"2024-03-04T08:49:43.046777+0000","last_fullsized":"2024-03-04T08:49:43.046777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325115+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T08:49:42.325115+0000","last_peered":"2024-03-04T08:49:42.325115+0000","last_clean":"2024-03-04T08:49:42.325115+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T08:49:42.325115+0000","last_undegraded":"2024-03-04T08:49:42.325115+0000","last_fullsized":"2024-03-04T08:49:42.325115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047184+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T08:49:43.047184+0000","last_peered":"2024-03-04T08:49:43.047184+0000","last_clean":"2024-03-04T08:49:43.047184+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T08:49:43.047184+0000","last_undegraded":"2024-03-04T08:49:43.047184+0000","last_fullsized":"2024-03-04T08:49:43.047184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370272+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T08:49:42.370272+0000","last_peered":"2024-03-04T08:49:42.370272+0000","last_clean":"2024-03-04T08:49:42.370272+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T08:49:42.370272+0000","last_undegraded":"2024-03-04T08:49:42.370272+0000","last_fullsized":"2024-03-04T08:49:42.370272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275907+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T08:49:43.275907+0000","last_peered":"2024-03-04T08:49:43.275907+0000","last_clean":"2024-03-04T08:49:43.275907+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T08:49:43.275907+0000","last_undegraded":"2024-03-04T08:49:43.275907+0000","last_fullsized":"2024-03-04T08:49:43.275907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276346+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T08:49:43.276346+0000","last_peered":"2024-03-04T08:49:43.276346+0000","last_clean":"2024-03-04T08:49:43.276346+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T08:49:43.276346+0000","last_undegraded":"2024-03-04T08:49:43.276346+0000","last_fullsized":"2024-03-04T08:49:43.276346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046951+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T08:49:43.046951+0000","last_peered":"2024-03-04T08:49:43.046951+0000","last_clean":"2024-03-04T08:49:43.046951+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T08:49:43.046951+0000","last_undegraded":"2024-03-04T08:49:43.046951+0000","last_fullsized":"2024-03-04T08:49:43.046951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325310+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T08:49:42.325310+0000","last_peered":"2024-03-04T08:49:42.325310+0000","last_clean":"2024-03-04T08:49:42.325310+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T08:49:42.325310+0000","last_undegraded":"2024-03-04T08:49:42.325310+0000","last_fullsized":"2024-03-04T08:49:42.325310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276935+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T08:49:43.276935+0000","last_peered":"2024-03-04T08:49:43.276935+0000","last_clean":"2024-03-04T08:49:43.276935+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T08:49:43.276935+0000","last_undegraded":"2024-03-04T08:49:43.276935+0000","last_fullsized":"2024-03-04T08:49:43.276935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369643+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T08:49:42.369643+0000","last_peered":"2024-03-04T08:49:42.369643+0000","last_clean":"2024-03-04T08:49:42.369643+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T08:49:42.369643+0000","last_undegraded":"2024-03-04T08:49:42.369643+0000","last_fullsized":"2024-03-04T08:49:42.369643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278146+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T08:49:43.278146+0000","last_peered":"2024-03-04T08:49:43.278146+0000","last_clean":"2024-03-04T08:49:43.278146+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T08:49:43.278146+0000","last_undegraded":"2024-03-04T08:49:43.278146+0000","last_fullsized":"2024-03-04T08:49:43.278146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.407135+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T08:49:49.407135+0000","last_peered":"2024-03-04T08:49:49.407135+0000","last_clean":"2024-03-04T08:49:49.407135+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T08:49:49.407135+0000","last_undegraded":"2024-03-04T08:49:49.407135+0000","last_fullsized":"2024-03-04T08:49:49.407135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276098+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T08:49:43.276098+0000","last_peered":"2024-03-04T08:49:43.276098+0000","last_clean":"2024-03-04T08:49:43.276098+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T08:49:43.276098+0000","last_undegraded":"2024-03-04T08:49:43.276098+0000","last_fullsized":"2024-03-04T08:49:43.276098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.053077+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T08:49:54.053077+0000","last_peered":"2024-03-04T08:49:54.053077+0000","last_clean":"2024-03-04T08:49:54.053077+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T08:49:54.053077+0000","last_undegraded":"2024-03-04T08:49:54.053077+0000","last_fullsized":"2024-03-04T08:49:54.053077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.917199+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T08:49:51.917199+0000","last_peered":"2024-03-04T08:49:51.917199+0000","last_clean":"2024-03-04T08:49:51.917199+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T08:49:51.917199+0000","last_undegraded":"2024-03-04T08:49:51.917199+0000","last_fullsized":"2024-03-04T08:49:51.917199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047047+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T08:49:43.047047+0000","last_peered":"2024-03-04T08:49:43.047047+0000","last_clean":"2024-03-04T08:49:43.047047+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T08:49:43.047047+0000","last_undegraded":"2024-03-04T08:49:43.047047+0000","last_fullsized":"2024-03-04T08:49:43.047047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.054875+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T08:49:54.054875+0000","last_peered":"2024-03-04T08:49:54.054875+0000","last_clean":"2024-03-04T08:49:54.054875+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T08:49:54.054875+0000","last_undegraded":"2024-03-04T08:49:54.054875+0000","last_fullsized":"2024-03-04T08:49:54.054875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275934+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T08:49:43.275934+0000","last_peered":"2024-03-04T08:49:43.275934+0000","last_clean":"2024-03-04T08:49:43.275934+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T08:49:43.275934+0000","last_undegraded":"2024-03-04T08:49:43.275934+0000","last_fullsized":"2024-03-04T08:49:43.275934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.404962+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T08:49:49.404962+0000","last_peered":"2024-03-04T08:49:49.404962+0000","last_clean":"2024-03-04T08:49:49.404962+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T08:49:49.404962+0000","last_undegraded":"2024-03-04T08:49:49.404962+0000","last_fullsized":"2024-03-04T08:49:49.404962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370223+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T08:49:42.370223+0000","last_peered":"2024-03-04T08:49:42.370223+0000","last_clean":"2024-03-04T08:49:42.370223+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T08:49:42.370223+0000","last_undegraded":"2024-03-04T08:49:42.370223+0000","last_fullsized":"2024-03-04T08:49:42.370223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.880438+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T08:49:56.880438+0000","last_peered":"2024-03-04T08:49:56.880438+0000","last_clean":"2024-03-04T08:49:56.880438+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T08:49:56.880438+0000","last_undegraded":"2024-03-04T08:49:56.880438+0000","last_fullsized":"2024-03-04T08:49:56.880438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047304+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T08:49:43.047304+0000","last_peered":"2024-03-04T08:49:43.047304+0000","last_clean":"2024-03-04T08:49:43.047304+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T08:49:43.047304+0000","last_undegraded":"2024-03-04T08:49:43.047304+0000","last_fullsized":"2024-03-04T08:49:43.047304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.198681+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T08:49:49.198681+0000","last_peered":"2024-03-04T08:49:49.198681+0000","last_clean":"2024-03-04T08:49:49.198681+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T08:49:49.198681+0000","last_undegraded":"2024-03-04T08:49:49.198681+0000","last_fullsized":"2024-03-04T08:49:49.198681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325558+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T08:49:42.325558+0000","last_peered":"2024-03-04T08:49:42.325558+0000","last_clean":"2024-03-04T08:49:42.325558+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T08:49:42.325558+0000","last_undegraded":"2024-03-04T08:49:42.325558+0000","last_fullsized":"2024-03-04T08:49:42.325558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.867177+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T08:49:56.867177+0000","last_peered":"2024-03-04T08:49:56.867177+0000","last_clean":"2024-03-04T08:49:56.867177+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T08:49:56.867177+0000","last_undegraded":"2024-03-04T08:49:56.867177+0000","last_fullsized":"2024-03-04T08:49:56.867177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281324+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T08:49:43.281324+0000","last_peered":"2024-03-04T08:49:43.281324+0000","last_clean":"2024-03-04T08:49:43.281324+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T08:49:43.281324+0000","last_undegraded":"2024-03-04T08:49:43.281324+0000","last_fullsized":"2024-03-04T08:49:43.281324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.788081+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T08:49:56.788081+0000","last_peered":"2024-03-04T08:49:56.788081+0000","last_clean":"2024-03-04T08:49:56.788081+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T08:49:56.788081+0000","last_undegraded":"2024-03-04T08:49:56.788081+0000","last_fullsized":"2024-03-04T08:49:56.788081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276382+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T08:49:43.276382+0000","last_peered":"2024-03-04T08:49:43.276382+0000","last_clean":"2024-03-04T08:49:43.276382+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T08:49:43.276382+0000","last_undegraded":"2024-03-04T08:49:43.276382+0000","last_fullsized":"2024-03-04T08:49:43.276382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.056462+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T08:49:54.056462+0000","last_peered":"2024-03-04T08:49:54.056462+0000","last_clean":"2024-03-04T08:49:54.056462+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T08:49:54.056462+0000","last_undegraded":"2024-03-04T08:49:54.056462+0000","last_fullsized":"2024-03-04T08:49:54.056462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325413+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T08:49:42.325413+0000","last_peered":"2024-03-04T08:49:42.325413+0000","last_clean":"2024-03-04T08:49:42.325413+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T08:49:42.325413+0000","last_undegraded":"2024-03-04T08:49:42.325413+0000","last_fullsized":"2024-03-04T08:49:42.325413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.151344+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T08:49:54.151344+0000","last_peered":"2024-03-04T08:49:54.151344+0000","last_clean":"2024-03-04T08:49:54.151344+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T08:49:54.151344+0000","last_undegraded":"2024-03-04T08:49:54.151344+0000","last_fullsized":"2024-03-04T08:49:54.151344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277684+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T08:49:43.277684+0000","last_peered":"2024-03-04T08:49:43.277684+0000","last_clean":"2024-03-04T08:49:43.277684+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T08:49:43.277684+0000","last_undegraded":"2024-03-04T08:49:43.277684+0000","last_fullsized":"2024-03-04T08:49:43.277684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.047848+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T08:49:54.047848+0000","last_peered":"2024-03-04T08:49:54.047848+0000","last_clean":"2024-03-04T08:49:54.047848+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T08:49:54.047848+0000","last_undegraded":"2024-03-04T08:49:54.047848+0000","last_fullsized":"2024-03-04T08:49:54.047848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325325+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T08:49:42.325325+0000","last_peered":"2024-03-04T08:49:42.325325+0000","last_clean":"2024-03-04T08:49:42.325325+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T08:49:42.325325+0000","last_undegraded":"2024-03-04T08:49:42.325325+0000","last_fullsized":"2024-03-04T08:49:42.325325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.605635+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T08:49:43.605635+0000","last_peered":"2024-03-04T08:49:43.605635+0000","last_clean":"2024-03-04T08:49:43.605635+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T08:49:43.605635+0000","last_undegraded":"2024-03-04T08:49:43.605635+0000","last_fullsized":"2024-03-04T08:49:43.605635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370359+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T08:49:42.370359+0000","last_peered":"2024-03-04T08:49:42.370359+0000","last_clean":"2024-03-04T08:49:42.370359+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T08:49:42.370359+0000","last_undegraded":"2024-03-04T08:49:42.370359+0000","last_fullsized":"2024-03-04T08:49:42.370359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.861241+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T08:49:56.861241+0000","last_peered":"2024-03-04T08:49:56.861241+0000","last_clean":"2024-03-04T08:49:56.861241+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T08:49:56.861241+0000","last_undegraded":"2024-03-04T08:49:56.861241+0000","last_fullsized":"2024-03-04T08:49:56.861241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281668+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T08:49:43.281668+0000","last_peered":"2024-03-04T08:49:43.281668+0000","last_clean":"2024-03-04T08:49:43.281668+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T08:49:43.281668+0000","last_undegraded":"2024-03-04T08:49:43.281668+0000","last_fullsized":"2024-03-04T08:49:43.281668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.055120+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T08:49:54.055120+0000","last_peered":"2024-03-04T08:49:54.055120+0000","last_clean":"2024-03-04T08:49:54.055120+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T08:49:54.055120+0000","last_undegraded":"2024-03-04T08:49:54.055120+0000","last_fullsized":"2024-03-04T08:49:54.055120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280764+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T08:49:43.280764+0000","last_peered":"2024-03-04T08:49:43.280764+0000","last_clean":"2024-03-04T08:49:43.280764+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T08:49:43.280764+0000","last_undegraded":"2024-03-04T08:49:43.280764+0000","last_fullsized":"2024-03-04T08:49:43.280764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.049927+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T08:49:54.049927+0000","last_peered":"2024-03-04T08:49:54.049927+0000","last_clean":"2024-03-04T08:49:54.049927+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T08:49:54.049927+0000","last_undegraded":"2024-03-04T08:49:54.049927+0000","last_fullsized":"2024-03-04T08:49:54.049927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325992+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T08:49:42.325992+0000","last_peered":"2024-03-04T08:49:42.325992+0000","last_clean":"2024-03-04T08:49:42.325992+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T08:49:42.325992+0000","last_undegraded":"2024-03-04T08:49:42.325992+0000","last_fullsized":"2024-03-04T08:49:42.325992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277565+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T08:49:43.277565+0000","last_peered":"2024-03-04T08:49:43.277565+0000","last_clean":"2024-03-04T08:49:43.277565+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T08:49:43.277565+0000","last_undegraded":"2024-03-04T08:49:43.277565+0000","last_fullsized":"2024-03-04T08:49:43.277565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.051501+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T08:49:54.051501+0000","last_peered":"2024-03-04T08:49:54.051501+0000","last_clean":"2024-03-04T08:49:54.051501+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T08:49:54.051501+0000","last_undegraded":"2024-03-04T08:49:54.051501+0000","last_fullsized":"2024-03-04T08:49:54.051501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276209+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T08:49:43.276209+0000","last_peered":"2024-03-04T08:49:43.276209+0000","last_clean":"2024-03-04T08:49:43.276209+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T08:49:43.276209+0000","last_undegraded":"2024-03-04T08:49:43.276209+0000","last_fullsized":"2024-03-04T08:49:43.276209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.868981+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T08:49:51.868981+0000","last_peered":"2024-03-04T08:49:51.868981+0000","last_clean":"2024-03-04T08:49:51.868981+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T08:49:51.868981+0000","last_undegraded":"2024-03-04T08:49:51.868981+0000","last_fullsized":"2024-03-04T08:49:51.868981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275709+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T08:49:43.275709+0000","last_peered":"2024-03-04T08:49:43.275709+0000","last_clean":"2024-03-04T08:49:43.275709+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T08:49:43.275709+0000","last_undegraded":"2024-03-04T08:49:43.275709+0000","last_fullsized":"2024-03-04T08:49:43.275709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.868993+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T08:49:51.868993+0000","last_peered":"2024-03-04T08:49:51.868993+0000","last_clean":"2024-03-04T08:49:51.868993+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T08:49:51.868993+0000","last_undegraded":"2024-03-04T08:49:51.868993+0000","last_fullsized":"2024-03-04T08:49:51.868993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.892105+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T08:49:56.892105+0000","last_peered":"2024-03-04T08:49:56.892105+0000","last_clean":"2024-03-04T08:49:56.892105+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T08:49:56.892105+0000","last_undegraded":"2024-03-04T08:49:56.892105+0000","last_fullsized":"2024-03-04T08:49:56.892105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279927+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T08:49:43.279927+0000","last_peered":"2024-03-04T08:49:43.279927+0000","last_clean":"2024-03-04T08:49:43.279927+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T08:49:43.279927+0000","last_undegraded":"2024-03-04T08:49:43.279927+0000","last_fullsized":"2024-03-04T08:49:43.279927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047062+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T08:49:43.047062+0000","last_peered":"2024-03-04T08:49:43.047062+0000","last_clean":"2024-03-04T08:49:43.047062+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T08:49:43.047062+0000","last_undegraded":"2024-03-04T08:49:43.047062+0000","last_fullsized":"2024-03-04T08:49:43.047062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369747+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T08:49:42.369747+0000","last_peered":"2024-03-04T08:49:42.369747+0000","last_clean":"2024-03-04T08:49:42.369747+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T08:49:42.369747+0000","last_undegraded":"2024-03-04T08:49:42.369747+0000","last_fullsized":"2024-03-04T08:49:42.369747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.053942+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T08:49:54.053942+0000","last_peered":"2024-03-04T08:49:54.053942+0000","last_clean":"2024-03-04T08:49:54.053942+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T08:49:54.053942+0000","last_undegraded":"2024-03-04T08:49:54.053942+0000","last_fullsized":"2024-03-04T08:49:54.053942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276449+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T08:49:43.276449+0000","last_peered":"2024-03-04T08:49:43.276449+0000","last_clean":"2024-03-04T08:49:43.276449+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T08:49:43.276449+0000","last_undegraded":"2024-03-04T08:49:43.276449+0000","last_fullsized":"2024-03-04T08:49:43.276449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.049671+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T08:49:54.049671+0000","last_peered":"2024-03-04T08:49:54.049671+0000","last_clean":"2024-03-04T08:49:54.049671+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T08:49:54.049671+0000","last_undegraded":"2024-03-04T08:49:54.049671+0000","last_fullsized":"2024-03-04T08:49:54.049671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275984+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T08:49:43.275984+0000","last_peered":"2024-03-04T08:49:43.275984+0000","last_clean":"2024-03-04T08:49:43.275984+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T08:49:43.275984+0000","last_undegraded":"2024-03-04T08:49:43.275984+0000","last_fullsized":"2024-03-04T08:49:43.275984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.893508+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T08:49:56.893508+0000","last_peered":"2024-03-04T08:49:56.893508+0000","last_clean":"2024-03-04T08:49:56.893508+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T08:49:56.893508+0000","last_undegraded":"2024-03-04T08:49:56.893508+0000","last_fullsized":"2024-03-04T08:49:56.893508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276106+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T08:49:43.276106+0000","last_peered":"2024-03-04T08:49:43.276106+0000","last_clean":"2024-03-04T08:49:43.276106+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T08:49:43.276106+0000","last_undegraded":"2024-03-04T08:49:43.276106+0000","last_fullsized":"2024-03-04T08:49:43.276106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.404540+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T08:49:49.404540+0000","last_peered":"2024-03-04T08:49:49.404540+0000","last_clean":"2024-03-04T08:49:49.404540+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T08:49:49.404540+0000","last_undegraded":"2024-03-04T08:49:49.404540+0000","last_fullsized":"2024-03-04T08:49:49.404540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325605+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T08:49:42.325605+0000","last_peered":"2024-03-04T08:49:42.325605+0000","last_clean":"2024-03-04T08:49:42.325605+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T08:49:42.325605+0000","last_undegraded":"2024-03-04T08:49:42.325605+0000","last_fullsized":"2024-03-04T08:49:42.325605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.882925+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T08:49:56.882925+0000","last_peered":"2024-03-04T08:49:56.882925+0000","last_clean":"2024-03-04T08:49:56.882925+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T08:49:56.882925+0000","last_undegraded":"2024-03-04T08:49:56.882925+0000","last_fullsized":"2024-03-04T08:49:56.882925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275588+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T08:49:43.275588+0000","last_peered":"2024-03-04T08:49:43.275588+0000","last_clean":"2024-03-04T08:49:43.275588+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T08:49:43.275588+0000","last_undegraded":"2024-03-04T08:49:43.275588+0000","last_fullsized":"2024-03-04T08:49:43.275588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.048045+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T08:49:54.048045+0000","last_peered":"2024-03-04T08:49:54.048045+0000","last_clean":"2024-03-04T08:49:54.048045+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T08:49:54.048045+0000","last_undegraded":"2024-03-04T08:49:54.048045+0000","last_fullsized":"2024-03-04T08:49:54.048045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277053+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T08:49:43.277053+0000","last_peered":"2024-03-04T08:49:43.277053+0000","last_clean":"2024-03-04T08:49:43.277053+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T08:49:43.277053+0000","last_undegraded":"2024-03-04T08:49:43.277053+0000","last_fullsized":"2024-03-04T08:49:43.277053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.304676+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T08:49:49.304676+0000","last_peered":"2024-03-04T08:49:49.304676+0000","last_clean":"2024-03-04T08:49:49.304676+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T08:49:49.304676+0000","last_undegraded":"2024-03-04T08:49:49.304676+0000","last_fullsized":"2024-03-04T08:49:49.304676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325238+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T08:49:42.325238+0000","last_peered":"2024-03-04T08:49:42.325238+0000","last_clean":"2024-03-04T08:49:42.325238+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T08:49:42.325238+0000","last_undegraded":"2024-03-04T08:49:42.325238+0000","last_fullsized":"2024-03-04T08:49:42.325238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326038+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T08:49:42.326038+0000","last_peered":"2024-03-04T08:49:42.326038+0000","last_clean":"2024-03-04T08:49:42.326038+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T08:49:42.326038+0000","last_undegraded":"2024-03-04T08:49:42.326038+0000","last_fullsized":"2024-03-04T08:49:42.326038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.883031+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T08:49:56.883031+0000","last_peered":"2024-03-04T08:49:56.883031+0000","last_clean":"2024-03-04T08:49:56.883031+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T08:49:56.883031+0000","last_undegraded":"2024-03-04T08:49:56.883031+0000","last_fullsized":"2024-03-04T08:49:56.883031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278451+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T08:49:43.278451+0000","last_peered":"2024-03-04T08:49:43.278451+0000","last_clean":"2024-03-04T08:49:43.278451+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T08:49:43.278451+0000","last_undegraded":"2024-03-04T08:49:43.278451+0000","last_fullsized":"2024-03-04T08:49:43.278451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.882376+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T08:49:56.882376+0000","last_peered":"2024-03-04T08:49:56.882376+0000","last_clean":"2024-03-04T08:49:56.882376+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T08:49:56.882376+0000","last_undegraded":"2024-03-04T08:49:56.882376+0000","last_fullsized":"2024-03-04T08:49:56.882376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047218+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T08:49:43.047218+0000","last_peered":"2024-03-04T08:49:43.047218+0000","last_clean":"2024-03-04T08:49:43.047218+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T08:49:43.047218+0000","last_undegraded":"2024-03-04T08:49:43.047218+0000","last_fullsized":"2024-03-04T08:49:43.047218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.607240+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T08:49:43.607240+0000","last_peered":"2024-03-04T08:49:43.607240+0000","last_clean":"2024-03-04T08:49:43.607240+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T08:49:43.607240+0000","last_undegraded":"2024-03-04T08:49:43.607240+0000","last_fullsized":"2024-03-04T08:49:43.607240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047168+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T08:49:43.047168+0000","last_peered":"2024-03-04T08:49:43.047168+0000","last_clean":"2024-03-04T08:49:43.047168+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T08:49:43.047168+0000","last_undegraded":"2024-03-04T08:49:43.047168+0000","last_fullsized":"2024-03-04T08:49:43.047168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.883261+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T08:49:56.883261+0000","last_peered":"2024-03-04T08:49:56.883261+0000","last_clean":"2024-03-04T08:49:56.883261+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T08:49:56.883261+0000","last_undegraded":"2024-03-04T08:49:56.883261+0000","last_fullsized":"2024-03-04T08:49:56.883261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":86220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":253952,"data_stored":85178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":847872,"data_stored":675280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":86040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":84530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":85290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":847872,"data_stored":674670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":86768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:02.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:02.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.234+0000 7f06b2800640 1 Processor -- start 2024-03-04T08:50:02.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.234+0000 7f06b2800640 1 -- start start 2024-03-04T08:50:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.236+0000 7f06b2800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06ac154930 0x7f06ac06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.236+0000 7f06b2800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac0ca550 0x7f06ac0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.236+0000 7f06b2800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac06c6c0 con 0x7f06ac15db50 2024-03-04T08:50:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.236+0000 7f06b2800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac06cfb0 con 0x7f06ac154930 2024-03-04T08:50:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.236+0000 7f06b2800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac154d10 con 0x7f06ac0ca550 2024-03-04T08:50:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.236+0000 7f06ab400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06ac154930 0x7f06ac06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.237+0000 7f06a2a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac0ca550 0x7f06ac0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.237+0000 7f06abe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f06ac15db50 0x7f06ac15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:54026/0 (socket says 172.21.15.46:54026) 2024-03-04T08:50:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.237+0000 7f06abe00640 1 -- 172.21.15.46:0/3978104018 learned_addr learned my addr 172.21.15.46:0/3978104018 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.239+0000 7f06ab400640 1 -- 172.21.15.46:0/3978104018 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac0ca550 msgr2=0x7f06ac0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.239+0000 7f06ab400640 1 --2- 172.21.15.46:0/3978104018 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac0ca550 0x7f06ac0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.239+0000 7f06ab400640 1 -- 172.21.15.46:0/3978104018 >> v1:172.21.15.73:6789/0 conn(0x7f06ac15db50 legacy=0x7f06ac15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:02.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.239+0000 7f06ab400640 1 -- 172.21.15.46:0/3978104018 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0cd180 con 0x7f06ac154930 2024-03-04T08:50:02.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.242+0000 7f06ab400640 1 --2- 172.21.15.46:0/3978104018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac154930 0x7f06ac06d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f069c0097a0 tx=0x7f069c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e1a1c7c7049496 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:02.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.247+0000 7f06aaa00640 1 -- 172.21.15.46:0/3978104018 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c031780 con 0x7f06ac154930 2024-03-04T08:50:02.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.247+0000 7f06aaa00640 1 -- 172.21.15.46:0/3978104018 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c037070 con 0x7f06ac154930 2024-03-04T08:50:02.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.247+0000 7f06aaa00640 1 -- 172.21.15.46:0/3978104018 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c031b40 con 0x7f06ac154930 2024-03-04T08:50:02.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.248+0000 7f06b2800640 1 -- 172.21.15.46:0/3978104018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac154930 msgr2=0x7f06ac06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:02.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.248+0000 7f06b2800640 1 --2- 172.21.15.46:0/3978104018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac154930 0x7f06ac06d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f069c0097a0 tx=0x7f069c02b820 comp rx=0 tx=0).stop 2024-03-04T08:50:02.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.249+0000 7f06b2800640 1 -- 172.21.15.46:0/3978104018 shutdown_connections 2024-03-04T08:50:02.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.249+0000 7f06b2800640 1 --2- 172.21.15.46:0/3978104018 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac0ca550 0x7f06ac0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.249+0000 7f06b2800640 1 --2- 172.21.15.46:0/3978104018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac154930 0x7f06ac06d440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.249+0000 7f06b2800640 1 -- 172.21.15.46:0/3978104018 >> 172.21.15.46:0/3978104018 conn(0x7f06ac0b1920 msgr2=0x7f06ac0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:02.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.249+0000 7f06b2800640 1 -- 172.21.15.46:0/3978104018 shutdown_connections 2024-03-04T08:50:02.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.249+0000 7f06b2800640 1 -- 172.21.15.46:0/3978104018 wait complete. 2024-03-04T08:50:02.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.251+0000 7f06b2800640 1 Processor -- start 2024-03-04T08:50:02.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.251+0000 7f06b2800640 1 -- start start 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.253+0000 7f06b2800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 0x7f06ac148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.253+0000 7f06b2800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac154930 0x7f06ac1ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.253+0000 7f06b2800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06ac15db50 0x7f06ac1eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.253+0000 7f06b2800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac06cc40 con 0x7f06ac0ca550 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.253+0000 7f06b2800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac06c960 con 0x7f06ac15db50 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.253+0000 7f06b2800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac15e810 con 0x7f06ac154930 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.254+0000 7f06a2a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac154930 0x7f06ac1ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:02.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.254+0000 7f06ab400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 0x7f06ac148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:02.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.254+0000 7f06abe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06ac15db50 0x7f06ac1eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:02.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.254+0000 7f06ab400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 0x7f06ac148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46038/0 (socket says 172.21.15.46:46038) 2024-03-04T08:50:02.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.254+0000 7f06ab400640 1 -- 172.21.15.46:0/1958862502 learned_addr learned my addr 172.21.15.46:0/1958862502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:02.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.257+0000 7f06ab400640 1 -- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac154930 msgr2=0x7f06ac1ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:02.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.258+0000 7f06ab400640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac154930 0x7f06ac1ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.258+0000 7f06ab400640 1 -- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06ac15db50 msgr2=0x7f06ac1eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:02.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.258+0000 7f06ab400640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06ac15db50 0x7f06ac1eed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.258+0000 7f06ab400640 1 -- 172.21.15.46:0/1958862502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac14ab10 con 0x7f06ac0ca550 2024-03-04T08:50:02.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.260+0000 7f06ab400640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 0x7f06ac148420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f069c0096f0 tx=0x7f069c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:02.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.265+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c032610 con 0x7f06ac0ca550 2024-03-04T08:50:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.265+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c0327d0 con 0x7f06ac0ca550 2024-03-04T08:50:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.265+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c032bc0 con 0x7f06ac0ca550 2024-03-04T08:50:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.265+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac14a550 con 0x7f06ac0ca550 2024-03-04T08:50:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.265+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac1ee040 con 0x7f06ac0ca550 2024-03-04T08:50:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.266+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac153cb0 con 0x7f06ac0ca550 2024-03-04T08:50:02.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.287+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f069c04c060 con 0x7f06ac0ca550 2024-03-04T08:50:02.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.288+0000 7f06a3e00640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f068806b520 0x7f068806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:02.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.289+0000 7f06a2a00640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f068806b520 0x7f068806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:02.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.289+0000 7f06a2a00640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f068806b520 0x7f068806d9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0cba20 tx=0x7f0694009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.556+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f069c078460 con 0x7f06ac0ca550 2024-03-04T08:50:02.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.557+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f06ac153cb0 con 0x7f06ac0ca550 2024-03-04T08:50:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.755+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06ac0680b0 con 0x7f068806b520 2024-03-04T08:50:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.763+0000 7f06a3e00640 1 -- 172.21.15.46:0/1958862502 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251934 (secure 0 0 0) 0x7f06ac0680b0 con 0x7f068806b520 2024-03-04T08:50:02.763 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T08:50:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f068806b520 msgr2=0x7f068806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f068806b520 0x7f068806d9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0cba20 tx=0x7f0694009190 comp rx=0 tx=0).stop 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 msgr2=0x7f06ac148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 0x7f06ac148420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f069c0096f0 tx=0x7f069c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 shutdown_connections 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f068806b520 0x7f068806d9e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06ac15db50 0x7f06ac1eed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06ac154930 0x7f06ac1ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 --2- 172.21.15.46:0/1958862502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac0ca550 0x7f06ac148420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 >> 172.21.15.46:0/1958862502 conn(0x7f06ac0b1920 msgr2=0x7f06ac15dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 shutdown_connections 2024-03-04T08:50:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:02.768+0000 7f06b2800640 1 -- 172.21.15.46:0/1958862502 wait complete. 2024-03-04T08:50:02.782 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-03-04T08:50:01.434016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":363,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":295,"ondisk_log_size":295,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235988,"kb_used_data":3220,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738732,"statfs":{"total":773094113280,"available":772852461568,"internally_reserved":0,"allocated":3297280,"data_stored":1863976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002581"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281486+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T08:49:43.281486+0000","last_peered":"2024-03-04T08:49:43.281486+0000","last_clean":"2024-03-04T08:49:43.281486+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T08:49:43.281486+0000","last_undegraded":"2024-03-04T08:49:43.281486+0000","last_fullsized":"2024-03-04T08:49:43.281486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047094+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T08:49:43.047094+0000","last_peered":"2024-03-04T08:49:43.047094+0000","last_clean":"2024-03-04T08:49:43.047094+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T08:49:43.047094+0000","last_undegraded":"2024-03-04T08:49:43.047094+0000","last_fullsized":"2024-03-04T08:49:43.047094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047069+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T08:49:43.047069+0000","last_peered":"2024-03-04T08:49:43.047069+0000","last_clean":"2024-03-04T08:49:43.047069+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T08:49:43.047069+0000","last_undegraded":"2024-03-04T08:49:43.047069+0000","last_fullsized":"2024-03-04T08:49:43.047069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369960+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T08:49:42.369960+0000","last_peered":"2024-03-04T08:49:42.369960+0000","last_clean":"2024-03-04T08:49:42.369960+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T08:49:42.369960+0000","last_undegraded":"2024-03-04T08:49:42.369960+0000","last_fullsized":"2024-03-04T08:49:42.369960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280132+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T08:49:43.280132+0000","last_peered":"2024-03-04T08:49:43.280132+0000","last_clean":"2024-03-04T08:49:43.280132+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T08:49:43.280132+0000","last_undegraded":"2024-03-04T08:49:43.280132+0000","last_fullsized":"2024-03-04T08:49:43.280132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369716+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T08:49:42.369716+0000","last_peered":"2024-03-04T08:49:42.369716+0000","last_clean":"2024-03-04T08:49:42.369716+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T08:49:42.369716+0000","last_undegraded":"2024-03-04T08:49:42.369716+0000","last_fullsized":"2024-03-04T08:49:42.369716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279556+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T08:49:43.279556+0000","last_peered":"2024-03-04T08:49:43.279556+0000","last_clean":"2024-03-04T08:49:43.279556+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T08:49:43.279556+0000","last_undegraded":"2024-03-04T08:49:43.279556+0000","last_fullsized":"2024-03-04T08:49:43.279556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280535+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T08:49:43.280535+0000","last_peered":"2024-03-04T08:49:43.280535+0000","last_clean":"2024-03-04T08:49:43.280535+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T08:49:43.280535+0000","last_undegraded":"2024-03-04T08:49:43.280535+0000","last_fullsized":"2024-03-04T08:49:43.280535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281592+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T08:49:43.281592+0000","last_peered":"2024-03-04T08:49:43.281592+0000","last_clean":"2024-03-04T08:49:43.281592+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T08:49:43.281592+0000","last_undegraded":"2024-03-04T08:49:43.281592+0000","last_fullsized":"2024-03-04T08:49:43.281592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280787+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T08:49:43.280787+0000","last_peered":"2024-03-04T08:49:43.280787+0000","last_clean":"2024-03-04T08:49:43.280787+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T08:49:43.280787+0000","last_undegraded":"2024-03-04T08:49:43.280787+0000","last_fullsized":"2024-03-04T08:49:43.280787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280684+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T08:49:43.280684+0000","last_peered":"2024-03-04T08:49:43.280684+0000","last_clean":"2024-03-04T08:49:43.280684+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T08:49:43.280684+0000","last_undegraded":"2024-03-04T08:49:43.280684+0000","last_fullsized":"2024-03-04T08:49:43.280684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276060+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T08:49:43.276060+0000","last_peered":"2024-03-04T08:49:43.276060+0000","last_clean":"2024-03-04T08:49:43.276060+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T08:49:43.276060+0000","last_undegraded":"2024-03-04T08:49:43.276060+0000","last_fullsized":"2024-03-04T08:49:43.276060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276313+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T08:49:43.276313+0000","last_peered":"2024-03-04T08:49:43.276313+0000","last_clean":"2024-03-04T08:49:43.276313+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T08:49:43.276313+0000","last_undegraded":"2024-03-04T08:49:43.276313+0000","last_fullsized":"2024-03-04T08:49:43.276313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046770+0000","last_change":"2024-03-04T08:49:40.146477+0000","last_active":"2024-03-04T08:49:43.046770+0000","last_peered":"2024-03-04T08:49:43.046770+0000","last_clean":"2024-03-04T08:49:43.046770+0000","last_became_active":"2024-03-04T08:49:40.146170+0000","last_became_peered":"2024-03-04T08:49:40.146170+0000","last_unstale":"2024-03-04T08:49:43.046770+0000","last_undegraded":"2024-03-04T08:49:43.046770+0000","last_fullsized":"2024-03-04T08:49:43.046770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:53:13.937230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325117+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T08:49:42.325117+0000","last_peered":"2024-03-04T08:49:42.325117+0000","last_clean":"2024-03-04T08:49:42.325117+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T08:49:42.325117+0000","last_undegraded":"2024-03-04T08:49:42.325117+0000","last_fullsized":"2024-03-04T08:49:42.325117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325919+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T08:49:42.325919+0000","last_peered":"2024-03-04T08:49:42.325919+0000","last_clean":"2024-03-04T08:49:42.325919+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T08:49:42.325919+0000","last_undegraded":"2024-03-04T08:49:42.325919+0000","last_fullsized":"2024-03-04T08:49:42.325919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277148+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T08:49:43.277148+0000","last_peered":"2024-03-04T08:49:43.277148+0000","last_clean":"2024-03-04T08:49:43.277148+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T08:49:43.277148+0000","last_undegraded":"2024-03-04T08:49:43.277148+0000","last_fullsized":"2024-03-04T08:49:43.277148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326173+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T08:49:42.326173+0000","last_peered":"2024-03-04T08:49:42.326173+0000","last_clean":"2024-03-04T08:49:42.326173+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T08:49:42.326173+0000","last_undegraded":"2024-03-04T08:49:42.326173+0000","last_fullsized":"2024-03-04T08:49:42.326173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280559+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T08:49:43.280559+0000","last_peered":"2024-03-04T08:49:43.280559+0000","last_clean":"2024-03-04T08:49:43.280559+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T08:49:43.280559+0000","last_undegraded":"2024-03-04T08:49:43.280559+0000","last_fullsized":"2024-03-04T08:49:43.280559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276042+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T08:49:43.276042+0000","last_peered":"2024-03-04T08:49:43.276042+0000","last_clean":"2024-03-04T08:49:43.276042+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T08:49:43.276042+0000","last_undegraded":"2024-03-04T08:49:43.276042+0000","last_fullsized":"2024-03-04T08:49:43.276042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277967+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T08:49:43.277967+0000","last_peered":"2024-03-04T08:49:43.277967+0000","last_clean":"2024-03-04T08:49:43.277967+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T08:49:43.277967+0000","last_undegraded":"2024-03-04T08:49:43.277967+0000","last_fullsized":"2024-03-04T08:49:43.277967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046777+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T08:49:43.046777+0000","last_peered":"2024-03-04T08:49:43.046777+0000","last_clean":"2024-03-04T08:49:43.046777+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T08:49:43.046777+0000","last_undegraded":"2024-03-04T08:49:43.046777+0000","last_fullsized":"2024-03-04T08:49:43.046777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325115+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T08:49:42.325115+0000","last_peered":"2024-03-04T08:49:42.325115+0000","last_clean":"2024-03-04T08:49:42.325115+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T08:49:42.325115+0000","last_undegraded":"2024-03-04T08:49:42.325115+0000","last_fullsized":"2024-03-04T08:49:42.325115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047184+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T08:49:43.047184+0000","last_peered":"2024-03-04T08:49:43.047184+0000","last_clean":"2024-03-04T08:49:43.047184+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T08:49:43.047184+0000","last_undegraded":"2024-03-04T08:49:43.047184+0000","last_fullsized":"2024-03-04T08:49:43.047184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370272+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T08:49:42.370272+0000","last_peered":"2024-03-04T08:49:42.370272+0000","last_clean":"2024-03-04T08:49:42.370272+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T08:49:42.370272+0000","last_undegraded":"2024-03-04T08:49:42.370272+0000","last_fullsized":"2024-03-04T08:49:42.370272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275907+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T08:49:43.275907+0000","last_peered":"2024-03-04T08:49:43.275907+0000","last_clean":"2024-03-04T08:49:43.275907+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T08:49:43.275907+0000","last_undegraded":"2024-03-04T08:49:43.275907+0000","last_fullsized":"2024-03-04T08:49:43.275907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276346+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T08:49:43.276346+0000","last_peered":"2024-03-04T08:49:43.276346+0000","last_clean":"2024-03-04T08:49:43.276346+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T08:49:43.276346+0000","last_undegraded":"2024-03-04T08:49:43.276346+0000","last_fullsized":"2024-03-04T08:49:43.276346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046951+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T08:49:43.046951+0000","last_peered":"2024-03-04T08:49:43.046951+0000","last_clean":"2024-03-04T08:49:43.046951+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T08:49:43.046951+0000","last_undegraded":"2024-03-04T08:49:43.046951+0000","last_fullsized":"2024-03-04T08:49:43.046951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325310+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T08:49:42.325310+0000","last_peered":"2024-03-04T08:49:42.325310+0000","last_clean":"2024-03-04T08:49:42.325310+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T08:49:42.325310+0000","last_undegraded":"2024-03-04T08:49:42.325310+0000","last_fullsized":"2024-03-04T08:49:42.325310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276935+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T08:49:43.276935+0000","last_peered":"2024-03-04T08:49:43.276935+0000","last_clean":"2024-03-04T08:49:43.276935+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T08:49:43.276935+0000","last_undegraded":"2024-03-04T08:49:43.276935+0000","last_fullsized":"2024-03-04T08:49:43.276935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369643+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T08:49:42.369643+0000","last_peered":"2024-03-04T08:49:42.369643+0000","last_clean":"2024-03-04T08:49:42.369643+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T08:49:42.369643+0000","last_undegraded":"2024-03-04T08:49:42.369643+0000","last_fullsized":"2024-03-04T08:49:42.369643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278146+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T08:49:43.278146+0000","last_peered":"2024-03-04T08:49:43.278146+0000","last_clean":"2024-03-04T08:49:43.278146+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T08:49:43.278146+0000","last_undegraded":"2024-03-04T08:49:43.278146+0000","last_fullsized":"2024-03-04T08:49:43.278146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.407135+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T08:49:49.407135+0000","last_peered":"2024-03-04T08:49:49.407135+0000","last_clean":"2024-03-04T08:49:49.407135+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T08:49:49.407135+0000","last_undegraded":"2024-03-04T08:49:49.407135+0000","last_fullsized":"2024-03-04T08:49:49.407135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276098+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T08:49:43.276098+0000","last_peered":"2024-03-04T08:49:43.276098+0000","last_clean":"2024-03-04T08:49:43.276098+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T08:49:43.276098+0000","last_undegraded":"2024-03-04T08:49:43.276098+0000","last_fullsized":"2024-03-04T08:49:43.276098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.053077+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T08:49:54.053077+0000","last_peered":"2024-03-04T08:49:54.053077+0000","last_clean":"2024-03-04T08:49:54.053077+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T08:49:54.053077+0000","last_undegraded":"2024-03-04T08:49:54.053077+0000","last_fullsized":"2024-03-04T08:49:54.053077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.917199+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T08:49:51.917199+0000","last_peered":"2024-03-04T08:49:51.917199+0000","last_clean":"2024-03-04T08:49:51.917199+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T08:49:51.917199+0000","last_undegraded":"2024-03-04T08:49:51.917199+0000","last_fullsized":"2024-03-04T08:49:51.917199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047047+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T08:49:43.047047+0000","last_peered":"2024-03-04T08:49:43.047047+0000","last_clean":"2024-03-04T08:49:43.047047+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T08:49:43.047047+0000","last_undegraded":"2024-03-04T08:49:43.047047+0000","last_fullsized":"2024-03-04T08:49:43.047047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.054875+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T08:49:54.054875+0000","last_peered":"2024-03-04T08:49:54.054875+0000","last_clean":"2024-03-04T08:49:54.054875+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T08:49:54.054875+0000","last_undegraded":"2024-03-04T08:49:54.054875+0000","last_fullsized":"2024-03-04T08:49:54.054875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275934+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T08:49:43.275934+0000","last_peered":"2024-03-04T08:49:43.275934+0000","last_clean":"2024-03-04T08:49:43.275934+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T08:49:43.275934+0000","last_undegraded":"2024-03-04T08:49:43.275934+0000","last_fullsized":"2024-03-04T08:49:43.275934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.404962+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T08:49:49.404962+0000","last_peered":"2024-03-04T08:49:49.404962+0000","last_clean":"2024-03-04T08:49:49.404962+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T08:49:49.404962+0000","last_undegraded":"2024-03-04T08:49:49.404962+0000","last_fullsized":"2024-03-04T08:49:49.404962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370223+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T08:49:42.370223+0000","last_peered":"2024-03-04T08:49:42.370223+0000","last_clean":"2024-03-04T08:49:42.370223+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T08:49:42.370223+0000","last_undegraded":"2024-03-04T08:49:42.370223+0000","last_fullsized":"2024-03-04T08:49:42.370223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.880438+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T08:49:56.880438+0000","last_peered":"2024-03-04T08:49:56.880438+0000","last_clean":"2024-03-04T08:49:56.880438+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T08:49:56.880438+0000","last_undegraded":"2024-03-04T08:49:56.880438+0000","last_fullsized":"2024-03-04T08:49:56.880438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047304+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T08:49:43.047304+0000","last_peered":"2024-03-04T08:49:43.047304+0000","last_clean":"2024-03-04T08:49:43.047304+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T08:49:43.047304+0000","last_undegraded":"2024-03-04T08:49:43.047304+0000","last_fullsized":"2024-03-04T08:49:43.047304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.198681+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T08:49:49.198681+0000","last_peered":"2024-03-04T08:49:49.198681+0000","last_clean":"2024-03-04T08:49:49.198681+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T08:49:49.198681+0000","last_undegraded":"2024-03-04T08:49:49.198681+0000","last_fullsized":"2024-03-04T08:49:49.198681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325558+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T08:49:42.325558+0000","last_peered":"2024-03-04T08:49:42.325558+0000","last_clean":"2024-03-04T08:49:42.325558+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T08:49:42.325558+0000","last_undegraded":"2024-03-04T08:49:42.325558+0000","last_fullsized":"2024-03-04T08:49:42.325558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.867177+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T08:49:56.867177+0000","last_peered":"2024-03-04T08:49:56.867177+0000","last_clean":"2024-03-04T08:49:56.867177+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T08:49:56.867177+0000","last_undegraded":"2024-03-04T08:49:56.867177+0000","last_fullsized":"2024-03-04T08:49:56.867177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281324+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T08:49:43.281324+0000","last_peered":"2024-03-04T08:49:43.281324+0000","last_clean":"2024-03-04T08:49:43.281324+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T08:49:43.281324+0000","last_undegraded":"2024-03-04T08:49:43.281324+0000","last_fullsized":"2024-03-04T08:49:43.281324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.788081+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T08:49:56.788081+0000","last_peered":"2024-03-04T08:49:56.788081+0000","last_clean":"2024-03-04T08:49:56.788081+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T08:49:56.788081+0000","last_undegraded":"2024-03-04T08:49:56.788081+0000","last_fullsized":"2024-03-04T08:49:56.788081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276382+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T08:49:43.276382+0000","last_peered":"2024-03-04T08:49:43.276382+0000","last_clean":"2024-03-04T08:49:43.276382+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T08:49:43.276382+0000","last_undegraded":"2024-03-04T08:49:43.276382+0000","last_fullsized":"2024-03-04T08:49:43.276382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.056462+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T08:49:54.056462+0000","last_peered":"2024-03-04T08:49:54.056462+0000","last_clean":"2024-03-04T08:49:54.056462+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T08:49:54.056462+0000","last_undegraded":"2024-03-04T08:49:54.056462+0000","last_fullsized":"2024-03-04T08:49:54.056462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325413+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T08:49:42.325413+0000","last_peered":"2024-03-04T08:49:42.325413+0000","last_clean":"2024-03-04T08:49:42.325413+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T08:49:42.325413+0000","last_undegraded":"2024-03-04T08:49:42.325413+0000","last_fullsized":"2024-03-04T08:49:42.325413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.151344+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T08:49:54.151344+0000","last_peered":"2024-03-04T08:49:54.151344+0000","last_clean":"2024-03-04T08:49:54.151344+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T08:49:54.151344+0000","last_undegraded":"2024-03-04T08:49:54.151344+0000","last_fullsized":"2024-03-04T08:49:54.151344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277684+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T08:49:43.277684+0000","last_peered":"2024-03-04T08:49:43.277684+0000","last_clean":"2024-03-04T08:49:43.277684+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T08:49:43.277684+0000","last_undegraded":"2024-03-04T08:49:43.277684+0000","last_fullsized":"2024-03-04T08:49:43.277684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.047848+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T08:49:54.047848+0000","last_peered":"2024-03-04T08:49:54.047848+0000","last_clean":"2024-03-04T08:49:54.047848+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T08:49:54.047848+0000","last_undegraded":"2024-03-04T08:49:54.047848+0000","last_fullsized":"2024-03-04T08:49:54.047848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325325+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T08:49:42.325325+0000","last_peered":"2024-03-04T08:49:42.325325+0000","last_clean":"2024-03-04T08:49:42.325325+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T08:49:42.325325+0000","last_undegraded":"2024-03-04T08:49:42.325325+0000","last_fullsized":"2024-03-04T08:49:42.325325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.605635+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T08:49:43.605635+0000","last_peered":"2024-03-04T08:49:43.605635+0000","last_clean":"2024-03-04T08:49:43.605635+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T08:49:43.605635+0000","last_undegraded":"2024-03-04T08:49:43.605635+0000","last_fullsized":"2024-03-04T08:49:43.605635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.370359+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T08:49:42.370359+0000","last_peered":"2024-03-04T08:49:42.370359+0000","last_clean":"2024-03-04T08:49:42.370359+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T08:49:42.370359+0000","last_undegraded":"2024-03-04T08:49:42.370359+0000","last_fullsized":"2024-03-04T08:49:42.370359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.861241+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T08:49:56.861241+0000","last_peered":"2024-03-04T08:49:56.861241+0000","last_clean":"2024-03-04T08:49:56.861241+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T08:49:56.861241+0000","last_undegraded":"2024-03-04T08:49:56.861241+0000","last_fullsized":"2024-03-04T08:49:56.861241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.281668+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T08:49:43.281668+0000","last_peered":"2024-03-04T08:49:43.281668+0000","last_clean":"2024-03-04T08:49:43.281668+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T08:49:43.281668+0000","last_undegraded":"2024-03-04T08:49:43.281668+0000","last_fullsized":"2024-03-04T08:49:43.281668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.055120+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T08:49:54.055120+0000","last_peered":"2024-03-04T08:49:54.055120+0000","last_clean":"2024-03-04T08:49:54.055120+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T08:49:54.055120+0000","last_undegraded":"2024-03-04T08:49:54.055120+0000","last_fullsized":"2024-03-04T08:49:54.055120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.280764+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T08:49:43.280764+0000","last_peered":"2024-03-04T08:49:43.280764+0000","last_clean":"2024-03-04T08:49:43.280764+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T08:49:43.280764+0000","last_undegraded":"2024-03-04T08:49:43.280764+0000","last_fullsized":"2024-03-04T08:49:43.280764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.049927+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T08:49:54.049927+0000","last_peered":"2024-03-04T08:49:54.049927+0000","last_clean":"2024-03-04T08:49:54.049927+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T08:49:54.049927+0000","last_undegraded":"2024-03-04T08:49:54.049927+0000","last_fullsized":"2024-03-04T08:49:54.049927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325992+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T08:49:42.325992+0000","last_peered":"2024-03-04T08:49:42.325992+0000","last_clean":"2024-03-04T08:49:42.325992+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T08:49:42.325992+0000","last_undegraded":"2024-03-04T08:49:42.325992+0000","last_fullsized":"2024-03-04T08:49:42.325992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277565+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T08:49:43.277565+0000","last_peered":"2024-03-04T08:49:43.277565+0000","last_clean":"2024-03-04T08:49:43.277565+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T08:49:43.277565+0000","last_undegraded":"2024-03-04T08:49:43.277565+0000","last_fullsized":"2024-03-04T08:49:43.277565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.051501+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T08:49:54.051501+0000","last_peered":"2024-03-04T08:49:54.051501+0000","last_clean":"2024-03-04T08:49:54.051501+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T08:49:54.051501+0000","last_undegraded":"2024-03-04T08:49:54.051501+0000","last_fullsized":"2024-03-04T08:49:54.051501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276209+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T08:49:43.276209+0000","last_peered":"2024-03-04T08:49:43.276209+0000","last_clean":"2024-03-04T08:49:43.276209+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T08:49:43.276209+0000","last_undegraded":"2024-03-04T08:49:43.276209+0000","last_fullsized":"2024-03-04T08:49:43.276209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.868981+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T08:49:51.868981+0000","last_peered":"2024-03-04T08:49:51.868981+0000","last_clean":"2024-03-04T08:49:51.868981+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T08:49:51.868981+0000","last_undegraded":"2024-03-04T08:49:51.868981+0000","last_fullsized":"2024-03-04T08:49:51.868981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275709+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T08:49:43.275709+0000","last_peered":"2024-03-04T08:49:43.275709+0000","last_clean":"2024-03-04T08:49:43.275709+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T08:49:43.275709+0000","last_undegraded":"2024-03-04T08:49:43.275709+0000","last_fullsized":"2024-03-04T08:49:43.275709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:51.868993+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T08:49:51.868993+0000","last_peered":"2024-03-04T08:49:51.868993+0000","last_clean":"2024-03-04T08:49:51.868993+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T08:49:51.868993+0000","last_undegraded":"2024-03-04T08:49:51.868993+0000","last_fullsized":"2024-03-04T08:49:51.868993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.046808+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T08:49:43.046808+0000","last_peered":"2024-03-04T08:49:43.046808+0000","last_clean":"2024-03-04T08:49:43.046808+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T08:49:43.046808+0000","last_undegraded":"2024-03-04T08:49:43.046808+0000","last_fullsized":"2024-03-04T08:49:43.046808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.892105+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T08:49:56.892105+0000","last_peered":"2024-03-04T08:49:56.892105+0000","last_clean":"2024-03-04T08:49:56.892105+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T08:49:56.892105+0000","last_undegraded":"2024-03-04T08:49:56.892105+0000","last_fullsized":"2024-03-04T08:49:56.892105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.279927+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T08:49:43.279927+0000","last_peered":"2024-03-04T08:49:43.279927+0000","last_clean":"2024-03-04T08:49:43.279927+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T08:49:43.279927+0000","last_undegraded":"2024-03-04T08:49:43.279927+0000","last_fullsized":"2024-03-04T08:49:43.279927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047062+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T08:49:43.047062+0000","last_peered":"2024-03-04T08:49:43.047062+0000","last_clean":"2024-03-04T08:49:43.047062+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T08:49:43.047062+0000","last_undegraded":"2024-03-04T08:49:43.047062+0000","last_fullsized":"2024-03-04T08:49:43.047062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.369747+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T08:49:42.369747+0000","last_peered":"2024-03-04T08:49:42.369747+0000","last_clean":"2024-03-04T08:49:42.369747+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T08:49:42.369747+0000","last_undegraded":"2024-03-04T08:49:42.369747+0000","last_fullsized":"2024-03-04T08:49:42.369747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.053942+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T08:49:54.053942+0000","last_peered":"2024-03-04T08:49:54.053942+0000","last_clean":"2024-03-04T08:49:54.053942+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T08:49:54.053942+0000","last_undegraded":"2024-03-04T08:49:54.053942+0000","last_fullsized":"2024-03-04T08:49:54.053942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276449+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T08:49:43.276449+0000","last_peered":"2024-03-04T08:49:43.276449+0000","last_clean":"2024-03-04T08:49:43.276449+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T08:49:43.276449+0000","last_undegraded":"2024-03-04T08:49:43.276449+0000","last_fullsized":"2024-03-04T08:49:43.276449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.049671+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T08:49:54.049671+0000","last_peered":"2024-03-04T08:49:54.049671+0000","last_clean":"2024-03-04T08:49:54.049671+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T08:49:54.049671+0000","last_undegraded":"2024-03-04T08:49:54.049671+0000","last_fullsized":"2024-03-04T08:49:54.049671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275984+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T08:49:43.275984+0000","last_peered":"2024-03-04T08:49:43.275984+0000","last_clean":"2024-03-04T08:49:43.275984+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T08:49:43.275984+0000","last_undegraded":"2024-03-04T08:49:43.275984+0000","last_fullsized":"2024-03-04T08:49:43.275984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.893508+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T08:49:56.893508+0000","last_peered":"2024-03-04T08:49:56.893508+0000","last_clean":"2024-03-04T08:49:56.893508+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T08:49:56.893508+0000","last_undegraded":"2024-03-04T08:49:56.893508+0000","last_fullsized":"2024-03-04T08:49:56.893508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.276106+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T08:49:43.276106+0000","last_peered":"2024-03-04T08:49:43.276106+0000","last_clean":"2024-03-04T08:49:43.276106+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T08:49:43.276106+0000","last_undegraded":"2024-03-04T08:49:43.276106+0000","last_fullsized":"2024-03-04T08:49:43.276106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.404540+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T08:49:49.404540+0000","last_peered":"2024-03-04T08:49:49.404540+0000","last_clean":"2024-03-04T08:49:49.404540+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T08:49:49.404540+0000","last_undegraded":"2024-03-04T08:49:49.404540+0000","last_fullsized":"2024-03-04T08:49:49.404540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325605+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T08:49:42.325605+0000","last_peered":"2024-03-04T08:49:42.325605+0000","last_clean":"2024-03-04T08:49:42.325605+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T08:49:42.325605+0000","last_undegraded":"2024-03-04T08:49:42.325605+0000","last_fullsized":"2024-03-04T08:49:42.325605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.882925+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T08:49:56.882925+0000","last_peered":"2024-03-04T08:49:56.882925+0000","last_clean":"2024-03-04T08:49:56.882925+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T08:49:56.882925+0000","last_undegraded":"2024-03-04T08:49:56.882925+0000","last_fullsized":"2024-03-04T08:49:56.882925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.275588+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T08:49:43.275588+0000","last_peered":"2024-03-04T08:49:43.275588+0000","last_clean":"2024-03-04T08:49:43.275588+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T08:49:43.275588+0000","last_undegraded":"2024-03-04T08:49:43.275588+0000","last_fullsized":"2024-03-04T08:49:43.275588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:54.048045+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T08:49:54.048045+0000","last_peered":"2024-03-04T08:49:54.048045+0000","last_clean":"2024-03-04T08:49:54.048045+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T08:49:54.048045+0000","last_undegraded":"2024-03-04T08:49:54.048045+0000","last_fullsized":"2024-03-04T08:49:54.048045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.277053+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T08:49:43.277053+0000","last_peered":"2024-03-04T08:49:43.277053+0000","last_clean":"2024-03-04T08:49:43.277053+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T08:49:43.277053+0000","last_undegraded":"2024-03-04T08:49:43.277053+0000","last_fullsized":"2024-03-04T08:49:43.277053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:49.304676+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T08:49:49.304676+0000","last_peered":"2024-03-04T08:49:49.304676+0000","last_clean":"2024-03-04T08:49:49.304676+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T08:49:49.304676+0000","last_undegraded":"2024-03-04T08:49:49.304676+0000","last_fullsized":"2024-03-04T08:49:49.304676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.325238+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T08:49:42.325238+0000","last_peered":"2024-03-04T08:49:42.325238+0000","last_clean":"2024-03-04T08:49:42.325238+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T08:49:42.325238+0000","last_undegraded":"2024-03-04T08:49:42.325238+0000","last_fullsized":"2024-03-04T08:49:42.325238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:42.326038+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T08:49:42.326038+0000","last_peered":"2024-03-04T08:49:42.326038+0000","last_clean":"2024-03-04T08:49:42.326038+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T08:49:42.326038+0000","last_undegraded":"2024-03-04T08:49:42.326038+0000","last_fullsized":"2024-03-04T08:49:42.326038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.883031+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T08:49:56.883031+0000","last_peered":"2024-03-04T08:49:56.883031+0000","last_clean":"2024-03-04T08:49:56.883031+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T08:49:56.883031+0000","last_undegraded":"2024-03-04T08:49:56.883031+0000","last_fullsized":"2024-03-04T08:49:56.883031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.278451+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T08:49:43.278451+0000","last_peered":"2024-03-04T08:49:43.278451+0000","last_clean":"2024-03-04T08:49:43.278451+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T08:49:43.278451+0000","last_undegraded":"2024-03-04T08:49:43.278451+0000","last_fullsized":"2024-03-04T08:49:43.278451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.882376+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T08:49:56.882376+0000","last_peered":"2024-03-04T08:49:56.882376+0000","last_clean":"2024-03-04T08:49:56.882376+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T08:49:56.882376+0000","last_undegraded":"2024-03-04T08:49:56.882376+0000","last_fullsized":"2024-03-04T08:49:56.882376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047218+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T08:49:43.047218+0000","last_peered":"2024-03-04T08:49:43.047218+0000","last_clean":"2024-03-04T08:49:43.047218+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T08:49:43.047218+0000","last_undegraded":"2024-03-04T08:49:43.047218+0000","last_fullsized":"2024-03-04T08:49:43.047218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.607240+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T08:49:43.607240+0000","last_peered":"2024-03-04T08:49:43.607240+0000","last_clean":"2024-03-04T08:49:43.607240+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T08:49:43.607240+0000","last_undegraded":"2024-03-04T08:49:43.607240+0000","last_fullsized":"2024-03-04T08:49:43.607240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:43.047168+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T08:49:43.047168+0000","last_peered":"2024-03-04T08:49:43.047168+0000","last_clean":"2024-03-04T08:49:43.047168+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T08:49:43.047168+0000","last_undegraded":"2024-03-04T08:49:43.047168+0000","last_fullsized":"2024-03-04T08:49:43.047168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-04T08:49:56.883261+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T08:49:56.883261+0000","last_peered":"2024-03-04T08:49:56.883261+0000","last_clean":"2024-03-04T08:49:56.883261+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T08:49:56.883261+0000","last_undegraded":"2024-03-04T08:49:56.883261+0000","last_fullsized":"2024-03-04T08:49:56.883261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":86220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":253952,"data_stored":85178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":847872,"data_stored":675280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":86040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":84530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":85290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":847872,"data_stored":674670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":86768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:02.786 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T08:50:02.786 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-04T08:50:02.787 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-04T08:50:02.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-04T08:50:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.012+0000 7f818e000640 1 Processor -- start 2024-03-04T08:50:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.013+0000 7f818e000640 1 -- start start 2024-03-04T08:50:03.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.014+0000 7f818e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f81880c0e80 0x7f81880c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:03.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.014+0000 7f818e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8188072a80 0x7f8188072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:03.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.014+0000 7f818e000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8188071e00 con 0x7f818806f530 2024-03-04T08:50:03.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.014+0000 7f818e000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880733f0 con 0x7f81880c0e80 2024-03-04T08:50:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.014+0000 7f818e000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81881572b0 con 0x7f8188072a80 2024-03-04T08:50:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.015+0000 7f8186a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f81880c0e80 0x7f81880c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.015+0000 7f8187e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8188072a80 0x7f8188072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.015+0000 7f8186a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f81880c0e80 0x7f81880c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46044/0 (socket says 172.21.15.46:46044) 2024-03-04T08:50:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.015+0000 7f8186a00640 1 -- 172.21.15.46:0/1190108259 learned_addr learned my addr 172.21.15.46:0/1190108259 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:03.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.018+0000 7f8186a00640 1 -- 172.21.15.46:0/1190108259 >> v2:172.21.15.73:3300/0 conn(0x7f8188072a80 msgr2=0x7f8188072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:03.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.018+0000 7f8186a00640 1 --2- 172.21.15.46:0/1190108259 >> v2:172.21.15.73:3300/0 conn(0x7f8188072a80 0x7f8188072eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.018+0000 7f8186a00640 1 -- 172.21.15.46:0/1190108259 >> v1:172.21.15.73:6789/0 conn(0x7f818806f530 legacy=0x7f81880716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:03.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.018+0000 7f8186a00640 1 -- 172.21.15.46:0/1190108259 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880c2a00 con 0x7f81880c0e80 2024-03-04T08:50:03.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.020+0000 7f8186a00640 1 --2- 172.21.15.46:0/1190108259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f81880c7f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f818806bed0 tx=0x7f817802e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397f03dd1db234ce server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:03.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.024+0000 7f8186000640 1 -- 172.21.15.46:0/1190108259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817803b070 con 0x7f81880c0e80 2024-03-04T08:50:03.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.024+0000 7f8186000640 1 -- 172.21.15.46:0/1190108259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8178036440 con 0x7f81880c0e80 2024-03-04T08:50:03.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.024+0000 7f8186000640 1 -- 172.21.15.46:0/1190108259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178036810 con 0x7f81880c0e80 2024-03-04T08:50:03.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 -- 172.21.15.46:0/1190108259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 msgr2=0x7f81880c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:03.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 --2- 172.21.15.46:0/1190108259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f81880c7f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f818806bed0 tx=0x7f817802e200 comp rx=0 tx=0).stop 2024-03-04T08:50:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 -- 172.21.15.46:0/1190108259 shutdown_connections 2024-03-04T08:50:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 --2- 172.21.15.46:0/1190108259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f81880c7f70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 --2- 172.21.15.46:0/1190108259 >> v2:172.21.15.73:3300/0 conn(0x7f8188072a80 0x7f8188072eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 -- 172.21.15.46:0/1190108259 >> 172.21.15.46:0/1190108259 conn(0x7f818806aff0 msgr2=0x7f818806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 -- 172.21.15.46:0/1190108259 shutdown_connections 2024-03-04T08:50:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.025+0000 7f818e000640 1 -- 172.21.15.46:0/1190108259 wait complete. 2024-03-04T08:50:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.027+0000 7f818e000640 1 Processor -- start 2024-03-04T08:50:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.027+0000 7f818e000640 1 -- start start 2024-03-04T08:50:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f818e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f818806f530 0x7f81880c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f818e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8188072a80 0x7f818814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f818e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f818814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f818e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188156c60 con 0x7f81880c0e80 2024-03-04T08:50:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f818e000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188156980 con 0x7f8188072a80 2024-03-04T08:50:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f818e000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8188156f40 con 0x7f818806f530 2024-03-04T08:50:03.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f8186a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8188072a80 0x7f818814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:03.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f8187e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f818814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:03.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f8187400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f818806f530 0x7f81880c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:03.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.028+0000 7f8186a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8188072a80 0x7f818814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40350/0 (socket says 172.21.15.46:40350) 2024-03-04T08:50:03.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.029+0000 7f8186a00640 1 -- 172.21.15.46:0/2527602240 learned_addr learned my addr 172.21.15.46:0/2527602240 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:03.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.032+0000 7f8187e00640 1 -- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f818806f530 msgr2=0x7f81880c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:03.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.033+0000 7f8187e00640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f818806f530 0x7f81880c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.033+0000 7f8187e00640 1 -- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8188072a80 msgr2=0x7f818814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:03.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.033+0000 7f8187e00640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8188072a80 0x7f818814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.033+0000 7f8187e00640 1 -- 172.21.15.46:0/2527602240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188152250 con 0x7f81880c0e80 2024-03-04T08:50:03.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.035+0000 7f8187e00640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f818814e380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8180009d90 tx=0x7f818000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.039+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180018020 con 0x7f81880c0e80 2024-03-04T08:50:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.039+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8180014480 con 0x7f81880c0e80 2024-03-04T08:50:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.039+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180014870 con 0x7f81880c0e80 2024-03-04T08:50:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.039+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81880c5580 con 0x7f81880c0e80 2024-03-04T08:50:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.040+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81880c4280 con 0x7f81880c0e80 2024-03-04T08:50:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.041+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81880680b0 con 0x7f81880c0e80 2024-03-04T08:50:03.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.342+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8180005d10 con 0x7f81880c0e80 2024-03-04T08:50:03.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.344+0000 7f817f400640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f816406b4d0 0x7f816406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:03.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.344+0000 7f8187400640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f816406b4d0 0x7f816406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:03.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.345+0000 7f8187400640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f816406b4d0 0x7f816406d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8170000f60 tx=0x7f8170009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:03.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.371+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8180057d10 con 0x7f81880c0e80 2024-03-04T08:50:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.372+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8180022030 con 0x7f81880c0e80 2024-03-04T08:50:03.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.618+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81880b19e0 con 0x7f81880c0e80 2024-03-04T08:50:03.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.713+0000 7f817f400640 1 -- 172.21.15.46:0/2527602240 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8180010040 con 0x7f81880c0e80 2024-03-04T08:50:03.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:03.710 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-04T08:50:03.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f816406b4d0 msgr2=0x7f816406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:03.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f816406b4d0 0x7f816406d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8170000f60 tx=0x7f8170009040 comp rx=0 tx=0).stop 2024-03-04T08:50:03.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 msgr2=0x7f818814e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:03.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f818814e380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8180009d90 tx=0x7f818000c490 comp rx=0 tx=0).stop 2024-03-04T08:50:03.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 shutdown_connections 2024-03-04T08:50:03.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f816406b4d0 0x7f816406d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8188072a80 0x7f818814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81880c0e80 0x7f818814e380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 --2- 172.21.15.46:0/2527602240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f818806f530 0x7f81880c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 >> 172.21.15.46:0/2527602240 conn(0x7f818806aff0 msgr2=0x7f81881556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 shutdown_connections 2024-03-04T08:50:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:03.717+0000 7f818e000640 1 -- 172.21.15.46:0/2527602240 wait complete. 2024-03-04T08:50:03.731 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-04T08:50:04.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:04.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.249+0000 7fcc9fe00640 1 Processor -- start 2024-03-04T08:50:04.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.249+0000 7fcc9fe00640 1 -- start start 2024-03-04T08:50:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.250+0000 7fcc9fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca00d01b0 0x7fcca00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.250+0000 7fcc9fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcca00ca900 0x7fcca015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.250+0000 7fcc9fe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca015c4b0 con 0x7fcca015c040 2024-03-04T08:50:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.250+0000 7fcc9fe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca015b310 con 0x7fcca00ca900 2024-03-04T08:50:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.250+0000 7fcc9fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca015a700 con 0x7fcca00d01b0 2024-03-04T08:50:04.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.251+0000 7fcc9ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca00d01b0 0x7fcca00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:04.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.251+0000 7fcc9ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca00d01b0 0x7fcca00ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40362/0 (socket says 172.21.15.46:40362) 2024-03-04T08:50:04.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.251+0000 7fcc9ea00640 1 -- 172.21.15.46:0/758189918 learned_addr learned my addr 172.21.15.46:0/758189918 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:04.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.251+0000 7fcc9e000640 1 --2- 172.21.15.46:0/758189918 >> v2:172.21.15.46:3300/0 conn(0x7fcca00ca900 0x7fcca015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:04.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.254+0000 7fcc9ea00640 1 -- 172.21.15.46:0/758189918 >> v2:172.21.15.46:3300/0 conn(0x7fcca00ca900 msgr2=0x7fcca015bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:04.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.254+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/758189918 >> v2:172.21.15.46:3300/0 conn(0x7fcca00ca900 0x7fcca015bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:04.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.254+0000 7fcc9ea00640 1 -- 172.21.15.46:0/758189918 >> v1:172.21.15.46:6789/0 conn(0x7fcca015c040 legacy=0x7fcca006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:04.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.254+0000 7fcc9ea00640 1 -- 172.21.15.46:0/758189918 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca015a9e0 con 0x7fcca00d01b0 2024-03-04T08:50:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.256+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/758189918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00d01b0 0x7fcca00ca3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcca00cc420 tx=0x7fcc9002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355daa18db1eb044 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:04.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.261+0000 7fcc9d600640 1 -- 172.21.15.46:0/758189918 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9002f850 con 0x7fcca00d01b0 2024-03-04T08:50:04.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.261+0000 7fcc9d600640 1 -- 172.21.15.46:0/758189918 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9002f9f0 con 0x7fcca00d01b0 2024-03-04T08:50:04.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.261+0000 7fcc9d600640 1 -- 172.21.15.46:0/758189918 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9002fdc0 con 0x7fcca00d01b0 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 -- 172.21.15.46:0/758189918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00d01b0 msgr2=0x7fcca00ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/758189918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00d01b0 0x7fcca00ca3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcca00cc420 tx=0x7fcc9002ba30 comp rx=0 tx=0).stop 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 -- 172.21.15.46:0/758189918 shutdown_connections 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/758189918 >> v2:172.21.15.46:3300/0 conn(0x7fcca00ca900 0x7fcca015bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/758189918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00d01b0 0x7fcca00ca3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 -- 172.21.15.46:0/758189918 >> 172.21.15.46:0/758189918 conn(0x7fcca0066c40 msgr2=0x7fcca0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:04.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 -- 172.21.15.46:0/758189918 shutdown_connections 2024-03-04T08:50:04.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.262+0000 7fcc9fe00640 1 -- 172.21.15.46:0/758189918 wait complete. 2024-03-04T08:50:04.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.264+0000 7fcc9fe00640 1 Processor -- start 2024-03-04T08:50:04.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.264+0000 7fcc9fe00640 1 -- start start 2024-03-04T08:50:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00ca900 0x7fcca01efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00d01b0 0x7fcca00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 0x7fcca014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00d0590 con 0x7fcca015c040 2024-03-04T08:50:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015afa0 con 0x7fcca00ca900 2024-03-04T08:50:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9fe00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015a3b0 con 0x7fcca00d01b0 2024-03-04T08:50:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.265+0000 7fcc9f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 0x7fcca014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.266+0000 7fcc9e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00d01b0 0x7fcca00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.266+0000 7fcc9f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 0x7fcca014ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46072/0 (socket says 172.21.15.46:46072) 2024-03-04T08:50:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.266+0000 7fcc9f400640 1 -- 172.21.15.46:0/3644153724 learned_addr learned my addr 172.21.15.46:0/3644153724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:04.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.270+0000 7fcc9f400640 1 -- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00d01b0 msgr2=0x7fcca00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:04.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.270+0000 7fcc9f400640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00d01b0 0x7fcca00ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:04.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.270+0000 7fcc9f400640 1 -- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00ca900 msgr2=0x7fcca01efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:04.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.270+0000 7fcc9f400640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00ca900 0x7fcca01efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:04.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.270+0000 7fcc9f400640 1 -- 172.21.15.46:0/3644153724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca01f3910 con 0x7fcca015c040 2024-03-04T08:50:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.273+0000 7fcc9f400640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 0x7fcca014ca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7d0 tx=0x7fcc9800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.278+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98003b70 con 0x7fcca015c040 2024-03-04T08:50:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.278+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98003d30 con 0x7fcca015c040 2024-03-04T08:50:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.278+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800aa90 con 0x7fcca015c040 2024-03-04T08:50:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.278+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca01f3bf0 con 0x7fcca015c040 2024-03-04T08:50:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.278+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01f41b0 con 0x7fcca015c040 2024-03-04T08:50:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.280+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca01f43b0 con 0x7fcca015c040 2024-03-04T08:50:04.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.325+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc9800ac30 con 0x7fcca015c040 2024-03-04T08:50:04.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.328+0000 7fcc96a00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b520 0x7fcc8006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.329+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b520 0x7fcc8006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.329+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b520 0x7fcc8006d9e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc90039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:04.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.356+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc980573a0 con 0x7fcca015c040 2024-03-04T08:50:04.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.690+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcca01f43b0 con 0x7fcca015c040 2024-03-04T08:50:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:04.960+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcca004f330 con 0x7fcca015c040 2024-03-04T08:50:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.162+0000 7fcc96a00640 1 -- 172.21.15.46:0/3644153724 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7fcc98059a00 con 0x7fcca015c040 2024-03-04T08:50:05.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:05.160 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b520 msgr2=0x7fcc8006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b520 0x7fcc8006d9e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc90039040 comp rx=0 tx=0).stop 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 msgr2=0x7fcca014ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 0x7fcca014ca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7d0 tx=0x7fcc9800cc90 comp rx=0 tx=0).stop 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 shutdown_connections 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b520 0x7fcc8006d9e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca015c040 0x7fcca014ca40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00d01b0 0x7fcca00ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/3644153724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00ca900 0x7fcca01efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.165+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 >> 172.21.15.46:0/3644153724 conn(0x7fcca0066c40 msgr2=0x7fcca006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.166+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 shutdown_connections 2024-03-04T08:50:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.166+0000 7fcc9fe00640 1 -- 172.21.15.46:0/3644153724 wait complete. 2024-03-04T08:50:05.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:49:22.737500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:49:37.195578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:49:38.689323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:50:05.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:50:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.374+0000 7f0af1400640 1 Processor -- start 2024-03-04T08:50:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.374+0000 7f0af1400640 1 -- start start 2024-03-04T08:50:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.376+0000 7f0af1400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec06aff0 0x7f0aec0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.376+0000 7f0af1400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0aec15acf0 0x7f0aec06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.376+0000 7f0af1400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0c7920 con 0x7f0aec1544d0 2024-03-04T08:50:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.376+0000 7f0af1400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec0c2fe0 con 0x7f0aec15acf0 2024-03-04T08:50:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.376+0000 7f0af1400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0c2990 con 0x7f0aec06aff0 2024-03-04T08:50:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.377+0000 7f0aebe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0aec1544d0 0x7f0aec0ccb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:54048/0 (socket says 172.21.15.46:54048) 2024-03-04T08:50:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.377+0000 7f0aebe00640 1 -- 172.21.15.46:0/801752563 learned_addr learned my addr 172.21.15.46:0/801752563 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.377+0000 7f0af0a00640 1 --2- 172.21.15.46:0/801752563 >> v2:172.21.15.46:3300/0 conn(0x7f0aec15acf0 0x7f0aec06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.377+0000 7f0aeb400640 1 --2- 172.21.15.46:0/801752563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec06aff0 0x7f0aec0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.380+0000 7f0aeaa00640 1 -- 172.21.15.46:0/801752563 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105605110 0 0) 0x7f0aec0c7920 con 0x7f0aec1544d0 2024-03-04T08:50:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.380+0000 7f0aeaa00640 1 -- 172.21.15.46:0/801752563 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad0003520 con 0x7f0aec1544d0 2024-03-04T08:50:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.381+0000 7f0af0a00640 1 -- 172.21.15.46:0/801752563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec06aff0 msgr2=0x7f0aec0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.381+0000 7f0af0a00640 1 --2- 172.21.15.46:0/801752563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec06aff0 0x7f0aec0c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.381+0000 7f0af0a00640 1 -- 172.21.15.46:0/801752563 >> v1:172.21.15.73:6789/0 conn(0x7f0aec1544d0 legacy=0x7f0aec0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.381+0000 7f0af0a00640 1 -- 172.21.15.46:0/801752563 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0c2c70 con 0x7f0aec15acf0 2024-03-04T08:50:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.383+0000 7f0af0a00640 1 --2- 172.21.15.46:0/801752563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec15acf0 0x7f0aec06b900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009d90 tx=0x7f0ae402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e44c0668e6b96a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:05.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.388+0000 7f0aeaa00640 1 -- 172.21.15.46:0/801752563 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4039070 con 0x7f0aec15acf0 2024-03-04T08:50:05.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.388+0000 7f0aeaa00640 1 -- 172.21.15.46:0/801752563 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae402cce0 con 0x7f0aec15acf0 2024-03-04T08:50:05.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.388+0000 7f0aeaa00640 1 -- 172.21.15.46:0/801752563 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4034660 con 0x7f0aec15acf0 2024-03-04T08:50:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 -- 172.21.15.46:0/801752563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec15acf0 msgr2=0x7f0aec06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 --2- 172.21.15.46:0/801752563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec15acf0 0x7f0aec06b900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009d90 tx=0x7f0ae402bf30 comp rx=0 tx=0).stop 2024-03-04T08:50:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 -- 172.21.15.46:0/801752563 shutdown_connections 2024-03-04T08:50:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 --2- 172.21.15.46:0/801752563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec15acf0 0x7f0aec06b900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 --2- 172.21.15.46:0/801752563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec06aff0 0x7f0aec0c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 -- 172.21.15.46:0/801752563 >> 172.21.15.46:0/801752563 conn(0x7f0aec070220 msgr2=0x7f0aec070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 -- 172.21.15.46:0/801752563 shutdown_connections 2024-03-04T08:50:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.389+0000 7f0af1400640 1 -- 172.21.15.46:0/801752563 wait complete. 2024-03-04T08:50:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.391+0000 7f0af1400640 1 Processor -- start 2024-03-04T08:50:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.391+0000 7f0af1400640 1 -- start start 2024-03-04T08:50:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.392+0000 7f0af1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec06aff0 0x7f0aec1f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.392+0000 7f0af1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 0x7f0aec14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.392+0000 7f0af1400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec15acf0 0x7f0aec1e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.392+0000 7f0af1400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec154a30 con 0x7f0aec06aff0 2024-03-04T08:50:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.392+0000 7f0af1400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1548b0 con 0x7f0aec1544d0 2024-03-04T08:50:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.392+0000 7f0af1400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0cd270 con 0x7f0aec15acf0 2024-03-04T08:50:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.393+0000 7f0aeb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 0x7f0aec14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.393+0000 7f0aebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec06aff0 0x7f0aec1f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.393+0000 7f0af0a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec15acf0 0x7f0aec1e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.393+0000 7f0aeb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 0x7f0aec14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40368/0 (socket says 172.21.15.46:40368) 2024-03-04T08:50:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.393+0000 7f0aebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec06aff0 0x7f0aec1f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46100/0 (socket says 172.21.15.46:46100) 2024-03-04T08:50:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.393+0000 7f0aeb400640 1 -- 172.21.15.46:0/2475354462 learned_addr learned my addr 172.21.15.46:0/2475354462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.397+0000 7f0aeb400640 1 -- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec15acf0 msgr2=0x7f0aec1e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.397+0000 7f0aeb400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec15acf0 0x7f0aec1e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.397+0000 7f0aeb400640 1 -- 172.21.15.46:0/2475354462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec06aff0 msgr2=0x7f0aec1f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.397+0000 7f0aeb400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec06aff0 0x7f0aec1f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.397+0000 7f0aeb400640 1 -- 172.21.15.46:0/2475354462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec1effe0 con 0x7f0aec1544d0 2024-03-04T08:50:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.400+0000 7f0aeb400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 0x7f0aec14c830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800ea10 tx=0x7f0ad800eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.402+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8017070 con 0x7f0aec1544d0 2024-03-04T08:50:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.402+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec1f0250 con 0x7f0aec1544d0 2024-03-04T08:50:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.402+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec1f0810 con 0x7f0aec1544d0 2024-03-04T08:50:05.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.403+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec0cd010 con 0x7f0aec1544d0 2024-03-04T08:50:05.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.405+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad800ca00 con 0x7f0aec1544d0 2024-03-04T08:50:05.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.405+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8021060 con 0x7f0aec1544d0 2024-03-04T08:50:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.684+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ad801a070 con 0x7f0aec1544d0 2024-03-04T08:50:05.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.687+0000 7f0ae3e00640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0acc06b500 0x7f0acc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:05.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.687+0000 7f0aebe00640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0acc06b500 0x7f0acc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:05.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.688+0000 7f0aebe00640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0acc06b500 0x7f0acc06d9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0011e0 tx=0x7f0adc007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:05.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.691+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ad80571a0 con 0x7f0aec1544d0 2024-03-04T08:50:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.702+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0aec0cd010 con 0x7f0aec1544d0 2024-03-04T08:50:05.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:05.922+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0aec04f410 con 0x7f0aec1544d0 2024-03-04T08:50:06.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.020+0000 7f0ae3e00640 1 -- 172.21.15.46:0/2475354462 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ad8059100 con 0x7f0aec1544d0 2024-03-04T08:50:06.017 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-03-04T08:50:06.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0acc06b500 msgr2=0x7f0acc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0acc06b500 0x7f0acc06d9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0011e0 tx=0x7f0adc007d30 comp rx=0 tx=0).stop 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 msgr2=0x7f0aec14c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 0x7f0aec14c830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800ea10 tx=0x7f0ad800eed0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 shutdown_connections 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0acc06b500 0x7f0acc06d9c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aec1544d0 0x7f0aec14c830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aec15acf0 0x7f0aec1e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 --2- 172.21.15.46:0/2475354462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aec06aff0 0x7f0aec1f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 >> 172.21.15.46:0/2475354462 conn(0x7f0aec070220 msgr2=0x7f0aec0ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 shutdown_connections 2024-03-04T08:50:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.023+0000 7f0af1400640 1 -- 172.21.15.46:0/2475354462 wait complete. 2024-03-04T08:50:06.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:50:06.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.217+0000 7f1607200640 1 Processor -- start 2024-03-04T08:50:06.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.218+0000 7f1607200640 1 -- start start 2024-03-04T08:50:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.220+0000 7f1607200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1600151350 0x7f16000720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.220+0000 7f1607200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f16000c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.220+0000 7f1607200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000c8120 con 0x7f1600157bd0 2024-03-04T08:50:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.220+0000 7f1607200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1600157110 con 0x7f1600151350 2024-03-04T08:50:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.220+0000 7f1607200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16000c10a0 con 0x7f160015a700 2024-03-04T08:50:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.221+0000 7f15f7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f16000c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:06.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.221+0000 7f15f7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f16000c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:54170/0 (socket says 172.21.15.46:54170) 2024-03-04T08:50:06.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.221+0000 7f15f7e00640 1 -- 172.21.15.46:0/3712571270 learned_addr learned my addr 172.21.15.46:0/3712571270 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:06.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.221+0000 7f1605200640 1 --1- 172.21.15.46:0/3712571270 >> v1:172.21.15.46:6789/0 conn(0x7f1600157bd0 0x7f16000c85b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43972/0 (socket says 172.21.15.46:43972) 2024-03-04T08:50:06.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.221+0000 7f15ffe00640 1 --2- 172.21.15.46:0/3712571270 >> v2:172.21.15.46:3300/0 conn(0x7f1600151350 0x7f16000720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:06.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.224+0000 7f15f7e00640 1 -- 172.21.15.46:0/3712571270 >> v2:172.21.15.46:3300/0 conn(0x7f1600151350 msgr2=0x7f16000720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:06.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.224+0000 7f15f7e00640 1 --2- 172.21.15.46:0/3712571270 >> v2:172.21.15.46:3300/0 conn(0x7f1600151350 0x7f16000720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.224+0000 7f15f7e00640 1 -- 172.21.15.46:0/3712571270 >> v1:172.21.15.46:6789/0 conn(0x7f1600157bd0 legacy=0x7f16000c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.224+0000 7f15f7e00640 1 -- 172.21.15.46:0/3712571270 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000c1380 con 0x7f160015a700 2024-03-04T08:50:06.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.227+0000 7f15f7e00640 1 --2- 172.21.15.46:0/3712571270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f16000c7ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009870 tx=0x7f15e802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdd28b551c2bd71e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:06.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.231+0000 7f15ff400640 1 -- 172.21.15.46:0/3712571270 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e802f840 con 0x7f160015a700 2024-03-04T08:50:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.231+0000 7f15ff400640 1 -- 172.21.15.46:0/3712571270 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e802f9e0 con 0x7f160015a700 2024-03-04T08:50:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.231+0000 7f15ff400640 1 -- 172.21.15.46:0/3712571270 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e802fdb0 con 0x7f160015a700 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 -- 172.21.15.46:0/3712571270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 msgr2=0x7f16000c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 --2- 172.21.15.46:0/3712571270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f16000c7ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009870 tx=0x7f15e802ba20 comp rx=0 tx=0).stop 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 -- 172.21.15.46:0/3712571270 shutdown_connections 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 --2- 172.21.15.46:0/3712571270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f16000c7ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 --2- 172.21.15.46:0/3712571270 >> v2:172.21.15.46:3300/0 conn(0x7f1600151350 0x7f16000720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 -- 172.21.15.46:0/3712571270 >> 172.21.15.46:0/3712571270 conn(0x7f160006aff0 msgr2=0x7f160006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 -- 172.21.15.46:0/3712571270 shutdown_connections 2024-03-04T08:50:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.232+0000 7f1607200640 1 -- 172.21.15.46:0/3712571270 wait complete. 2024-03-04T08:50:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.234+0000 7f1607200640 1 Processor -- start 2024-03-04T08:50:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.234+0000 7f1607200640 1 -- start start 2024-03-04T08:50:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.235+0000 7f1607200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1600151350 0x7f160014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.235+0000 7f1607200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1600157bd0 0x7f1600159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.235+0000 7f1607200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f160014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:06.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.235+0000 7f1607200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001576b0 con 0x7f1600151350 2024-03-04T08:50:06.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.235+0000 7f1607200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001573d0 con 0x7f1600157bd0 2024-03-04T08:50:06.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.235+0000 7f1607200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16000b1fc0 con 0x7f160015a700 2024-03-04T08:50:06.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.236+0000 7f15ffe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1600151350 0x7f160014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:06.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.236+0000 7f1605200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f160014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:06.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.236+0000 7f15f7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1600157bd0 0x7f1600159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:06.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.236+0000 7f15ffe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1600151350 0x7f160014d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46120/0 (socket says 172.21.15.46:46120) 2024-03-04T08:50:06.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.236+0000 7f15ffe00640 1 -- 172.21.15.46:0/3426376997 learned_addr learned my addr 172.21.15.46:0/3426376997 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:06.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.239+0000 7f1605200640 1 -- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1600157bd0 msgr2=0x7f1600159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.239+0000 7f1605200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1600157bd0 0x7f1600159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.239+0000 7f1605200640 1 -- 172.21.15.46:0/3426376997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1600151350 msgr2=0x7f160014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.239+0000 7f1605200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1600151350 0x7f160014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.239+0000 7f1605200640 1 -- 172.21.15.46:0/3426376997 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160014c310 con 0x7f160015a700 2024-03-04T08:50:06.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.242+0000 7f1605200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f160014d980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15f80012e0 tx=0x7f15f800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:06.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.244+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8018070 con 0x7f160015a700 2024-03-04T08:50:06.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.244+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16000cb010 con 0x7f160015a700 2024-03-04T08:50:06.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.245+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16000cb5b0 con 0x7f160015a700 2024-03-04T08:50:06.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.246+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16000680b0 con 0x7f160015a700 2024-03-04T08:50:06.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.449+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8004d60 con 0x7f160015a700 2024-03-04T08:50:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.527+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8022060 con 0x7f160015a700 2024-03-04T08:50:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.534+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f15f801b070 con 0x7f160015a700 2024-03-04T08:50:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.537+0000 7f15fcc00640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f15dc06b4d0 0x7f15dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.537+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15f8089f10 con 0x7f160015a700 2024-03-04T08:50:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.537+0000 7f15ffe00640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f15dc06b4d0 0x7f15dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.538+0000 7f15ffe00640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f15dc06b4d0 0x7f15dc06d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009b60 tx=0x7f15f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.550+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f15f8058730 con 0x7f160015a700 2024-03-04T08:50:06.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.756+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1600150b70 con 0x7f160015a700 2024-03-04T08:50:06.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.780+0000 7f15fcc00640 1 -- 172.21.15.46:0/3426376997 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15f805c7d0 con 0x7f160015a700 2024-03-04T08:50:06.776 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f15dc06b4d0 msgr2=0x7f15dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f15dc06b4d0 0x7f15dc06d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009b60 tx=0x7f15f0009190 comp rx=0 tx=0).stop 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 msgr2=0x7f160014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f160014d980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15f80012e0 tx=0x7f15f800cb90 comp rx=0 tx=0).stop 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 shutdown_connections 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f15dc06b4d0 0x7f15dc06d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1600157bd0 0x7f1600159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f160015a700 0x7f160014d980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 --2- 172.21.15.46:0/3426376997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1600151350 0x7f160014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.782+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 >> 172.21.15.46:0/3426376997 conn(0x7f160006aff0 msgr2=0x7f1600147420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:06.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.783+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 shutdown_connections 2024-03-04T08:50:06.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:06.783+0000 7f1607200640 1 -- 172.21.15.46:0/3426376997 wait complete. 2024-03-04T08:50:06.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:50:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.037+0000 7f1d32400640 1 Processor -- start 2024-03-04T08:50:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.037+0000 7f1d32400640 1 -- start start 2024-03-04T08:50:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.038+0000 7f1d32400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d2c0cc700 0x7f1d2c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.038+0000 7f1d32400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0ca6d0 con 0x7f1d2c154b30 2024-03-04T08:50:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.038+0000 7f1d32400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0ca990 con 0x7f1d2c154750 2024-03-04T08:50:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.038+0000 7f1d32400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0cac70 con 0x7f1d2c0cc700 2024-03-04T08:50:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.039+0000 7f1d2b400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1d2c154750 0x7f1d2c0cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:54064/0 (socket says 172.21.15.46:54064) 2024-03-04T08:50:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.039+0000 7f1d2b400640 1 -- 172.21.15.46:0/2152892892 learned_addr learned my addr 172.21.15.46:0/2152892892 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:07.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.040+0000 7f1d2be00640 1 --2- 172.21.15.46:0/2152892892 >> v2:172.21.15.46:3300/0 conn(0x7f1d2c0cc700 0x7f1d2c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.042+0000 7f1d2a000640 1 -- 172.21.15.46:0/2152892892 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857853927 0 0) 0x7f1d2c0ca990 con 0x7f1d2c154750 2024-03-04T08:50:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.043+0000 7f1d2a000640 1 -- 172.21.15.46:0/2152892892 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10003520 con 0x7f1d2c154750 2024-03-04T08:50:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.046+0000 7f1d2be00640 1 -- 172.21.15.46:0/2152892892 >> v1:172.21.15.73:6789/0 conn(0x7f1d2c154750 legacy=0x7f1d2c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.046+0000 7f1d2be00640 1 -- 172.21.15.46:0/2152892892 >> v1:172.21.15.46:6789/0 conn(0x7f1d2c154b30 legacy=0x7f1d2c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.046+0000 7f1d2be00640 1 -- 172.21.15.46:0/2152892892 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c15a900 con 0x7f1d2c0cc700 2024-03-04T08:50:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.049+0000 7f1d2be00640 1 --2- 172.21.15.46:0/2152892892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c0ccb50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009d90 tx=0x7f1d2402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b9e761a925c955 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.055+0000 7f1d2a000640 1 -- 172.21.15.46:0/2152892892 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24039070 con 0x7f1d2c0cc700 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.055+0000 7f1d2a000640 1 -- 172.21.15.46:0/2152892892 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2402cd80 con 0x7f1d2c0cc700 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.055+0000 7f1d2a000640 1 -- 172.21.15.46:0/2152892892 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24034660 con 0x7f1d2c0cc700 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 -- 172.21.15.46:0/2152892892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0cc700 msgr2=0x7f1d2c0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 --2- 172.21.15.46:0/2152892892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c0ccb50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009d90 tx=0x7f1d2402bfd0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 -- 172.21.15.46:0/2152892892 shutdown_connections 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 --2- 172.21.15.46:0/2152892892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c0ccb50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 -- 172.21.15.46:0/2152892892 >> 172.21.15.46:0/2152892892 conn(0x7f1d2c066c40 msgr2=0x7f1d2c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 -- 172.21.15.46:0/2152892892 shutdown_connections 2024-03-04T08:50:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.056+0000 7f1d32400640 1 -- 172.21.15.46:0/2152892892 wait complete. 2024-03-04T08:50:07.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.059+0000 7f1d32400640 1 Processor -- start 2024-03-04T08:50:07.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.059+0000 7f1d32400640 1 -- start start 2024-03-04T08:50:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.060+0000 7f1d32400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.060+0000 7f1d32400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d2c154750 0x7f1d2c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.060+0000 7f1d32400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0d0490 0x7f1d2c1f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.060+0000 7f1d32400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0ce820 con 0x7f1d2c0d0490 2024-03-04T08:50:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.060+0000 7f1d32400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c15aec0 con 0x7f1d2c0cc700 2024-03-04T08:50:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.060+0000 7f1d32400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c15a5b0 con 0x7f1d2c154750 2024-03-04T08:50:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.061+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.061+0000 7f1d2aa00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d2c154750 0x7f1d2c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.061+0000 7f1d2be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0d0490 0x7f1d2c1f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.061+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c14f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40390/0 (socket says 172.21.15.46:40390) 2024-03-04T08:50:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.061+0000 7f1d2b400640 1 -- 172.21.15.46:0/3768841655 learned_addr learned my addr 172.21.15.46:0/3768841655 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:07.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.065+0000 7f1d2aa00640 1 -- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d2c0cc700 msgr2=0x7f1d2c14f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.065+0000 7f1d2aa00640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c14f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.065+0000 7f1d2aa00640 1 -- 172.21.15.46:0/3768841655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0d0490 msgr2=0x7f1d2c1f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.065+0000 7f1d2aa00640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0d0490 0x7f1d2c1f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.065+0000 7f1d2aa00640 1 -- 172.21.15.46:0/3768841655 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c159a10 con 0x7f1d2c154750 2024-03-04T08:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.069+0000 7f1d2aa00640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d2c154750 0x7f1d2c151450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800c420 tx=0x7f1d1800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.072+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d180052d0 con 0x7f1d2c154750 2024-03-04T08:50:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.072+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c0d09f0 con 0x7f1d2c154750 2024-03-04T08:50:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.072+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c159f90 con 0x7f1d2c154750 2024-03-04T08:50:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.074+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c0680b0 con 0x7f1d2c154750 2024-03-04T08:50:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.074+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18005470 con 0x7f1d2c154750 2024-03-04T08:50:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.074+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18020060 con 0x7f1d2c154750 2024-03-04T08:50:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.354+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d18007220 con 0x7f1d2c154750 2024-03-04T08:50:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.356+0000 7f1d23400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d0c06b500 0x7f1d0c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.356+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d180899f0 con 0x7f1d2c154750 2024-03-04T08:50:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.357+0000 7f1d2b400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d0c06b500 0x7f1d0c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.358+0000 7f1d2b400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d0c06b500 0x7f1d0c06d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0011e0 tx=0x7f1d1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.365+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1d18058220 con 0x7f1d2c154750 2024-03-04T08:50:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.566+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d2c14de10 con 0x7f1d2c154750 2024-03-04T08:50:07.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.574+0000 7f1d23400640 1 -- 172.21.15.46:0/3768841655 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d1805c2c0 con 0x7f1d2c154750 2024-03-04T08:50:07.571 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-03-04T08:50:07.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d0c06b500 msgr2=0x7f1d0c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d0c06b500 0x7f1d0c06d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0011e0 tx=0x7f1d1c009040 comp rx=0 tx=0).stop 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d2c154750 msgr2=0x7f1d2c151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d2c154750 0x7f1d2c151450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800c420 tx=0x7f1d1800c8e0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 shutdown_connections 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1d0c06b500 0x7f1d0c06d9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2c0d0490 0x7f1d2c1f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d2c154750 0x7f1d2c151450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 --2- 172.21.15.46:0/3768841655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d2c0cc700 0x7f1d2c14f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 >> 172.21.15.46:0/3768841655 conn(0x7f1d2c066c40 msgr2=0x7f1d2c153590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 shutdown_connections 2024-03-04T08:50:07.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.577+0000 7f1d32400640 1 -- 172.21.15.46:0/3768841655 wait complete. 2024-03-04T08:50:07.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.780+0000 7f5a68e00640 1 Processor -- start 2024-03-04T08:50:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.780+0000 7f5a68e00640 1 -- start start 2024-03-04T08:50:07.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.781+0000 7f5a68e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a6406d4e0 0x7f5a6406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.781+0000 7f5a68e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6415e3b0 0x7f5a64071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.781+0000 7f5a68e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a6406d8c0 0x7f5a64071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.781+0000 7f5a68e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6406ea90 con 0x7f5a6406d4e0 2024-03-04T08:50:07.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.781+0000 7f5a68e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6415e860 con 0x7f5a6406d8c0 2024-03-04T08:50:07.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.781+0000 7f5a68e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640c2020 con 0x7f5a6415e3b0 2024-03-04T08:50:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.782+0000 7f5a62800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a6406d8c0 0x7f5a64071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.782+0000 7f5a61e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a6406d4e0 0x7f5a6406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.782+0000 7f5a61400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6415e3b0 0x7f5a64071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.782+0000 7f5a61e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a6406d4e0 0x7f5a6406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46146/0 (socket says 172.21.15.46:46146) 2024-03-04T08:50:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.782+0000 7f5a61e00640 1 -- 172.21.15.46:0/1589215015 learned_addr learned my addr 172.21.15.46:0/1589215015 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.785+0000 7f5a61e00640 1 -- 172.21.15.46:0/1589215015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6415e3b0 msgr2=0x7f5a64071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.785+0000 7f5a61e00640 1 --2- 172.21.15.46:0/1589215015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6415e3b0 0x7f5a64071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.785+0000 7f5a61e00640 1 -- 172.21.15.46:0/1589215015 >> v2:172.21.15.73:3300/0 conn(0x7f5a6406d8c0 msgr2=0x7f5a64071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.785+0000 7f5a61e00640 1 --2- 172.21.15.46:0/1589215015 >> v2:172.21.15.73:3300/0 conn(0x7f5a6406d8c0 0x7f5a64071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.785+0000 7f5a61e00640 1 -- 172.21.15.46:0/1589215015 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a640c2300 con 0x7f5a6406d4e0 2024-03-04T08:50:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.787+0000 7f5a61e00640 1 --2- 172.21.15.46:0/1589215015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6406d4e0 0x7f5a6406e550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5a640b1c80 tx=0x7f5a5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db91f72da9b16f03 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.792+0000 7f5a60a00640 1 -- 172.21.15.46:0/1589215015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54034070 con 0x7f5a6406d4e0 2024-03-04T08:50:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.792+0000 7f5a60a00640 1 -- 172.21.15.46:0/1589215015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a54030860 con 0x7f5a6406d4e0 2024-03-04T08:50:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.792+0000 7f5a60a00640 1 -- 172.21.15.46:0/1589215015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54030c30 con 0x7f5a6406d4e0 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.793+0000 7f5a68e00640 1 -- 172.21.15.46:0/1589215015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6406d4e0 msgr2=0x7f5a6406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.793+0000 7f5a68e00640 1 --2- 172.21.15.46:0/1589215015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6406d4e0 0x7f5a6406e550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5a640b1c80 tx=0x7f5a5402b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 -- 172.21.15.46:0/1589215015 shutdown_connections 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 --2- 172.21.15.46:0/1589215015 >> v2:172.21.15.73:3300/0 conn(0x7f5a6406d8c0 0x7f5a64071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 --2- 172.21.15.46:0/1589215015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6415e3b0 0x7f5a64071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 --2- 172.21.15.46:0/1589215015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6406d4e0 0x7f5a6406e550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 -- 172.21.15.46:0/1589215015 >> 172.21.15.46:0/1589215015 conn(0x7f5a640c88d0 msgr2=0x7f5a640c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 -- 172.21.15.46:0/1589215015 shutdown_connections 2024-03-04T08:50:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.794+0000 7f5a68e00640 1 -- 172.21.15.46:0/1589215015 wait complete. 2024-03-04T08:50:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.796+0000 7f5a68e00640 1 Processor -- start 2024-03-04T08:50:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.796+0000 7f5a68e00640 1 -- start start 2024-03-04T08:50:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.798+0000 7f5a68e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6406d4e0 0x7f5a6414e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.798+0000 7f5a68e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6406d8c0 0x7f5a641594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.798+0000 7f5a68e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6415e3b0 0x7f5a6415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.798+0000 7f5a68e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640c2ba0 con 0x7f5a6415e3b0 2024-03-04T08:50:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.798+0000 7f5a68e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640c28c0 con 0x7f5a6406d8c0 2024-03-04T08:50:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.798+0000 7f5a68e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6406df40 con 0x7f5a6406d4e0 2024-03-04T08:50:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.799+0000 7f5a61400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6406d8c0 0x7f5a641594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.799+0000 7f5a61e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6406d4e0 0x7f5a6414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.799+0000 7f5a62800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6415e3b0 0x7f5a6415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.799+0000 7f5a61400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6406d8c0 0x7f5a641594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40402/0 (socket says 172.21.15.46:40402) 2024-03-04T08:50:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.799+0000 7f5a61400640 1 -- 172.21.15.46:0/2484686499 learned_addr learned my addr 172.21.15.46:0/2484686499 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.803+0000 7f5a61e00640 1 -- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6406d8c0 msgr2=0x7f5a641594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.803+0000 7f5a61e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6406d8c0 0x7f5a641594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.803+0000 7f5a61e00640 1 -- 172.21.15.46:0/2484686499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6415e3b0 msgr2=0x7f5a6415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.803+0000 7f5a61e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6415e3b0 0x7f5a6415d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.803+0000 7f5a61e00640 1 -- 172.21.15.46:0/2484686499 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64158cf0 con 0x7f5a6406d4e0 2024-03-04T08:50:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.805+0000 7f5a61e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6406d4e0 0x7f5a6414e830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a6406bfd0 tx=0x7f5a54004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.809+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54048070 con 0x7f5a6406d4e0 2024-03-04T08:50:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.809+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a54030660 con 0x7f5a6406d4e0 2024-03-04T08:50:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.809+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54034040 con 0x7f5a6406d4e0 2024-03-04T08:50:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.809+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a64158400 con 0x7f5a6406d4e0 2024-03-04T08:50:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.810+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a64158f90 con 0x7f5a6406d4e0 2024-03-04T08:50:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:07.811+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a640680b0 con 0x7f5a6406d4e0 2024-03-04T08:50:08.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.078+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a5404b070 con 0x7f5a6406d4e0 2024-03-04T08:50:08.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.079+0000 7f5a5a000640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5a4406b520 0x7f5a4406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.080+0000 7f5a61400640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5a4406b520 0x7f5a4406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.080+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a54079100 con 0x7f5a6406d4e0 2024-03-04T08:50:08.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.081+0000 7f5a61400640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5a4406b520 0x7f5a4406d9e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a50006a90 tx=0x7f5a50009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:08.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.092+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5a54052020 con 0x7f5a6406d4e0 2024-03-04T08:50:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.429+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a6406dd00 con 0x7f5a6406d4e0 2024-03-04T08:50:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.464+0000 7f5a5a000640 1 -- 172.21.15.46:0/2484686499 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6630 (secure 0 0 0) 0x7f5a54030830 con 0x7f5a6406d4e0 2024-03-04T08:50:08.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:08.461 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:49:40.471641+0000","modified":"2024-03-04T08:49:57.389959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4267,"mds_2":4262,"mds_3":4259,"mds_4":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4259":{"gid":4259,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4262":{"gid":4262,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4252,4259,4262,4267,4273]},"id":1}]} 2024-03-04T08:50:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5a4406b520 msgr2=0x7f5a4406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5a4406b520 0x7f5a4406d9e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a50006a90 tx=0x7f5a50009190 comp rx=0 tx=0).stop 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6406d4e0 msgr2=0x7f5a6414e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6406d4e0 0x7f5a6414e830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a6406bfd0 tx=0x7f5a54004730 comp rx=0 tx=0).stop 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 shutdown_connections 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5a4406b520 0x7f5a4406d9e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6406d8c0 0x7f5a641594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a6415e3b0 0x7f5a6415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 --2- 172.21.15.46:0/2484686499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6406d4e0 0x7f5a6414e830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 >> 172.21.15.46:0/2484686499 conn(0x7f5a640c88d0 msgr2=0x7f5a640c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 shutdown_connections 2024-03-04T08:50:08.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.467+0000 7f5a68e00640 1 -- 172.21.15.46:0/2484686499 wait complete. 2024-03-04T08:50:08.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.669+0000 7f19ad800640 1 Processor -- start 2024-03-04T08:50:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.669+0000 7f19ad800640 1 -- start start 2024-03-04T08:50:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.670+0000 7f19ad800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19a80cf110 0x7f19a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.670+0000 7f19ad800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a815a5f0 0x7f19a80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.670+0000 7f19ad800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a815ab50 con 0x7f19a80caaa0 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.671+0000 7f19ad800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a8154db0 con 0x7f19a80cf110 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.671+0000 7f19ad800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80cd9e0 con 0x7f19a815a5f0 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.671+0000 7f19a6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19a80cf110 0x7f19a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.671+0000 7f19a7400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f19a80caaa0 0x7f19a80ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43986/0 (socket says 172.21.15.46:43986) 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.671+0000 7f19a7400640 1 -- 172.21.15.46:0/24288347 learned_addr learned my addr 172.21.15.46:0/24288347 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.671+0000 7f199fe00640 1 --2- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a815a5f0 0x7f19a80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.674+0000 7f19a6a00640 1 -- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a815a5f0 msgr2=0x7f19a80ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.674+0000 7f19a6a00640 1 --2- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a815a5f0 0x7f19a80ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.674+0000 7f19a6a00640 1 -- 172.21.15.46:0/24288347 >> v1:172.21.15.46:6789/0 conn(0x7f19a80caaa0 legacy=0x7f19a80ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.674+0000 7f19a6a00640 1 -- 172.21.15.46:0/24288347 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a815ae30 con 0x7f19a80cf110 2024-03-04T08:50:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.676+0000 7f19a6a00640 1 --2- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a80cf4f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f19980097a0 tx=0x7f199802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db53bab43ec1c724 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.681+0000 7f19a6000640 1 -- 172.21.15.46:0/24288347 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998035020 con 0x7f19a80cf110 2024-03-04T08:50:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.681+0000 7f19a6000640 1 -- 172.21.15.46:0/24288347 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998031810 con 0x7f19a80cf110 2024-03-04T08:50:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.681+0000 7f19a6000640 1 -- 172.21.15.46:0/24288347 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998031be0 con 0x7f19a80cf110 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 -- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 msgr2=0x7f19a80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 --2- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a80cf4f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f19980097a0 tx=0x7f199802b8b0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 -- 172.21.15.46:0/24288347 shutdown_connections 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 --2- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a815a5f0 0x7f19a80ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 --2- 172.21.15.46:0/24288347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a80cf4f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 -- 172.21.15.46:0/24288347 >> 172.21.15.46:0/24288347 conn(0x7f19a80b1710 msgr2=0x7f19a80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 -- 172.21.15.46:0/24288347 shutdown_connections 2024-03-04T08:50:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.682+0000 7f19ad800640 1 -- 172.21.15.46:0/24288347 wait complete. 2024-03-04T08:50:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.684+0000 7f19ad800640 1 Processor -- start 2024-03-04T08:50:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.684+0000 7f19ad800640 1 -- start start 2024-03-04T08:50:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19ad800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a80caaa0 0x7f19a814bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19ad800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a81f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19ad800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a815a5f0 0x7f19a80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19ad800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a815b3f0 con 0x7f19a815a5f0 2024-03-04T08:50:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19ad800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80cfa30 con 0x7f19a80cf110 2024-03-04T08:50:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19ad800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80cdc30 con 0x7f19a80caaa0 2024-03-04T08:50:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.685+0000 7f19a7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a815a5f0 0x7f19a80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.686+0000 7f199fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a81f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.686+0000 7f19a6a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a80caaa0 0x7f19a814bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.686+0000 7f199fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a81f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40418/0 (socket says 172.21.15.46:40418) 2024-03-04T08:50:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.686+0000 7f199fe00640 1 -- 172.21.15.46:0/4012921019 learned_addr learned my addr 172.21.15.46:0/4012921019 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:08.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.689+0000 7f199fe00640 1 -- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a80caaa0 msgr2=0x7f19a814bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.689+0000 7f199fe00640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a80caaa0 0x7f19a814bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.689+0000 7f199fe00640 1 -- 172.21.15.46:0/4012921019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a815a5f0 msgr2=0x7f19a80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.690+0000 7f199fe00640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a815a5f0 0x7f19a80c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.690+0000 7f199fe00640 1 -- 172.21.15.46:0/4012921019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a814c5a0 con 0x7f19a80cf110 2024-03-04T08:50:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.690+0000 7f19a7400640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a815a5f0 0x7f19a80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:08.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.692+0000 7f199fe00640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a81f3fd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f199000e870 tx=0x7f199000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.697+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990017070 con 0x7f19a80cf110 2024-03-04T08:50:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.697+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000c940 con 0x7f19a80cf110 2024-03-04T08:50:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.697+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000cd30 con 0x7f19a80cf110 2024-03-04T08:50:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.697+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a81f0260 con 0x7f19a80cf110 2024-03-04T08:50:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.697+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a81f0820 con 0x7f19a80cf110 2024-03-04T08:50:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.698+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a80b1530 con 0x7f19a80cf110 2024-03-04T08:50:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.731+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f199001a070 con 0x7f19a80cf110 2024-03-04T08:50:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.732+0000 7f199ea00640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f198406b520 0x7f198406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.733+0000 7f19a6a00640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f198406b520 0x7f198406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.733+0000 7f19a6a00640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f198406b520 0x7f198406d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1998036000 tx=0x7f1998008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.735+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1990056d10 con 0x7f19a80cf110 2024-03-04T08:50:08.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:08.988+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f19a80b1530 con 0x7f19a80cf110 2024-03-04T08:50:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.212+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a8074df0 con 0x7f19a80cf110 2024-03-04T08:50:09.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.249+0000 7f199ea00640 1 -- 172.21.15.46:0/4012921019 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f1990058c70 con 0x7f19a80cf110 2024-03-04T08:50:09.251 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:09.251 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:49:42.200601+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f198406b520 msgr2=0x7f198406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f198406b520 0x7f198406d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1998036000 tx=0x7f1998008030 comp rx=0 tx=0).stop 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 msgr2=0x7f19a81f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a81f3fd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f199000e870 tx=0x7f199000ed30 comp rx=0 tx=0).stop 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 shutdown_connections 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f198406b520 0x7f198406d9e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19a80cf110 0x7f19a81f3fd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a815a5f0 0x7f19a80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 --2- 172.21.15.46:0/4012921019 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19a80caaa0 0x7f19a814bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 >> 172.21.15.46:0/4012921019 conn(0x7f19a80b1710 msgr2=0x7f19a8153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 shutdown_connections 2024-03-04T08:50:09.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.252+0000 7f19ad800640 1 -- 172.21.15.46:0/4012921019 wait complete. 2024-03-04T08:50:09.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:49:22.737500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:49:37.195578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:49:38.689323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:50:09.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:50:09.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:09.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:09.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.476+0000 7f2ea1000640 1 Processor -- start 2024-03-04T08:50:09.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.477+0000 7f2ea1000640 1 -- start start 2024-03-04T08:50:09.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.478+0000 7f2ea1000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2e9c15b700 0x7f2e9c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:09.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.479+0000 7f2ea1000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0c10b0 con 0x7f2e9c152350 2024-03-04T08:50:09.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.479+0000 7f2ea1000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0c1370 con 0x7f2e9c151f70 2024-03-04T08:50:09.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.479+0000 7f2ea1000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c0e80 con 0x7f2e9c15b700 2024-03-04T08:50:09.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.479+0000 7f2e9a800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2e9c152350 0x7f2e9c0c5230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43994/0 (socket says 172.21.15.46:43994) 2024-03-04T08:50:09.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.479+0000 7f2e9a800640 1 -- 172.21.15.46:0/885855258 learned_addr learned my addr 172.21.15.46:0/885855258 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:09.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.480+0000 7f2e93e00640 1 --2- 172.21.15.46:0/885855258 >> v2:172.21.15.73:3300/0 conn(0x7f2e9c15b700 0x7f2e9c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:09.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.484+0000 7f2e93e00640 1 -- 172.21.15.46:0/885855258 >> v1:172.21.15.73:6789/0 conn(0x7f2e9c151f70 legacy=0x7f2e9c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.484+0000 7f2e93e00640 1 -- 172.21.15.46:0/885855258 >> v1:172.21.15.46:6789/0 conn(0x7f2e9c152350 legacy=0x7f2e9c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.484+0000 7f2e93e00640 1 -- 172.21.15.46:0/885855258 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0c1650 con 0x7f2e9c15b700 2024-03-04T08:50:09.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.490+0000 7f2e93e00640 1 --2- 172.21.15.46:0/885855258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c06f700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e840097a0 tx=0x7f2e8402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9f524a812a252ae server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:09.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.494+0000 7f2e99400640 1 -- 172.21.15.46:0/885855258 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8402f810 con 0x7f2e9c15b700 2024-03-04T08:50:09.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2e99400640 1 -- 172.21.15.46:0/885855258 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8402f9b0 con 0x7f2e9c15b700 2024-03-04T08:50:09.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2e99400640 1 -- 172.21.15.46:0/885855258 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8402fd80 con 0x7f2e9c15b700 2024-03-04T08:50:09.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2ea1000640 1 -- 172.21.15.46:0/885855258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 msgr2=0x7f2e9c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2ea1000640 1 --2- 172.21.15.46:0/885855258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c06f700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e840097a0 tx=0x7f2e8402b9f0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2ea1000640 1 -- 172.21.15.46:0/885855258 shutdown_connections 2024-03-04T08:50:09.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2ea1000640 1 --2- 172.21.15.46:0/885855258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c06f700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.495+0000 7f2ea1000640 1 -- 172.21.15.46:0/885855258 >> 172.21.15.46:0/885855258 conn(0x7f2e9c06aff0 msgr2=0x7f2e9c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:09.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.496+0000 7f2ea1000640 1 -- 172.21.15.46:0/885855258 shutdown_connections 2024-03-04T08:50:09.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.496+0000 7f2ea1000640 1 -- 172.21.15.46:0/885855258 wait complete. 2024-03-04T08:50:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.497+0000 7f2ea1000640 1 Processor -- start 2024-03-04T08:50:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.497+0000 7f2ea1000640 1 -- start start 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.498+0000 7f2ea1000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e9c151f70 0x7f2e9c0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.498+0000 7f2ea1000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 0x7f2e9c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.498+0000 7f2ea1000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.498+0000 7f2ea1000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c158600 con 0x7f2e9c152350 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.498+0000 7f2ea1000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c158320 con 0x7f2e9c15b700 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.498+0000 7f2ea1000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c2b30 con 0x7f2e9c151f70 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.499+0000 7f2e93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 0x7f2e9c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.499+0000 7f2e9a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:09.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.499+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e9c151f70 0x7f2e9c0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:09.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.499+0000 7f2e93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 0x7f2e9c0c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46182/0 (socket says 172.21.15.46:46182) 2024-03-04T08:50:09.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.499+0000 7f2e93e00640 1 -- 172.21.15.46:0/1159867426 learned_addr learned my addr 172.21.15.46:0/1159867426 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:09.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.503+0000 7f2e93e00640 1 -- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e9c151f70 msgr2=0x7f2e9c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.503+0000 7f2e93e00640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e9c151f70 0x7f2e9c0ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.503+0000 7f2e93e00640 1 -- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 msgr2=0x7f2e9c0c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:09.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.503+0000 7f2e93e00640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c0c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:09.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.503+0000 7f2e93e00640 1 -- 172.21.15.46:0/1159867426 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0c3250 con 0x7f2e9c152350 2024-03-04T08:50:09.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.505+0000 7f2e93e00640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 0x7f2e9c0c45b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009890 tx=0x7f2e84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:09.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.509+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84046070 con 0x7f2e9c152350 2024-03-04T08:50:09.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.509+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84037c90 con 0x7f2e9c152350 2024-03-04T08:50:09.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.509+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8402fe60 con 0x7f2e9c152350 2024-03-04T08:50:09.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.509+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c0c3510 con 0x7f2e9c152350 2024-03-04T08:50:09.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.510+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c0c3ad0 con 0x7f2e9c152350 2024-03-04T08:50:09.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.511+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0c40e0 con 0x7f2e9c152350 2024-03-04T08:50:09.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.542+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e84049070 con 0x7f2e9c152350 2024-03-04T08:50:09.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.543+0000 7f2e92000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2e7806b520 0x7f2e7806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:09.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.544+0000 7f2e99e00640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2e7806b520 0x7f2e7806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:09.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.544+0000 7f2e99e00640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2e7806b520 0x7f2e7806d9e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000f60 tx=0x7f2e8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.549+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e84078ba0 con 0x7f2e9c152350 2024-03-04T08:50:09.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:09.890+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2e84050020 con 0x7f2e9c152350 2024-03-04T08:50:10.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.093+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e9c0680b0 con 0x7f2e9c152350 2024-03-04T08:50:10.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.140+0000 7f2e92000640 1 -- 172.21.15.46:0/1159867426 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e84033030 con 0x7f2e9c152350 2024-03-04T08:50:10.137 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-03-04T08:50:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.143+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2e7806b520 msgr2=0x7f2e7806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.143+0000 7f2ea1000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2e7806b520 0x7f2e7806d9e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000f60 tx=0x7f2e8c009040 comp rx=0 tx=0).stop 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.143+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 msgr2=0x7f2e9c0c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.143+0000 7f2ea1000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 0x7f2e9c0c45b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009890 tx=0x7f2e84004730 comp rx=0 tx=0).stop 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 shutdown_connections 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2e7806b520 0x7f2e7806d9e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e9c15b700 0x7f2e9c0c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e9c152350 0x7f2e9c0c45b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 --2- 172.21.15.46:0/1159867426 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e9c151f70 0x7f2e9c0ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 >> 172.21.15.46:0/1159867426 conn(0x7f2e9c06aff0 msgr2=0x7f2e9c072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 shutdown_connections 2024-03-04T08:50:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.144+0000 7f2ea1000640 1 -- 172.21.15.46:0/1159867426 wait complete. 2024-03-04T08:50:10.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:50:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.426+0000 7f748be00640 1 Processor -- start 2024-03-04T08:50:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.426+0000 7f748be00640 1 -- start start 2024-03-04T08:50:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.427+0000 7f748be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 0x7f748c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.427+0000 7f748be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0cc270 con 0x7f748c15a950 2024-03-04T08:50:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.427+0000 7f748be00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0ccfc0 con 0x7f748c0cd220 2024-03-04T08:50:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.427+0000 7f748be00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0cf1d0 con 0x7f748c0caae0 2024-03-04T08:50:10.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.428+0000 7f748aa00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 0x7f748c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:10.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.428+0000 7f748aa00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 0x7f748c15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:54244/0 (socket says 172.21.15.46:54244) 2024-03-04T08:50:10.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.428+0000 7f748aa00640 1 -- 172.21.15.46:0/2418987412 learned_addr learned my addr 172.21.15.46:0/2418987412 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.431+0000 7f748aa00640 1 -- 172.21.15.46:0/2418987412 >> v1:172.21.15.73:6789/0 conn(0x7f748c0cd220 legacy=0x7f748c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.431+0000 7f748aa00640 1 -- 172.21.15.46:0/2418987412 >> v1:172.21.15.46:6789/0 conn(0x7f748c15a950 legacy=0x7f748c164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.431+0000 7f748aa00640 1 -- 172.21.15.46:0/2418987412 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0cf400 con 0x7f748c0caae0 2024-03-04T08:50:10.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.434+0000 7f748aa00640 1 --2- 172.21.15.46:0/2418987412 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 0x7f748c15a410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098a0 tx=0x7f747c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22aa35b11eadbf05 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.436+0000 7f7489600640 1 -- 172.21.15.46:0/2418987412 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c035020 con 0x7f748c0caae0 2024-03-04T08:50:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.439+0000 7f7489600640 1 -- 172.21.15.46:0/2418987412 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c031640 con 0x7f748c0caae0 2024-03-04T08:50:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.439+0000 7f7489600640 1 -- 172.21.15.46:0/2418987412 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c02d040 con 0x7f748c0caae0 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 -- 172.21.15.46:0/2418987412 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 msgr2=0x7f748c15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 --2- 172.21.15.46:0/2418987412 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 0x7f748c15a410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098a0 tx=0x7f747c02b8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 -- 172.21.15.46:0/2418987412 shutdown_connections 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 --2- 172.21.15.46:0/2418987412 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0caae0 0x7f748c15a410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 -- 172.21.15.46:0/2418987412 >> 172.21.15.46:0/2418987412 conn(0x7f748c0b15b0 msgr2=0x7f748c0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 -- 172.21.15.46:0/2418987412 shutdown_connections 2024-03-04T08:50:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.440+0000 7f748be00640 1 -- 172.21.15.46:0/2418987412 wait complete. 2024-03-04T08:50:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.442+0000 7f748be00640 1 Processor -- start 2024-03-04T08:50:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.442+0000 7f748be00640 1 -- start start 2024-03-04T08:50:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.444+0000 7f748be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f748c0caae0 0x7f748c0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.444+0000 7f748be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0cd220 0x7f748c0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.444+0000 7f748be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 0x7f748c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.444+0000 7f748be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0cc4e0 con 0x7f748c0caae0 2024-03-04T08:50:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.444+0000 7f748be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0ccb30 con 0x7f748c15a950 2024-03-04T08:50:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.444+0000 7f748be00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0cc7c0 con 0x7f748c0cd220 2024-03-04T08:50:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.448+0000 7f748b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 0x7f748c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.450+0000 7f748b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 0x7f748c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40458/0 (socket says 172.21.15.46:40458) 2024-03-04T08:50:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.450+0000 7f748b400640 1 -- 172.21.15.46:0/1161256792 learned_addr learned my addr 172.21.15.46:0/1161256792 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.450+0000 7f748aa00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f748c0caae0 0x7f748c0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.455+0000 7f748b400640 1 -- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0cd220 msgr2=0x7f748c0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.455+0000 7f748b400640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0cd220 0x7f748c0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.456+0000 7f748b400640 1 -- 172.21.15.46:0/1161256792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f748c0caae0 msgr2=0x7f748c0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.456+0000 7f748b400640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f748c0caae0 0x7f748c0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.456+0000 7f748b400640 1 -- 172.21.15.46:0/1161256792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c15e6c0 con 0x7f748c15a950 2024-03-04T08:50:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.459+0000 7f748b400640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 0x7f748c0b3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f748400b960 tx=0x7f748400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.464+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484019070 con 0x7f748c15a950 2024-03-04T08:50:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.464+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748400cb20 con 0x7f748c15a950 2024-03-04T08:50:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.464+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484014440 con 0x7f748c15a950 2024-03-04T08:50:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.464+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c1e4aa0 con 0x7f748c15a950 2024-03-04T08:50:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.464+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c1e5060 con 0x7f748c15a950 2024-03-04T08:50:10.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.465+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c04f410 con 0x7f748c15a950 2024-03-04T08:50:10.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.810+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f748401c070 con 0x7f748c15a950 2024-03-04T08:50:10.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.811+0000 7f7482a00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f746c06b4d0 0x7f746c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:10.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.812+0000 7f748aa00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f746c06b4d0 0x7f746c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.813+0000 7f748aa00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f746c06b4d0 0x7f746c06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f747c036000 tx=0x7f747c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:10.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.819+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7484056b40 con 0x7f748c15a950 2024-03-04T08:50:10.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:10.837+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7484023020 con 0x7f748c15a950 2024-03-04T08:50:11.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.067+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f748c0b5a20 con 0x7f748c15a950 2024-03-04T08:50:11.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.078+0000 7f7482a00640 1 -- 172.21.15.46:0/1161256792 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7484058aa0 con 0x7f748c15a950 2024-03-04T08:50:11.074 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-03-04T08:50:11.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f746c06b4d0 msgr2=0x7f746c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f746c06b4d0 0x7f746c06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f747c036000 tx=0x7f747c03c040 comp rx=0 tx=0).stop 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 msgr2=0x7f748c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 0x7f748c0b3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f748400b960 tx=0x7f748400be20 comp rx=0 tx=0).stop 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 shutdown_connections 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f746c06b4d0 0x7f746c06d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c15a950 0x7f748c0b3940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f748c0cd220 0x7f748c0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 --2- 172.21.15.46:0/1161256792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f748c0caae0 0x7f748c0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 >> 172.21.15.46:0/1161256792 conn(0x7f748c0b15b0 msgr2=0x7f748c153ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 shutdown_connections 2024-03-04T08:50:11.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.080+0000 7f748be00640 1 -- 172.21.15.46:0/1161256792 wait complete. 2024-03-04T08:50:11.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:50:11.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.290+0000 7f6947800640 1 Processor -- start 2024-03-04T08:50:11.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.290+0000 7f6947800640 1 -- start start 2024-03-04T08:50:11.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.291+0000 7f6947800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6940154750 0x7f69400cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:11.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.291+0000 7f6947800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69400ca6d0 con 0x7f69400cc700 2024-03-04T08:50:11.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.292+0000 7f6947800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69400ca990 con 0x7f6940154b30 2024-03-04T08:50:11.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.292+0000 7f6947800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69400cac70 con 0x7f6940154750 2024-03-04T08:50:11.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.292+0000 7f6937e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6940154b30 0x7f69400ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:54100/0 (socket says 172.21.15.46:54100) 2024-03-04T08:50:11.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.292+0000 7f6937e00640 1 -- 172.21.15.46:0/440807921 learned_addr learned my addr 172.21.15.46:0/440807921 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:11.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.293+0000 7f6944e00640 1 --2- 172.21.15.46:0/440807921 >> v2:172.21.15.46:3300/0 conn(0x7f6940154750 0x7f69400cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.296+0000 7f693fe00640 1 -- 172.21.15.46:0/440807921 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706342968 0 0) 0x7f69400ca990 con 0x7f6940154b30 2024-03-04T08:50:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.296+0000 7f693fe00640 1 -- 172.21.15.46:0/440807921 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6924003520 con 0x7f6940154b30 2024-03-04T08:50:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.298+0000 7f6944e00640 1 -- 172.21.15.46:0/440807921 >> v1:172.21.15.73:6789/0 conn(0x7f6940154b30 legacy=0x7f69400ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.298+0000 7f6944e00640 1 -- 172.21.15.46:0/440807921 >> v1:172.21.15.46:6789/0 conn(0x7f69400cc700 legacy=0x7f6940164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.298+0000 7f6944e00640 1 -- 172.21.15.46:0/440807921 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694015a900 con 0x7f6940154750 2024-03-04T08:50:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.304+0000 7f6944e00640 1 --2- 172.21.15.46:0/440807921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6940154750 0x7f69400cea90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6930009d90 tx=0x7f693002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226727143ad12e5e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.309+0000 7f693fe00640 1 -- 172.21.15.46:0/440807921 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930039070 con 0x7f6940154750 2024-03-04T08:50:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.309+0000 7f693fe00640 1 -- 172.21.15.46:0/440807921 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693002cd80 con 0x7f6940154750 2024-03-04T08:50:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.309+0000 7f693fe00640 1 -- 172.21.15.46:0/440807921 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930034660 con 0x7f6940154750 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.309+0000 7f6947800640 1 -- 172.21.15.46:0/440807921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6940154750 msgr2=0x7f69400cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.309+0000 7f6947800640 1 --2- 172.21.15.46:0/440807921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6940154750 0x7f69400cea90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6930009d90 tx=0x7f693002bfd0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.310+0000 7f6947800640 1 -- 172.21.15.46:0/440807921 shutdown_connections 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.310+0000 7f6947800640 1 --2- 172.21.15.46:0/440807921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6940154750 0x7f69400cea90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.310+0000 7f6947800640 1 -- 172.21.15.46:0/440807921 >> 172.21.15.46:0/440807921 conn(0x7f6940066c40 msgr2=0x7f6940067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.310+0000 7f6947800640 1 -- 172.21.15.46:0/440807921 shutdown_connections 2024-03-04T08:50:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.310+0000 7f6947800640 1 -- 172.21.15.46:0/440807921 wait complete. 2024-03-04T08:50:11.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.312+0000 7f6947800640 1 Processor -- start 2024-03-04T08:50:11.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.312+0000 7f6947800640 1 -- start start 2024-03-04T08:50:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6947800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69400cc700 0x7f69401f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6947800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6940154750 0x7f69400c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6947800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69400b1fa0 0x7f69400c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6947800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400ce820 con 0x7f69400b1fa0 2024-03-04T08:50:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6947800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694015aec0 con 0x7f69400cc700 2024-03-04T08:50:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6947800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694015a5b0 con 0x7f6940154750 2024-03-04T08:50:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.313+0000 7f6944e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69400cc700 0x7f69401f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.314+0000 7f6945800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69400b1fa0 0x7f69400c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.314+0000 7f6937e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6940154750 0x7f69400c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.314+0000 7f6944e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69400cc700 0x7f69401f0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40474/0 (socket says 172.21.15.46:40474) 2024-03-04T08:50:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.314+0000 7f6944e00640 1 -- 172.21.15.46:0/848902748 learned_addr learned my addr 172.21.15.46:0/848902748 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.318+0000 7f6937e00640 1 -- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69400cc700 msgr2=0x7f69401f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.318+0000 7f6937e00640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69400cc700 0x7f69401f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.318+0000 7f6937e00640 1 -- 172.21.15.46:0/848902748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69400b1fa0 msgr2=0x7f69400c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.318+0000 7f6937e00640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69400b1fa0 0x7f69400c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.318+0000 7f6937e00640 1 -- 172.21.15.46:0/848902748 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400b0c20 con 0x7f6940154750 2024-03-04T08:50:11.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.321+0000 7f6937e00640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6940154750 0x7f69400c6f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f692800c3c0 tx=0x7f6928001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:11.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.326+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928017070 con 0x7f6940154750 2024-03-04T08:50:11.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.326+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6928005ce0 con 0x7f6940154750 2024-03-04T08:50:11.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.326+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69280072d0 con 0x7f6940154750 2024-03-04T08:50:11.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.326+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69400b0f00 con 0x7f6940154750 2024-03-04T08:50:11.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.326+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69400b14c0 con 0x7f6940154750 2024-03-04T08:50:11.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.327+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69400b1ad0 con 0x7f6940154750 2024-03-04T08:50:11.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.351+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f692801a070 con 0x7f6940154750 2024-03-04T08:50:11.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.352+0000 7f693d600640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f691c06b520 0x7f691c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:11.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.353+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f69280562b0 con 0x7f6940154750 2024-03-04T08:50:11.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.353+0000 7f6944e00640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f691c06b520 0x7f691c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:11.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.354+0000 7f6944e00640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f691c06b520 0x7f691c06d9e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f80 tx=0x7f6930030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:11.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.608+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6928058210 con 0x7f6940154750 2024-03-04T08:50:11.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.826+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f694015d8d0 con 0x7f6940154750 2024-03-04T08:50:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.893+0000 7f693d600640 1 -- 172.21.15.46:0/848902748 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f694015d8d0 con 0x7f6940154750 2024-03-04T08:50:11.890 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-03-04T08:50:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f691c06b520 msgr2=0x7f691c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f691c06b520 0x7f691c06d9e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f80 tx=0x7f6930030000 comp rx=0 tx=0).stop 2024-03-04T08:50:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6940154750 msgr2=0x7f69400c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6940154750 0x7f69400c6f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f692800c3c0 tx=0x7f6928001e70 comp rx=0 tx=0).stop 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 shutdown_connections 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f691c06b520 0x7f691c06d9e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69400b1fa0 0x7f69400c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6940154750 0x7f69400c6f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 --2- 172.21.15.46:0/848902748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69400cc700 0x7f69401f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 >> 172.21.15.46:0/848902748 conn(0x7f6940066c40 msgr2=0x7f694014e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 shutdown_connections 2024-03-04T08:50:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:11.896+0000 7f6947800640 1 -- 172.21.15.46:0/848902748 wait complete. 2024-03-04T08:50:11.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.096+0000 7fec84c00640 1 Processor -- start 2024-03-04T08:50:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.096+0000 7fec84c00640 1 -- start start 2024-03-04T08:50:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.098+0000 7fec84c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec80154930 0x7fec8006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.098+0000 7fec84c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.098+0000 7fec84c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8006c6c0 con 0x7fec8015db50 2024-03-04T08:50:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.098+0000 7fec84c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8006cfb0 con 0x7fec80154930 2024-03-04T08:50:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.098+0000 7fec84c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec80154d10 con 0x7fec800ca550 2024-03-04T08:50:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.099+0000 7fec77e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.099+0000 7fec7de00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec80154930 0x7fec8006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.099+0000 7fec7e800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fec8015db50 0x7fec8015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50706/0 (socket says 172.21.15.46:50706) 2024-03-04T08:50:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.099+0000 7fec7e800640 1 -- 172.21.15.46:0/3460268513 learned_addr learned my addr 172.21.15.46:0/3460268513 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:12.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.102+0000 7fec77e00640 1 -- 172.21.15.46:0/3460268513 >> v2:172.21.15.73:3300/0 conn(0x7fec80154930 msgr2=0x7fec8006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:12.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.102+0000 7fec77e00640 1 --2- 172.21.15.46:0/3460268513 >> v2:172.21.15.73:3300/0 conn(0x7fec80154930 0x7fec8006d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.102+0000 7fec77e00640 1 -- 172.21.15.46:0/3460268513 >> v1:172.21.15.73:6789/0 conn(0x7fec8015db50 legacy=0x7fec8015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:12.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.102+0000 7fec77e00640 1 -- 172.21.15.46:0/3460268513 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800cd180 con 0x7fec800ca550 2024-03-04T08:50:12.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.105+0000 7fec77e00640 1 --2- 172.21.15.46:0/3460268513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800ca990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec680097a0 tx=0x7fec6802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e92f9408c08b0ce server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:12.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.109+0000 7fec7d400640 1 -- 172.21.15.46:0/3460268513 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680315a0 con 0x7fec800ca550 2024-03-04T08:50:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.109+0000 7fec7d400640 1 -- 172.21.15.46:0/3460268513 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68037070 con 0x7fec800ca550 2024-03-04T08:50:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.109+0000 7fec7d400640 1 -- 172.21.15.46:0/3460268513 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68031960 con 0x7fec800ca550 2024-03-04T08:50:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 -- 172.21.15.46:0/3460268513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 msgr2=0x7fec800ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 --2- 172.21.15.46:0/3460268513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800ca990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec680097a0 tx=0x7fec6802b840 comp rx=0 tx=0).stop 2024-03-04T08:50:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 -- 172.21.15.46:0/3460268513 shutdown_connections 2024-03-04T08:50:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 --2- 172.21.15.46:0/3460268513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800ca990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 --2- 172.21.15.46:0/3460268513 >> v2:172.21.15.73:3300/0 conn(0x7fec80154930 0x7fec8006d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 -- 172.21.15.46:0/3460268513 >> 172.21.15.46:0/3460268513 conn(0x7fec800b1920 msgr2=0x7fec800b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 -- 172.21.15.46:0/3460268513 shutdown_connections 2024-03-04T08:50:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.110+0000 7fec84c00640 1 -- 172.21.15.46:0/3460268513 wait complete. 2024-03-04T08:50:12.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.112+0000 7fec84c00640 1 Processor -- start 2024-03-04T08:50:12.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.112+0000 7fec84c00640 1 -- start start 2024-03-04T08:50:12.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.113+0000 7fec84c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.113+0000 7fec84c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec80154930 0x7fec800c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.113+0000 7fec84c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8015db50 0x7fec800c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.113+0000 7fec84c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8006cc40 con 0x7fec80154930 2024-03-04T08:50:12.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.113+0000 7fec84c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8006c960 con 0x7fec8015db50 2024-03-04T08:50:12.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.113+0000 7fec84c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8015e810 con 0x7fec800ca550 2024-03-04T08:50:12.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.114+0000 7fec7de00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.114+0000 7fec77e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec80154930 0x7fec800c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.114+0000 7fec7e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8015db50 0x7fec800c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.114+0000 7fec7de00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58178/0 (socket says 172.21.15.46:58178) 2024-03-04T08:50:12.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.114+0000 7fec7de00640 1 -- 172.21.15.46:0/2971722658 learned_addr learned my addr 172.21.15.46:0/2971722658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:12.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.118+0000 7fec77e00640 1 -- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 msgr2=0x7fec800c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:12.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.118+0000 7fec77e00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.118+0000 7fec77e00640 1 -- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8015db50 msgr2=0x7fec800c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:12.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.118+0000 7fec77e00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8015db50 0x7fec800c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.118+0000 7fec77e00640 1 -- 172.21.15.46:0/2971722658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800c33b0 con 0x7fec80154930 2024-03-04T08:50:12.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.121+0000 7fec77e00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec80154930 0x7fec800c3e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec8006c890 tx=0x7fec680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:12.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.127+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68045640 con 0x7fec80154930 2024-03-04T08:50:12.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.127+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68045800 con 0x7fec80154930 2024-03-04T08:50:12.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.127+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68045bf0 con 0x7fec80154930 2024-03-04T08:50:12.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.127+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec800c9c40 con 0x7fec80154930 2024-03-04T08:50:12.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.127+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec800c3650 con 0x7fec80154930 2024-03-04T08:50:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.128+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec800ca220 con 0x7fec80154930 2024-03-04T08:50:12.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.445+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec6804c340 con 0x7fec80154930 2024-03-04T08:50:12.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.448+0000 7fec76000640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fec5c06b520 0x7fec5c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.448+0000 7fec7de00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fec5c06b520 0x7fec5c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.450+0000 7fec7de00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fec5c06b520 0x7fec5c06d9e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec70009c00 tx=0x7fec70009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.466+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fec6802f060 con 0x7fec80154930 2024-03-04T08:50:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.466+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fec800ca220 con 0x7fec80154930 2024-03-04T08:50:12.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.709+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec800680b0 con 0x7fec80154930 2024-03-04T08:50:12.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.780+0000 7fec76000640 1 -- 172.21.15.46:0/2971722658 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6630 (secure 0 0 0) 0x7fec6804a030 con 0x7fec80154930 2024-03-04T08:50:12.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:12.776 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:49:40.471641+0000","modified":"2024-03-04T08:49:57.389959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4267,"mds_2":4262,"mds_3":4259,"mds_4":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4259":{"gid":4259,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4262":{"gid":4262,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4252,4259,4262,4267,4273]},"id":1}]} 2024-03-04T08:50:12.777 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-03-04T08:50:12.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fec5c06b520 msgr2=0x7fec5c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:12.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fec5c06b520 0x7fec5c06d9e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec70009c00 tx=0x7fec70009190 comp rx=0 tx=0).stop 2024-03-04T08:50:12.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec80154930 msgr2=0x7fec800c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec80154930 0x7fec800c3e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec8006c890 tx=0x7fec680046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 shutdown_connections 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fec5c06b520 0x7fec5c06d9e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8015db50 0x7fec800c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec80154930 0x7fec800c3e50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 --2- 172.21.15.46:0/2971722658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec800ca550 0x7fec800c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 >> 172.21.15.46:0/2971722658 conn(0x7fec800b1920 msgr2=0x7fec800cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 shutdown_connections 2024-03-04T08:50:12.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:12.784+0000 7fec84c00640 1 -- 172.21.15.46:0/2971722658 wait complete. 2024-03-04T08:50:12.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.000+0000 7feea9e00640 1 Processor -- start 2024-03-04T08:50:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.000+0000 7feea9e00640 1 -- start start 2024-03-04T08:50:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.001+0000 7feea9e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feea40cc3b0 0x7feea40ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.001+0000 7feea9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feea415e400 0x7feea40cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.001+0000 7feea9e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40cf240 con 0x7feea40ce1f0 2024-03-04T08:50:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.001+0000 7feea9e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea4154a00 con 0x7feea40cc3b0 2024-03-04T08:50:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.001+0000 7feea9e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40cf800 con 0x7feea415e400 2024-03-04T08:50:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.002+0000 7feea8a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feea40cc3b0 0x7feea40ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.002+0000 7feea9400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feea40ce1f0 0x7feea406c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50716/0 (socket says 172.21.15.46:50716) 2024-03-04T08:50:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.002+0000 7feea9400640 1 -- 172.21.15.46:0/788495827 learned_addr learned my addr 172.21.15.46:0/788495827 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.002+0000 7feea3e00640 1 --2- 172.21.15.46:0/788495827 >> v2:172.21.15.73:3300/0 conn(0x7feea415e400 0x7feea40cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.004+0000 7feea8a00640 1 -- 172.21.15.46:0/788495827 >> v2:172.21.15.73:3300/0 conn(0x7feea415e400 msgr2=0x7feea40cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.004+0000 7feea8a00640 1 --2- 172.21.15.46:0/788495827 >> v2:172.21.15.73:3300/0 conn(0x7feea415e400 0x7feea40cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.004+0000 7feea8a00640 1 -- 172.21.15.46:0/788495827 >> v1:172.21.15.73:6789/0 conn(0x7feea40ce1f0 legacy=0x7feea406c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.004+0000 7feea8a00640 1 -- 172.21.15.46:0/788495827 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40cf520 con 0x7feea40cc3b0 2024-03-04T08:50:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.007+0000 7feea8a00640 1 --2- 172.21.15.46:0/788495827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea40ce720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feea408d070 tx=0x7fee9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bbe00c41f8a43a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:13.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.012+0000 7feea3400640 1 -- 172.21.15.46:0/788495827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940315a0 con 0x7feea40cc3b0 2024-03-04T08:50:13.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.012+0000 7feea3400640 1 -- 172.21.15.46:0/788495827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94037070 con 0x7feea40cc3b0 2024-03-04T08:50:13.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.012+0000 7feea3400640 1 -- 172.21.15.46:0/788495827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94031960 con 0x7feea40cc3b0 2024-03-04T08:50:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 -- 172.21.15.46:0/788495827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 msgr2=0x7feea40ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 --2- 172.21.15.46:0/788495827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea40ce720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feea408d070 tx=0x7fee9402b840 comp rx=0 tx=0).stop 2024-03-04T08:50:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 -- 172.21.15.46:0/788495827 shutdown_connections 2024-03-04T08:50:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 --2- 172.21.15.46:0/788495827 >> v2:172.21.15.73:3300/0 conn(0x7feea415e400 0x7feea40cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 --2- 172.21.15.46:0/788495827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea40ce720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 -- 172.21.15.46:0/788495827 >> 172.21.15.46:0/788495827 conn(0x7feea40cf9a0 msgr2=0x7feea40cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 -- 172.21.15.46:0/788495827 shutdown_connections 2024-03-04T08:50:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.013+0000 7feea9e00640 1 -- 172.21.15.46:0/788495827 wait complete. 2024-03-04T08:50:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.016+0000 7feea9e00640 1 Processor -- start 2024-03-04T08:50:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.016+0000 7feea9e00640 1 -- start start 2024-03-04T08:50:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.017+0000 7feea9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea4148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.017+0000 7feea9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea40ce1f0 0x7feea4156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.017+0000 7feea9e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feea415e400 0x7feea4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.017+0000 7feea9e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415dee0 con 0x7feea40cc3b0 2024-03-04T08:50:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.017+0000 7feea9e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415dc00 con 0x7feea40ce1f0 2024-03-04T08:50:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.017+0000 7feea9e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea40cec90 con 0x7feea415e400 2024-03-04T08:50:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.018+0000 7feea8a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea4148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.018+0000 7feea3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea40ce1f0 0x7feea4156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.018+0000 7feea9400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feea415e400 0x7feea4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.018+0000 7feea8a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea4148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32814/0 (socket says 172.21.15.46:32814) 2024-03-04T08:50:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.018+0000 7feea8a00640 1 -- 172.21.15.46:0/210701736 learned_addr learned my addr 172.21.15.46:0/210701736 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.022+0000 7feea8a00640 1 -- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feea415e400 msgr2=0x7feea4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.022+0000 7feea8a00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feea415e400 0x7feea4156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.022+0000 7feea8a00640 1 -- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea40ce1f0 msgr2=0x7feea4156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.022+0000 7feea8a00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea40ce1f0 0x7feea4156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.022+0000 7feea8a00640 1 -- 172.21.15.46:0/210701736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea41e5f10 con 0x7feea40cc3b0 2024-03-04T08:50:13.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.025+0000 7feea8a00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea4148cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee9402be50 tx=0x7fee940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:13.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.029+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94032630 con 0x7feea40cc3b0 2024-03-04T08:50:13.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.029+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940327d0 con 0x7feea40cc3b0 2024-03-04T08:50:13.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.029+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94032bc0 con 0x7feea40cc3b0 2024-03-04T08:50:13.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.029+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea41e61d0 con 0x7feea40cc3b0 2024-03-04T08:50:13.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.029+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea41576f0 con 0x7feea40cc3b0 2024-03-04T08:50:13.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.031+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea404f330 con 0x7feea40cc3b0 2024-03-04T08:50:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.051+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee940453f0 con 0x7feea40cc3b0 2024-03-04T08:50:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.053+0000 7feea0c00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fee8806b520 0x7fee8806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.053+0000 7feea3e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fee8806b520 0x7fee8806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.054+0000 7feea3e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fee8806b520 0x7fee8806d9e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feea40c6820 tx=0x7fee98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.056+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fee9402f030 con 0x7feea40cc3b0 2024-03-04T08:50:13.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.360+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fee94040070 con 0x7feea40cc3b0 2024-03-04T08:50:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.575+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feea40c2e30 con 0x7feea40cc3b0 2024-03-04T08:50:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.619+0000 7feea0c00640 1 -- 172.21.15.46:0/210701736 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16598 (secure 0 0 0) 0x7fee940a90f0 con 0x7feea40cc3b0 2024-03-04T08:50:13.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:13.616 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:50:11.544052+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fee8806b520 msgr2=0x7fee8806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fee8806b520 0x7fee8806d9e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feea40c6820 tx=0x7fee98009190 comp rx=0 tx=0).stop 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 msgr2=0x7feea4148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea4148cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee9402be50 tx=0x7fee940046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 shutdown_connections 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fee8806b520 0x7fee8806d9e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea40ce1f0 0x7feea4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feea415e400 0x7feea4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 --2- 172.21.15.46:0/210701736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea40cc3b0 0x7feea4148cc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 >> 172.21.15.46:0/210701736 conn(0x7feea40cf9a0 msgr2=0x7feea406bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 shutdown_connections 2024-03-04T08:50:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.622+0000 7feea9e00640 1 -- 172.21.15.46:0/210701736 wait complete. 2024-03-04T08:50:13.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.844+0000 7f5e81000640 1 Processor -- start 2024-03-04T08:50:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.845+0000 7f5e81000640 1 -- start start 2024-03-04T08:50:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.846+0000 7f5e81000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c15e280 0x7f5e7c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.846+0000 7f5e81000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c154a30 con 0x7f5e7c154650 2024-03-04T08:50:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.846+0000 7f5e81000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c0c9ae0 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.846+0000 7f5e81000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c4820 con 0x7f5e7c15e280 2024-03-04T08:50:13.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.878+0000 7f5e79400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5e7c0c96c0 0x7f5e7c15db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50732/0 (socket says 172.21.15.46:50732) 2024-03-04T08:50:13.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.879+0000 7f5e79400640 1 -- 172.21.15.46:0/622004077 learned_addr learned my addr 172.21.15.46:0/622004077 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:13.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.884+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152018613 0 0) 0x7f5e7c0c9ae0 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.884+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e60003520 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.889+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660964559 0 0) 0x7f5e6c001110 con 0x7f5e7c154650 2024-03-04T08:50:13.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.889+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e7c0c9ae0 con 0x7f5e7c154650 2024-03-04T08:50:13.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.890+0000 7f5e7a800640 1 --2- 172.21.15.46:0/622004077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c15e280 0x7f5e7c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.900+0000 7f5e7a800640 1 -- 172.21.15.46:0/622004077 >> v1:172.21.15.73:6789/0 conn(0x7f5e7c0c96c0 legacy=0x7f5e7c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.900+0000 7f5e7a800640 1 -- 172.21.15.46:0/622004077 >> v1:172.21.15.46:6789/0 conn(0x7f5e7c154650 legacy=0x7f5e7c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.901+0000 7f5e7a800640 1 -- 172.21.15.46:0/622004077 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0c3ca0 con 0x7f5e7c15e280 2024-03-04T08:50:13.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.906+0000 7f5e7a800640 1 --2- 172.21.15.46:0/622004077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c15e280 0x7f5e7c0ca060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009dc0 tx=0x7f5e7402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcfc3b5db361962 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:13.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.910+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74039070 con 0x7f5e7c15e280 2024-03-04T08:50:13.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.910+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7402ccd0 con 0x7f5e7c15e280 2024-03-04T08:50:13.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.911+0000 7f5e78a00640 1 -- 172.21.15.46:0/622004077 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74034660 con 0x7f5e7c15e280 2024-03-04T08:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 -- 172.21.15.46:0/622004077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c15e280 msgr2=0x7f5e7c0ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 --2- 172.21.15.46:0/622004077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c15e280 0x7f5e7c0ca060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009dc0 tx=0x7f5e7402bf20 comp rx=0 tx=0).stop 2024-03-04T08:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 -- 172.21.15.46:0/622004077 shutdown_connections 2024-03-04T08:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 --2- 172.21.15.46:0/622004077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c15e280 0x7f5e7c0ca060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 -- 172.21.15.46:0/622004077 >> 172.21.15.46:0/622004077 conn(0x7f5e7c071490 msgr2=0x7f5e7c0718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 -- 172.21.15.46:0/622004077 shutdown_connections 2024-03-04T08:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.912+0000 7f5e81000640 1 -- 172.21.15.46:0/622004077 wait complete. 2024-03-04T08:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.915+0000 7f5e81000640 1 Processor -- start 2024-03-04T08:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.915+0000 7f5e81000640 1 -- start start 2024-03-04T08:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.916+0000 7f5e81000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 0x7f5e7c1e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.916+0000 7f5e81000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e7c154650 0x7f5e7c1e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.916+0000 7f5e81000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c15e280 0x7f5e7c146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.916+0000 7f5e81000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c4540 con 0x7f5e7c154650 2024-03-04T08:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.916+0000 7f5e81000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c4260 con 0x7f5e7c15e280 2024-03-04T08:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.916+0000 7f5e81000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c9d70 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.917+0000 7f5e7a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c15e280 0x7f5e7c146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.917+0000 7f5e79e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 0x7f5e7c1e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.917+0000 7f5e79e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 0x7f5e7c1e4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58190/0 (socket says 172.21.15.46:58190) 2024-03-04T08:50:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.917+0000 7f5e79e00640 1 -- 172.21.15.46:0/446164130 learned_addr learned my addr 172.21.15.46:0/446164130 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.921+0000 7f5e79e00640 1 -- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c15e280 msgr2=0x7f5e7c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.921+0000 7f5e79e00640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c15e280 0x7f5e7c146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.921+0000 7f5e79e00640 1 -- 172.21.15.46:0/446164130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e7c154650 msgr2=0x7f5e7c1e3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.921+0000 7f5e79e00640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e7c154650 0x7f5e7c1e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.921+0000 7f5e79e00640 1 -- 172.21.15.46:0/446164130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c1f0280 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.923+0000 7f5e79e00640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 0x7f5e7c1e4dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c730 tx=0x7f5e6c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.925+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0050d0 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.925+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c1e5fa0 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.926+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c1f0800 con 0x7f5e7c0c96c0 2024-03-04T08:50:13.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:13.927+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c0680b0 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.145+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c005270 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.236+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00a640 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.239+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e6c00a880 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.240+0000 7f5e72000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:14.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.241+0000 7f5e79400640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:14.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.242+0000 7f5e79400640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c1538c0 tx=0x7f5e68007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:14.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.242+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5e6c057110 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.319+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5e6c0b6e10 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.569+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e7c0c94a0 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.586+0000 7f5e72000640 1 -- 172.21.15.46:0/446164130 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6630 (secure 0 0 0) 0x7f5e7c154a30 con 0x7f5e7c0c96c0 2024-03-04T08:50:14.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T08:50:14.583 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:49:40.471641+0000","modified":"2024-03-04T08:49:57.389959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4267,"mds_2":4262,"mds_3":4259,"mds_4":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4259":{"gid":4259,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4262":{"gid":4262,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4252,4259,4262,4267,4273]},"id":1}]} 2024-03-04T08:50:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e5c06b4d0 msgr2=0x7f5e5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c1538c0 tx=0x7f5e68007930 comp rx=0 tx=0).stop 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 msgr2=0x7f5e7c1e4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 0x7f5e7c1e4dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c730 tx=0x7f5e6c00cbf0 comp rx=0 tx=0).stop 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 shutdown_connections 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c15e280 0x7f5e7c146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e7c154650 0x7f5e7c1e3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 --2- 172.21.15.46:0/446164130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e7c0c96c0 0x7f5e7c1e4dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 >> 172.21.15.46:0/446164130 conn(0x7f5e7c071490 msgr2=0x7f5e7c0c8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 shutdown_connections 2024-03-04T08:50:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:14.589+0000 7f5e81000640 1 -- 172.21.15.46:0/446164130 wait complete. 2024-03-04T08:50:15.208 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-04T08:49:40.471641+0000', 'modified': '2024-03-04T08:49:57.389959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4273, 'mds_1': 4267, 'mds_2': 4262, 'mds_3': 4259, 'mds_4': 4252}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4252': {'gid': 4252, 'name': 'b', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.73:6835/3860229017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 3860229017}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3860229017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4259': {'gid': 4259, 'name': 'd', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.73:6838/381408316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 381408316}, {'type': 'v1', 'addr': '172.21.15.73:6838', 'nonce': 381408316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4262': {'gid': 4262, 'name': 'f', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.73:6839/1890974908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6837', 'nonce': 1890974908}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1890974908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4267': {'gid': 4267, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.46:6833/1752138796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6832', 'nonce': 1752138796}, {'type': 'v1', 'addr': '172.21.15.46:6833', 'nonce': 1752138796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4273': {'gid': 4273, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.46:6837/3649809556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6835', 'nonce': 3649809556}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 3649809556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4273, 'qdb_cluster': [4252, 4259, 4262, 4267, 4273]} 2024-03-04T08:50:15.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-04T08:50:15.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-04T08:50:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.412+0000 7fed34600640 1 Processor -- start 2024-03-04T08:50:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.412+0000 7fed34600640 1 -- start start 2024-03-04T08:50:15.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.414+0000 7fed34600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed2c154750 0x7fed2c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.414+0000 7fed34600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154b30 0x7fed2c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.414+0000 7fed34600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0ca6d0 con 0x7fed2c0ce650 2024-03-04T08:50:15.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.414+0000 7fed34600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0ca990 con 0x7fed2c154750 2024-03-04T08:50:15.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.414+0000 7fed34600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0cac70 con 0x7fed2c154b30 2024-03-04T08:50:15.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.415+0000 7fed32600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fed2c0ce650 0x7fed2c0cc700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50748/0 (socket says 172.21.15.46:50748) 2024-03-04T08:50:15.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.415+0000 7fed31c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed2c154750 0x7fed2c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.415+0000 7fed32600640 1 -- 172.21.15.46:0/841199241 learned_addr learned my addr 172.21.15.46:0/841199241 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:15.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.415+0000 7fed31200640 1 --2- 172.21.15.46:0/841199241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154b30 0x7fed2c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.418+0000 7fed2be00640 1 -- 172.21.15.46:0/841199241 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284958234 0 0) 0x7fed2c0ca6d0 con 0x7fed2c0ce650 2024-03-04T08:50:15.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.418+0000 7fed2be00640 1 -- 172.21.15.46:0/841199241 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed10003520 con 0x7fed2c0ce650 2024-03-04T08:50:15.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.419+0000 7fed31c00640 1 -- 172.21.15.46:0/841199241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154b30 msgr2=0x7fed2c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.419+0000 7fed31c00640 1 --2- 172.21.15.46:0/841199241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154b30 0x7fed2c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.419+0000 7fed31c00640 1 -- 172.21.15.46:0/841199241 >> v1:172.21.15.73:6789/0 conn(0x7fed2c0ce650 legacy=0x7fed2c0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.419+0000 7fed31c00640 1 -- 172.21.15.46:0/841199241 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c15a900 con 0x7fed2c154750 2024-03-04T08:50:15.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.422+0000 7fed31c00640 1 --2- 172.21.15.46:0/841199241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c154750 0x7fed2c0cea90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009d90 tx=0x7fed1c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a44c33647c7bb0a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.427+0000 7fed2be00640 1 -- 172.21.15.46:0/841199241 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c039070 con 0x7fed2c154750 2024-03-04T08:50:15.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.427+0000 7fed2be00640 1 -- 172.21.15.46:0/841199241 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c02cce0 con 0x7fed2c154750 2024-03-04T08:50:15.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.427+0000 7fed2be00640 1 -- 172.21.15.46:0/841199241 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c034660 con 0x7fed2c154750 2024-03-04T08:50:15.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 -- 172.21.15.46:0/841199241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c154750 msgr2=0x7fed2c0cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 --2- 172.21.15.46:0/841199241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c154750 0x7fed2c0cea90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009d90 tx=0x7fed1c02bf30 comp rx=0 tx=0).stop 2024-03-04T08:50:15.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 -- 172.21.15.46:0/841199241 shutdown_connections 2024-03-04T08:50:15.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 --2- 172.21.15.46:0/841199241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154b30 0x7fed2c0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 --2- 172.21.15.46:0/841199241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c154750 0x7fed2c0cea90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 -- 172.21.15.46:0/841199241 >> 172.21.15.46:0/841199241 conn(0x7fed2c066c40 msgr2=0x7fed2c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:15.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 -- 172.21.15.46:0/841199241 shutdown_connections 2024-03-04T08:50:15.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.428+0000 7fed34600640 1 -- 172.21.15.46:0/841199241 wait complete. 2024-03-04T08:50:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.430+0000 7fed34600640 1 Processor -- start 2024-03-04T08:50:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.430+0000 7fed34600640 1 -- start start 2024-03-04T08:50:15.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.431+0000 7fed34600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c0ce650 0x7fed2c1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.431+0000 7fed34600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154750 0x7fed2c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.431+0000 7fed34600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed2c14b6f0 0x7fed2c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.431+0000 7fed34600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c15a5b0 con 0x7fed2c0ce650 2024-03-04T08:50:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.431+0000 7fed34600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c15aec0 con 0x7fed2c14b6f0 2024-03-04T08:50:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.431+0000 7fed34600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c15b3e0 con 0x7fed2c154750 2024-03-04T08:50:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.432+0000 7fed31c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c0ce650 0x7fed2c1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.432+0000 7fed32600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed2c14b6f0 0x7fed2c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.432+0000 7fed31200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154750 0x7fed2c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.432+0000 7fed31c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c0ce650 0x7fed2c1f3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32842/0 (socket says 172.21.15.46:32842) 2024-03-04T08:50:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.432+0000 7fed31c00640 1 -- 172.21.15.46:0/3753792389 learned_addr learned my addr 172.21.15.46:0/3753792389 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.436+0000 7fed32600640 1 -- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154750 msgr2=0x7fed2c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.436+0000 7fed32600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154750 0x7fed2c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.436+0000 7fed32600640 1 -- 172.21.15.46:0/3753792389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c0ce650 msgr2=0x7fed2c1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.436+0000 7fed32600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c0ce650 0x7fed2c1f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.436+0000 7fed32600640 1 -- 172.21.15.46:0/3753792389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c1f0b90 con 0x7fed2c14b6f0 2024-03-04T08:50:15.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.439+0000 7fed32600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed2c14b6f0 0x7fed2c0b1b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c390 tx=0x7fed2400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.446+0000 7fed29600640 1 -- 172.21.15.46:0/3753792389 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24017070 con 0x7fed2c14b6f0 2024-03-04T08:50:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.446+0000 7fed29600640 1 -- 172.21.15.46:0/3753792389 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24005ce0 con 0x7fed2c14b6f0 2024-03-04T08:50:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.446+0000 7fed29600640 1 -- 172.21.15.46:0/3753792389 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240072d0 con 0x7fed2c14b6f0 2024-03-04T08:50:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.446+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c14b190 con 0x7fed2c14b6f0 2024-03-04T08:50:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.446+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c1efdd0 con 0x7fed2c14b6f0 2024-03-04T08:50:15.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.451+0000 7fed371e0740 1 Processor -- start 2024-03-04T08:50:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.452+0000 7fed371e0740 1 -- start start 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.453+0000 7fed371e0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.453+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 0x55712080bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.453+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120809c10 0x55712084aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.453+0000 7fed371e0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55712076f600 con 0x55712080b1b0 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.453+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557120718930 con 0x557120809c10 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.453+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55712076b6a0 con 0x557120855030 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.454+0000 7fed31c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 0x55712080bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.454+0000 7fed31c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 0x55712080bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58230/0 (socket says 172.21.15.46:58230) 2024-03-04T08:50:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.454+0000 7fed31c00640 1 -- 172.21.15.46:0/2058967873 learned_addr learned my addr 172.21.15.46:0/2058967873 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.457+0000 7fed31200640 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120809c10 0x55712084aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.458+0000 7fed31c00640 1 -- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120809c10 msgr2=0x55712084aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.458+0000 7fed31c00640 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120809c10 0x55712084aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.458+0000 7fed31c00640 1 -- 172.21.15.46:0/2058967873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 msgr2=0x55712080b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.458+0000 7fed31c00640 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.458+0000 7fed31c00640 1 -- 172.21.15.46:0/2058967873 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571204842d0 con 0x557120855030 2024-03-04T08:50:15.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.461+0000 7fed31c00640 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 0x55712080bad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed1c02c540 tx=0x7fed1c02e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b5e28b218251db server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.466+0000 7fed22000640 1 -- 172.21.15.46:0/2058967873 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c045070 con 0x557120855030 2024-03-04T08:50:15.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.466+0000 7fed22000640 1 -- 172.21.15.46:0/2058967873 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c03a040 con 0x557120855030 2024-03-04T08:50:15.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.466+0000 7fed22000640 1 -- 172.21.15.46:0/2058967873 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c039040 con 0x557120855030 2024-03-04T08:50:15.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 -- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 msgr2=0x55712080bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 0x55712080bad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed1c02c540 tx=0x7fed1c02e000 comp rx=0 tx=0).stop 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 -- 172.21.15.46:0/2058967873 shutdown_connections 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120809c10 0x55712084aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557120855030 0x55712080bad0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 --2- 172.21.15.46:0/2058967873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 -- 172.21.15.46:0/2058967873 >> 172.21.15.46:0/2058967873 conn(0x557120807920 msgr2=0x55712080a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 -- 172.21.15.46:0/2058967873 shutdown_connections 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.467+0000 7fed371e0740 1 -- 172.21.15.46:0/2058967873 wait complete. 2024-03-04T08:50:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.468+0000 7fed371e0740 1 -- start start 2024-03-04T08:50:15.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.469+0000 7fed371e0740 1 Processor -- start 2024-03-04T08:50:15.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.470+0000 7fed29600640 1 -- 172.21.15.46:0/3753792389 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed2401a070 con 0x7fed2c14b6f0 2024-03-04T08:50:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed29600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed0c06b4c0 0x7fed0c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed31200640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed0c06b4c0 0x7fed0c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed371e0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712085fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712084dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x557120826b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed371e0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557120830710 con 0x55712080b1b0 2024-03-04T08:50:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55712072bd90 con 0x557120855030 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.471+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x557120808ad0 con 0x55712084fd00 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.472+0000 7fed371e0740 10 client.0 _ll_register_callbacks cb 0x557120767350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.472+0000 7fed31200640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed0c06b4c0 0x7fed0c06d980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed2c14b5c0 tx=0x7fed180046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.472+0000 7fed29600640 1 -- 172.21.15.46:0/3753792389 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fed24055d50 con 0x7fed2c14b6f0 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.472+0000 7fed32600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x557120826b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.473+0000 7fed31c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712085fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.473+0000 7fed32600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x557120826b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58244/0 (socket says 172.21.15.46:58244) 2024-03-04T08:50:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.473+0000 7fed32600640 1 -- 172.21.15.46:0/1146230834 learned_addr learned my addr 172.21.15.46:0/1146230834 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:15.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.476+0000 7fed31200640 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712084dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.476+0000 7fed31c00640 1 -- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 msgr2=0x557120826b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.476+0000 7fed31c00640 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x557120826b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.476+0000 7fed31c00640 1 -- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 msgr2=0x55712084dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.476+0000 7fed31c00640 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712084dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.476+0000 7fed31c00640 1 -- 172.21.15.46:0/1146230834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55712054e6b0 con 0x55712080b1b0 2024-03-04T08:50:15.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.479+0000 7fed31c00640 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712085fb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed1c046000 tx=0x7fed1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997bf04bc9ccc2f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.479+0000 7fed16a00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-03-04T08:50:15.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.484+0000 7fed16a00640 1 -- 172.21.15.46:0/1146230834 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c04e030 con 0x55712080b1b0 2024-03-04T08:50:15.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.484+0000 7fed16a00640 1 -- 172.21.15.46:0/1146230834 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fed1c003d80 con 0x55712080b1b0 2024-03-04T08:50:15.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.484+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed1c03a040 con 0x55712080b1b0 2024-03-04T08:50:15.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.487+0000 7fed16a00640 1 -- 172.21.15.46:0/1146230834 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed1c057050 con 0x55712080b1b0 2024-03-04T08:50:15.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.487+0000 7fed371e0740 10 client.4464 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:15.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.487+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5571208602d0 con 0x55712080b1b0 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.495+0000 7fed16a00640 1 -- 172.21.15.46:0/1146230834 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c03a040 con 0x55712080b1b0 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.495+0000 7fed16a00640 1 -- 172.21.15.46:0/1146230834 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7fed1c05a020 con 0x55712080b1b0 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.496+0000 7fed371e0740 10 client.4464 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.496+0000 7fed371e0740 10 client.4464 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.496+0000 7fed371e0740 20 client.4464 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.496+0000 7fed371e0740 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x557120868fc0 0x55712086b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.496+0000 7fed371e0740 4 client.4464 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:50:15.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.496+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 --> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55712077cb40 con 0x557120868fc0 2024-03-04T08:50:15.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.508+0000 7fed31200640 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x557120868fc0 0x55712086b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.595+0000 7fed16a00640 10 client.4464 ms_handle_connect on v2:172.21.15.73:6834/3860229017 2024-03-04T08:50:15.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.595+0000 7fed31200640 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x557120868fc0 0x55712086b3b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f011dd7f0985cc19 server_cookie=aeded00e90e25041 in_seq=0 out_seq=0 2024-03-04T08:50:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.722+0000 7fed16a00640 1 -- 172.21.15.46:0/1146230834 <== mds.4 v2:172.21.15.73:6834/3860229017 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55712077cb40 con 0x557120868fc0 2024-03-04T08:50:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.722+0000 7fed16a00640 10 client.4464 handle_command_reply: tid=0 2024-03-04T08:50:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.722+0000 7fed371e0740 1 client.4464 shutdown 2024-03-04T08:50:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.722+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 msgr2=0x55712085fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.722+0000 7fed371e0740 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712085fb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed1c046000 tx=0x7fed1c004ab0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 shutdown_connections 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712084dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x557120868fc0 0x55712086b3b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x557120826b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 --2- 172.21.15.46:0/1146230834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712085fb10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed16a00640 0 client.4464 ms_handle_reset on v2:172.21.15.73:6834/3860229017 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 >> 172.21.15.46:0/1146230834 conn(0x557120809c10 msgr2=0x55712084a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 shutdown_connections 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 1 -- 172.21.15.46:0/1146230834 wait complete. 2024-03-04T08:50:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.723+0000 7fed371e0740 20 client.4464 trim_cache size 0 max 16384 2024-03-04T08:50:15.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.761+0000 7fed371e0740 1 Processor -- start 2024-03-04T08:50:15.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.761+0000 7fed371e0740 1 -- start start 2024-03-04T08:50:15.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.763+0000 7fed371e0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.763+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x55712080a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.763+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712080a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.763+0000 7fed371e0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0c78d0 con 0x55712080b1b0 2024-03-04T08:50:15.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.763+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55712082f620 con 0x557120855030 2024-03-04T08:50:15.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.763+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55712084f870 con 0x55712084fd00 2024-03-04T08:50:15.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.764+0000 7fed31200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x55712080a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.764+0000 7fed32600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712080a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.764+0000 7fed31c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.764+0000 7fed32600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712080a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37568/0 (socket says 172.21.15.46:37568) 2024-03-04T08:50:15.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.764+0000 7fed32600640 1 -- 172.21.15.46:0/3938493066 learned_addr learned my addr 172.21.15.46:0/3938493066 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.766+0000 7fed32600640 1 -- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 msgr2=0x55712080a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.766+0000 7fed32600640 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x55712080a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.766+0000 7fed32600640 1 -- 172.21.15.46:0/3938493066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 msgr2=0x55712080b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.766+0000 7fed32600640 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.766+0000 7fed32600640 1 -- 172.21.15.46:0/3938493066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55712084b100 con 0x557120855030 2024-03-04T08:50:15.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.768+0000 7fed32600640 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712080a660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed24000f60 tx=0x7fed24057a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181dff8ad2705992 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.771+0000 7fed21600640 1 -- 172.21.15.46:0/3938493066 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24060080 con 0x557120855030 2024-03-04T08:50:15.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.773+0000 7fed21600640 1 -- 172.21.15.46:0/3938493066 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24056070 con 0x557120855030 2024-03-04T08:50:15.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.773+0000 7fed21600640 1 -- 172.21.15.46:0/3938493066 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2406bdc0 con 0x557120855030 2024-03-04T08:50:15.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 -- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 msgr2=0x55712080a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712080a660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed24000f60 tx=0x7fed24057a80 comp rx=0 tx=0).stop 2024-03-04T08:50:15.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 -- 172.21.15.46:0/3938493066 shutdown_connections 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557120855030 0x55712080a660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712084fd00 0x55712080a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 --2- 172.21.15.46:0/3938493066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55712080b1b0 0x55712080b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 -- 172.21.15.46:0/3938493066 >> 172.21.15.46:0/3938493066 conn(0x557120809c10 msgr2=0x557120854100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 -- 172.21.15.46:0/3938493066 shutdown_connections 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.774+0000 7fed371e0740 1 -- 172.21.15.46:0/3938493066 wait complete. 2024-03-04T08:50:15.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.775+0000 7fed371e0740 1 -- start start 2024-03-04T08:50:15.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.775+0000 7fed371e0740 1 Processor -- start 2024-03-04T08:50:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.777+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712080b1b0 0x55712084d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.777+0000 7fed371e0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55712084fd00 0x557120827b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.777+0000 7fed371e0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557120855030 0x5571208b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.777+0000 7fed371e0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571208301d0 con 0x557120855030 2024-03-04T08:50:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.777+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557120854840 con 0x55712084fd00 2024-03-04T08:50:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.777+0000 7fed371e0740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55712082ebe0 con 0x55712080b1b0 2024-03-04T08:50:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.778+0000 7fed371e0740 10 client.0 _ll_register_callbacks cb 0x7fed18009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.778+0000 7fed31c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712080b1b0 0x55712084d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.778+0000 7fed31200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55712084fd00 0x557120827b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.778+0000 7fed32600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557120855030 0x5571208b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.778+0000 7fed31c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712080b1b0 0x55712084d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58262/0 (socket says 172.21.15.46:58262) 2024-03-04T08:50:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.778+0000 7fed31c00640 1 -- 172.21.15.46:0/3835783163 learned_addr learned my addr 172.21.15.46:0/3835783163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.782+0000 7fed32600640 1 -- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712080b1b0 msgr2=0x55712084d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.782+0000 7fed32600640 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712080b1b0 0x55712084d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.782+0000 7fed32600640 1 -- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55712084fd00 msgr2=0x557120827b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.782+0000 7fed32600640 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55712084fd00 0x557120827b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.782+0000 7fed32600640 1 -- 172.21.15.46:0/3835783163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55712082de50 con 0x557120855030 2024-03-04T08:50:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.784+0000 7fed32600640 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557120855030 0x5571208b8af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed24001200 tx=0x7fed24087880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e843279d80e280 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.784+0000 7fed16a00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-03-04T08:50:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.788+0000 7fed16a00640 1 -- 172.21.15.46:0/3835783163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24057100 con 0x557120855030 2024-03-04T08:50:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.788+0000 7fed16a00640 1 -- 172.21.15.46:0/3835783163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fed240572a0 con 0x557120855030 2024-03-04T08:50:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.788+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557120776e90 con 0x557120855030 2024-03-04T08:50:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.790+0000 7fed16a00640 1 -- 172.21.15.46:0/3835783163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed24053a00 con 0x557120855030 2024-03-04T08:50:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.790+0000 7fed371e0740 10 client.4470 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.790+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55712080a860 con 0x557120855030 2024-03-04T08:50:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed16a00640 1 -- 172.21.15.46:0/3835783163 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557120776e90 con 0x557120855030 2024-03-04T08:50:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed16a00640 1 -- 172.21.15.46:0/3835783163 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7fed2407c020 con 0x557120855030 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed371e0740 10 client.4470 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed371e0740 10 client.4470 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed371e0740 20 client.4470 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed371e0740 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x55712082cb10 0x55712082cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed371e0740 4 client.4470 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.795+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 --> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5571206f5860 con 0x55712082cb10 2024-03-04T08:50:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.796+0000 7fed31c00640 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x55712082cb10 0x55712082cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.800+0000 7fed31c00640 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x55712082cb10 0x55712082cef0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=51776d77298ae38f server_cookie=2006586d81163c4d in_seq=0 out_seq=0 2024-03-04T08:50:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.800+0000 7fed16a00640 10 client.4470 ms_handle_connect on v2:172.21.15.73:6834/3860229017 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed16a00640 1 -- 172.21.15.46:0/3835783163 <== mds.4 v2:172.21.15.73:6834/3860229017 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5571206f5860 con 0x55712082cb10 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed16a00640 10 client.4470 handle_command_reply: tid=0 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 client.4470 shutdown 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557120855030 msgr2=0x5571208b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557120855030 0x5571208b8af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed24001200 tx=0x7fed24087880 comp rx=0 tx=0).stop 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 shutdown_connections 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55712084fd00 0x557120827b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:6834/3860229017,v1:172.21.15.73:6835/3860229017] conn(0x55712082cb10 0x55712082cef0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557120855030 0x5571208b8af0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 --2- 172.21.15.46:0/3835783163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55712080b1b0 0x55712084d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed16a00640 0 client.4470 ms_handle_reset on v2:172.21.15.73:6834/3860229017 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.818+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 >> 172.21.15.46:0/3835783163 conn(0x557120809c10 msgr2=0x55712084a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.819+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 shutdown_connections 2024-03-04T08:50:15.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.819+0000 7fed371e0740 1 -- 172.21.15.46:0/3835783163 wait complete. 2024-03-04T08:50:15.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.819+0000 7fed371e0740 20 client.4470 trim_cache size 0 max 16384 2024-03-04T08:50:15.816 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T08:50:15.816 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "bc679561-c3d1-42a9-8f4c-6c87fdde4dff", 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4252, 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 20.115207163000001, 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 23, 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 46.153167472 2024-03-04T08:50:15.817 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed0c06b4c0 msgr2=0x7fed0c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed0c06b4c0 0x7fed0c06d980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed2c14b5c0 tx=0x7fed180046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed2c14b6f0 msgr2=0x7fed2c0b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed2c14b6f0 0x7fed2c0b1b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c390 tx=0x7fed2400c850 comp rx=0 tx=0).stop 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 shutdown_connections 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fed0c06b4c0 0x7fed0c06d980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed2c14b6f0 0x7fed2c0b1b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed2c154750 0x7fed2c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 --2- 172.21.15.46:0/3753792389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2c0ce650 0x7fed2c1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:15.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 >> 172.21.15.46:0/3753792389 conn(0x7fed2c066c40 msgr2=0x7fed2c153520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:15.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 shutdown_connections 2024-03-04T08:50:15.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:15.820+0000 7fed34600640 1 -- 172.21.15.46:0/3753792389 wait complete. 2024-03-04T08:50:15.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-04T08:50:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.058+0000 7f4f99000640 1 Processor -- start 2024-03-04T08:50:16.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.058+0000 7f4f99000640 1 -- start start 2024-03-04T08:50:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.060+0000 7f4f99000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f94165c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.060+0000 7f4f99000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9415e7e0 con 0x7f4f940cc4e0 2024-03-04T08:50:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.060+0000 7f4f99000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9406b310 con 0x7f4f940cc8c0 2024-03-04T08:50:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.060+0000 7f4f99000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415b310 con 0x7f4f940c7110 2024-03-04T08:50:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.061+0000 7f4f93e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f94165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.061+0000 7f4f93400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4f940cc4e0 0x7f4f9415ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38182/0 (socket says 172.21.15.46:38182) 2024-03-04T08:50:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.061+0000 7f4f93400640 1 -- 172.21.15.46:0/2464526727 learned_addr learned my addr 172.21.15.46:0/2464526727 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.064+0000 7f4f93e00640 1 -- 172.21.15.46:0/2464526727 >> v1:172.21.15.73:6789/0 conn(0x7f4f940cc8c0 legacy=0x7f4f94154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.064+0000 7f4f93e00640 1 -- 172.21.15.46:0/2464526727 >> v1:172.21.15.46:6789/0 conn(0x7f4f940cc4e0 legacy=0x7f4f9415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.064+0000 7f4f93e00640 1 -- 172.21.15.46:0/2464526727 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9415e500 con 0x7f4f940c7110 2024-03-04T08:50:16.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.067+0000 7f4f93e00640 1 --2- 172.21.15.46:0/2464526727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f94165c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009dc0 tx=0x7f4f8c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b338f26e72876478 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.073+0000 7f4f92000640 1 -- 172.21.15.46:0/2464526727 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c039070 con 0x7f4f940c7110 2024-03-04T08:50:16.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.073+0000 7f4f92000640 1 -- 172.21.15.46:0/2464526727 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c02cc40 con 0x7f4f940c7110 2024-03-04T08:50:16.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.073+0000 7f4f92000640 1 -- 172.21.15.46:0/2464526727 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c034440 con 0x7f4f940c7110 2024-03-04T08:50:16.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 -- 172.21.15.46:0/2464526727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 msgr2=0x7f4f94165c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 --2- 172.21.15.46:0/2464526727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f94165c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009dc0 tx=0x7f4f8c02be90 comp rx=0 tx=0).stop 2024-03-04T08:50:16.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 -- 172.21.15.46:0/2464526727 shutdown_connections 2024-03-04T08:50:16.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 --2- 172.21.15.46:0/2464526727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f94165c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 -- 172.21.15.46:0/2464526727 >> 172.21.15.46:0/2464526727 conn(0x7f4f9406dcd0 msgr2=0x7f4f9406e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 -- 172.21.15.46:0/2464526727 shutdown_connections 2024-03-04T08:50:16.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.074+0000 7f4f99000640 1 -- 172.21.15.46:0/2464526727 wait complete. 2024-03-04T08:50:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.077+0000 7f4f99000640 1 Processor -- start 2024-03-04T08:50:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.077+0000 7f4f99000640 1 -- start start 2024-03-04T08:50:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.078+0000 7f4f99000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f941f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.078+0000 7f4f99000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 0x7f4f941f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.078+0000 7f4f99000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f940cc8c0 0x7f4f94159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.078+0000 7f4f99000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9406aff0 con 0x7f4f940cc4e0 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.078+0000 7f4f99000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415a6e0 con 0x7f4f940cc8c0 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.078+0000 7f4f99000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c77f0 con 0x7f4f940c7110 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.079+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 0x7f4f941f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.079+0000 7f4f93400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f941f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.079+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 0x7f4f941f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32884/0 (socket says 172.21.15.46:32884) 2024-03-04T08:50:16.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.079+0000 7f4f92a00640 1 -- 172.21.15.46:0/1124037060 learned_addr learned my addr 172.21.15.46:0/1124037060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.083+0000 7f4f92a00640 1 -- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 msgr2=0x7f4f941f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.083+0000 7f4f92a00640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f941f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.083+0000 7f4f92a00640 1 -- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f940cc8c0 msgr2=0x7f4f94159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.083+0000 7f4f92a00640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f940cc8c0 0x7f4f94159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.083+0000 7f4f92a00640 1 -- 172.21.15.46:0/1124037060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f941f4470 con 0x7f4f940cc4e0 2024-03-04T08:50:16.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.086+0000 7f4f92a00640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 0x7f4f941f3f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009fd0 tx=0x7f4f8000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.089+0000 7f4f8b400640 1 -- 172.21.15.46:0/1124037060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80015020 con 0x7f4f940cc4e0 2024-03-04T08:50:16.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.089+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f941f0740 con 0x7f4f940cc4e0 2024-03-04T08:50:16.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.089+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f941f0d00 con 0x7f4f940cc4e0 2024-03-04T08:50:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.091+0000 7f4f8b400640 1 -- 172.21.15.46:0/1124037060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80011830 con 0x7f4f940cc4e0 2024-03-04T08:50:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.092+0000 7f4f8b400640 1 -- 172.21.15.46:0/1124037060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80011be0 con 0x7f4f940cc4e0 2024-03-04T08:50:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.094+0000 7f4f9d274740 1 Processor -- start 2024-03-04T08:50:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.094+0000 7f4f9d274740 1 -- start start 2024-03-04T08:50:16.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.095+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfec0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.095+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfec0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.095+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 0x55d1cfeffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.095+0000 7f4f9d274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfe24600 con 0x55d1cff0a210 2024-03-04T08:50:16.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.095+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfdcd930 con 0x55d1cfebedf0 2024-03-04T08:50:16.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.095+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfe206a0 con 0x55d1cfec0390 2024-03-04T08:50:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.096+0000 7f4f93e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfec0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.096+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 0x55d1cfeffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.096+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 0x55d1cfeffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37594/0 (socket says 172.21.15.46:37594) 2024-03-04T08:50:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.097+0000 7f4f92a00640 1 -- 172.21.15.46:0/3489835979 learned_addr learned my addr 172.21.15.46:0/3489835979 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.099+0000 7f4f92a00640 1 -- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 msgr2=0x55d1cfec0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.099+0000 7f4f92a00640 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfec0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.099+0000 7f4f92a00640 1 -- 172.21.15.46:0/3489835979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 msgr2=0x55d1cfec0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.099+0000 7f4f92a00640 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfec0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.099+0000 7f4f92a00640 1 -- 172.21.15.46:0/3489835979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1cfb392d0 con 0x55d1cfebedf0 2024-03-04T08:50:16.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.102+0000 7f4f92a00640 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 0x55d1cfeffbf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006fd0 tx=0x7f4f8000e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d8376efeddee9f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.107+0000 7f4f7fe00640 1 -- 172.21.15.46:0/3489835979 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80034070 con 0x55d1cfebedf0 2024-03-04T08:50:16.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.107+0000 7f4f7fe00640 1 -- 172.21.15.46:0/3489835979 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8001a5c0 con 0x55d1cfebedf0 2024-03-04T08:50:16.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.107+0000 7f4f7fe00640 1 -- 172.21.15.46:0/3489835979 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8001a9f0 con 0x55d1cfebedf0 2024-03-04T08:50:16.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 -- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 msgr2=0x55d1cfeffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 0x55d1cfeffbf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006fd0 tx=0x7f4f8000e000 comp rx=0 tx=0).stop 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 -- 172.21.15.46:0/3489835979 shutdown_connections 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfebedf0 0x55d1cfeffbf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfec0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 --2- 172.21.15.46:0/3489835979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfec0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 -- 172.21.15.46:0/3489835979 >> 172.21.15.46:0/3489835979 conn(0x55d1cfebcb00 msgr2=0x55d1cfebf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 -- 172.21.15.46:0/3489835979 shutdown_connections 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.108+0000 7f4f9d274740 1 -- 172.21.15.46:0/3489835979 wait complete. 2024-03-04T08:50:16.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.109+0000 7f4f9d274740 1 -- start start 2024-03-04T08:50:16.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.109+0000 7f4f9d274740 1 Processor -- start 2024-03-04T08:50:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cfec0390 0x55d1cff13130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cff0a210 0x55d1cfee5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfee58f0 con 0x55d1cfec0390 2024-03-04T08:50:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfde0d90 con 0x55d1cff0a210 2024-03-04T08:50:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfebdcb0 con 0x55d1cfefb8b0 2024-03-04T08:50:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.111+0000 7f4f9d274740 10 client.0 _ll_register_callbacks cb 0x55d1cfe1c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.112+0000 7f4f93400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cff0a210 0x55d1cfee5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.112+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.112+0000 7f4f93400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cff0a210 0x55d1cfee5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37602/0 (socket says 172.21.15.46:37602) 2024-03-04T08:50:16.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.112+0000 7f4f93400640 1 -- 172.21.15.46:0/2117492709 learned_addr learned my addr 172.21.15.46:0/2117492709 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.115+0000 7f4f92a00640 1 -- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cff0a210 msgr2=0x55d1cfee5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.115+0000 7f4f92a00640 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cff0a210 0x55d1cfee5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.115+0000 7f4f92a00640 1 -- 172.21.15.46:0/2117492709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cfec0390 msgr2=0x55d1cff13130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.115+0000 7f4f92a00640 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cfec0390 0x55d1cff13130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.115+0000 7f4f92a00640 1 -- 172.21.15.46:0/2117492709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1cfc036b0 con 0x55d1cfefb8b0 2024-03-04T08:50:16.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.118+0000 7f4f92a00640 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff059c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8001c040 tx=0x7f4f80011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe354c0ac17c2c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.118+0000 7f4f7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-03-04T08:50:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.121+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2117492709 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8003d060 con 0x55d1cfefb8b0 2024-03-04T08:50:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.121+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f8001a5c0 con 0x55d1cfefb8b0 2024-03-04T08:50:16.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.123+0000 7f4f8b400640 1 -- 172.21.15.46:0/1124037060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f80018020 con 0x7f4f940cc4e0 2024-03-04T08:50:16.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.123+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2117492709 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4f8008efe0 con 0x55d1cfefb8b0 2024-03-04T08:50:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.124+0000 7f4f8b400640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4f7406b440 0x7f4f7406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.124+0000 7f4f93e00640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4f7406b440 0x7f4f7406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.125+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2117492709 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f8005d630 con 0x55d1cfefb8b0 2024-03-04T08:50:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.125+0000 7f4f9d274740 10 client.4517 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.125+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1cfefd090 con 0x55d1cfefb8b0 2024-03-04T08:50:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.125+0000 7f4f93e00640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4f7406b440 0x7f4f7406d900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c036000 tx=0x7f4f8c02e070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.127+0000 7f4f8b400640 1 -- 172.21.15.46:0/1124037060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4f8008d5e0 con 0x7f4f940cc4e0 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2117492709 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8001a5c0 con 0x55d1cfefb8b0 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2117492709 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7f4f8005c030 con 0x55d1cfefb8b0 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f9d274740 10 client.4517 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f9d274740 10 client.4517 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f9d274740 20 client.4517 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff08ca0 0x55d1cff20140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f9d274740 4 client.4517 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:50:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.136+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 --> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1cfe31b40 con 0x55d1cff08ca0 2024-03-04T08:50:16.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.145+0000 7f4f93400640 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff08ca0 0x55d1cff20140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.233+0000 7f4f93400640 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff08ca0 0x55d1cff20140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2245754073144af3 server_cookie=a9991f9de173b8d4 in_seq=0 out_seq=0 2024-03-04T08:50:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.233+0000 7f4f7cc00640 10 client.4517 ms_handle_connect on v2:172.21.15.73:6836/381408316 2024-03-04T08:50:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.384+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2117492709 <== mds.3 v2:172.21.15.73:6836/381408316 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d1cfe31b40 con 0x55d1cff08ca0 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.384+0000 7f4f7cc00640 10 client.4517 handle_command_reply: tid=0 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 client.4517 shutdown 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 msgr2=0x55d1cff059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff059c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8001c040 tx=0x7f4f80011000 comp rx=0 tx=0).stop 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 shutdown_connections 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff08ca0 0x55d1cff20140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cff0a210 0x55d1cfee5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff059c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2117492709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cfec0390 0x55d1cff13130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f7cc00640 0 client.4517 ms_handle_reset on v2:172.21.15.73:6836/381408316 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 >> 172.21.15.46:0/2117492709 conn(0x55d1cfebedf0 msgr2=0x55d1cfeb97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 shutdown_connections 2024-03-04T08:50:16.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.385+0000 7f4f9d274740 1 -- 172.21.15.46:0/2117492709 wait complete. 2024-03-04T08:50:16.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.386+0000 7f4f9d274740 20 client.4517 trim_cache size 0 max 16384 2024-03-04T08:50:16.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.434+0000 7f4f9d274740 1 Processor -- start 2024-03-04T08:50:16.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.434+0000 7f4f9d274740 1 -- start start 2024-03-04T08:50:16.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.436+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfefbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.436+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 0x55d1cfee8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.436+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfee8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.436+0000 7f4f9d274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c00aaf0 con 0x55d1cff0a210 2024-03-04T08:50:16.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.436+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfee58f0 con 0x55d1cfefb8b0 2024-03-04T08:50:16.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.436+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfebdcb0 con 0x55d1cfec0390 2024-03-04T08:50:16.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.437+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 0x55d1cfee8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.437+0000 7f4f93400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfefbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.437+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 0x55d1cfee8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37618/0 (socket says 172.21.15.46:37618) 2024-03-04T08:50:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.437+0000 7f4f92a00640 1 -- 172.21.15.46:0/206044200 learned_addr learned my addr 172.21.15.46:0/206044200 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.437+0000 7f4f93e00640 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfee8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.440+0000 7f4f92a00640 1 -- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 msgr2=0x55d1cfefbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.440+0000 7f4f92a00640 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfefbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.440+0000 7f4f92a00640 1 -- 172.21.15.46:0/206044200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 msgr2=0x55d1cfee8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.440+0000 7f4f92a00640 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfee8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.440+0000 7f4f92a00640 1 -- 172.21.15.46:0/206044200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1cfee5e90 con 0x55d1cfefb8b0 2024-03-04T08:50:16.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.442+0000 7f4f92a00640 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 0x55d1cfee8730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000bd70 tx=0x7f4f80009150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e7b4541443ce85 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.446+0000 7f4f7f400640 1 -- 172.21.15.46:0/206044200 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8003d040 con 0x55d1cfefb8b0 2024-03-04T08:50:16.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.446+0000 7f4f7f400640 1 -- 172.21.15.46:0/206044200 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80061920 con 0x55d1cfefb8b0 2024-03-04T08:50:16.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.446+0000 7f4f7f400640 1 -- 172.21.15.46:0/206044200 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80034080 con 0x55d1cfefb8b0 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 -- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 msgr2=0x55d1cfee8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 0x55d1cfee8730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000bd70 tx=0x7f4f80009150 comp rx=0 tx=0).stop 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 -- 172.21.15.46:0/206044200 shutdown_connections 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfefb8b0 0x55d1cfee8730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cfee8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 --2- 172.21.15.46:0/206044200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfec0390 0x55d1cfefbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 -- 172.21.15.46:0/206044200 >> 172.21.15.46:0/206044200 conn(0x55d1cfebedf0 msgr2=0x55d1cfec1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 -- 172.21.15.46:0/206044200 shutdown_connections 2024-03-04T08:50:16.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.447+0000 7f4f9d274740 1 -- 172.21.15.46:0/206044200 wait complete. 2024-03-04T08:50:16.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.448+0000 7f4f9d274740 1 -- start start 2024-03-04T08:50:16.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.448+0000 7f4f9d274740 1 Processor -- start 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 0x55d1cff17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff79820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cff018d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cff09080 con 0x55d1cff0a210 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cfee64f0 con 0x55d1cfec0390 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cff14d90 con 0x55d1cfefb8b0 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f9d274740 10 client.0 _ll_register_callbacks cb 0x7f4f80032070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f93400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 0x55d1cff17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.450+0000 7f4f92a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff79820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.451+0000 7f4f93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cff018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.451+0000 7f4f93400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 0x55d1cff17a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37628/0 (socket says 172.21.15.46:37628) 2024-03-04T08:50:16.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.451+0000 7f4f93400640 1 -- 172.21.15.46:0/2801496953 learned_addr learned my addr 172.21.15.46:0/2801496953 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.454+0000 7f4f93400640 1 -- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 msgr2=0x55d1cff79820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.454+0000 7f4f93400640 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff79820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.454+0000 7f4f93400640 1 -- 172.21.15.46:0/2801496953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 msgr2=0x55d1cff018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.454+0000 7f4f93400640 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cff018d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.454+0000 7f4f93400640 1 -- 172.21.15.46:0/2801496953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1cff14fb0 con 0x55d1cfec0390 2024-03-04T08:50:16.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.456+0000 7f4f93400640 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 0x55d1cff17a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55d1cff155b0 tx=0x7f4f8401a3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32af664d680df231 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.456+0000 7f4f7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-04T08:50:16.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.460+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2801496953 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8401a880 con 0x55d1cfec0390 2024-03-04T08:50:16.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.460+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2801496953 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4f8401aa20 con 0x55d1cfec0390 2024-03-04T08:50:16.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.460+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f80061920 con 0x55d1cfec0390 2024-03-04T08:50:16.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.463+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2801496953 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f8401ac20 con 0x55d1cfec0390 2024-03-04T08:50:16.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.463+0000 7f4f9d274740 10 client.4585 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:16.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.463+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1cfec0b90 con 0x55d1cfec0390 2024-03-04T08:50:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2801496953 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80061920 con 0x55d1cfec0390 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2801496953 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7f4f840245e0 con 0x55d1cfec0390 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f9d274740 10 client.4585 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f9d274740 10 client.4585 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f9d274740 20 client.4585 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff7d380 0x55d1cff7d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f9d274740 4 client.4585 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.468+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 --> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1cfe2be90 con 0x55d1cff7d380 2024-03-04T08:50:16.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.469+0000 7f4f92a00640 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff7d380 0x55d1cff7d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.474+0000 7f4f7cc00640 10 client.4585 ms_handle_connect on v2:172.21.15.73:6836/381408316 2024-03-04T08:50:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.474+0000 7f4f92a00640 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff7d380 0x55d1cff7d760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=41e32213c6191e51 server_cookie=100ddfcbbd8a32b in_seq=0 out_seq=0 2024-03-04T08:50:16.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.493+0000 7f4f7cc00640 1 -- 172.21.15.46:0/2801496953 <== mds.3 v2:172.21.15.73:6836/381408316 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d1cfe2be90 con 0x55d1cff7d380 2024-03-04T08:50:16.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.493+0000 7f4f7cc00640 10 client.4585 handle_command_reply: tid=0 2024-03-04T08:50:16.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.493+0000 7f4f9d274740 1 client.4585 shutdown 2024-03-04T08:50:16.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 msgr2=0x55d1cff17a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 0x55d1cff17a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55d1cff155b0 tx=0x7f4f8401a3b0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 shutdown_connections 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:6836/381408316,v1:172.21.15.73:6838/381408316] conn(0x55d1cff7d380 0x55d1cff7d760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d1cff0a210 0x55d1cff018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d1cfefb8b0 0x55d1cff79820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 --2- 172.21.15.46:0/2801496953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d1cfec0390 0x55d1cff17a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f7cc00640 0 client.4585 ms_handle_reset on v2:172.21.15.73:6836/381408316 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 >> 172.21.15.46:0/2801496953 conn(0x55d1cfebedf0 msgr2=0x55d1cfee4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 shutdown_connections 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 1 -- 172.21.15.46:0/2801496953 wait complete. 2024-03-04T08:50:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.494+0000 7f4f9d274740 20 client.4585 trim_cache size 0 max 16384 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "bc679561-c3d1-42a9-8f4c-6c87fdde4dff", 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4259, 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 23.413155941999999, 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 23, 2024-03-04T08:50:16.492 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 46.768169606000001 2024-03-04T08:50:16.493 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T08:50:16.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4f7406b440 msgr2=0x7f4f7406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4f7406b440 0x7f4f7406d900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c036000 tx=0x7f4f8c02e070 comp rx=0 tx=0).stop 2024-03-04T08:50:16.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 msgr2=0x7f4f941f3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 0x7f4f941f3f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009fd0 tx=0x7f4f8000b870 comp rx=0 tx=0).stop 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 shutdown_connections 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4f7406b440 0x7f4f7406d900 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f940cc8c0 0x7f4f94159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f940cc4e0 0x7f4f941f3f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 --2- 172.21.15.46:0/1124037060 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4f940c7110 0x7f4f941f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.495+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 >> 172.21.15.46:0/1124037060 conn(0x7f4f9406dcd0 msgr2=0x7f4f9406e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.496+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 shutdown_connections 2024-03-04T08:50:16.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.496+0000 7f4f99000640 1 -- 172.21.15.46:0/1124037060 wait complete. 2024-03-04T08:50:16.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-04T08:50:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.694+0000 7fa7f5a00640 1 Processor -- start 2024-03-04T08:50:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.694+0000 7fa7f5a00640 1 -- start start 2024-03-04T08:50:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.696+0000 7fa7f5a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7f015e320 0x7fa7f015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.696+0000 7fa7f5a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7f00cedc0 0x7fa7f00cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.696+0000 7fa7f5a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00ccf10 con 0x7fa7f015add0 2024-03-04T08:50:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.696+0000 7fa7f5a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f015e740 con 0x7fa7f00cedc0 2024-03-04T08:50:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.696+0000 7fa7f5a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f015de90 con 0x7fa7f015e320 2024-03-04T08:50:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.697+0000 7fa7ef400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7f015e320 0x7fa7f015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.697+0000 7fa7ef400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7f015e320 0x7fa7f015a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37640/0 (socket says 172.21.15.46:37640) 2024-03-04T08:50:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.697+0000 7fa7ef400640 1 -- 172.21.15.46:0/3543268402 learned_addr learned my addr 172.21.15.46:0/3543268402 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.697+0000 7fa7f5000640 1 --2- 172.21.15.46:0/3543268402 >> v2:172.21.15.46:3300/0 conn(0x7fa7f00cedc0 0x7fa7f00cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.700+0000 7fa7ef400640 1 -- 172.21.15.46:0/3543268402 >> v2:172.21.15.46:3300/0 conn(0x7fa7f00cedc0 msgr2=0x7fa7f00cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.700+0000 7fa7ef400640 1 --2- 172.21.15.46:0/3543268402 >> v2:172.21.15.46:3300/0 conn(0x7fa7f00cedc0 0x7fa7f00cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.700+0000 7fa7ef400640 1 -- 172.21.15.46:0/3543268402 >> v1:172.21.15.46:6789/0 conn(0x7fa7f015add0 legacy=0x7fa7f00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.701+0000 7fa7ef400640 1 -- 172.21.15.46:0/3543268402 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00cfe30 con 0x7fa7f015e320 2024-03-04T08:50:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.705+0000 7fa7ef400640 1 --2- 172.21.15.46:0/3543268402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f015e320 0x7fa7f015a2d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa7f015e010 tx=0x7fa7dc02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2da818503708a941 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.709+0000 7fa7eea00640 1 -- 172.21.15.46:0/3543268402 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc02f840 con 0x7fa7f015e320 2024-03-04T08:50:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.709+0000 7fa7eea00640 1 -- 172.21.15.46:0/3543268402 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc02f9e0 con 0x7fa7f015e320 2024-03-04T08:50:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.709+0000 7fa7eea00640 1 -- 172.21.15.46:0/3543268402 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc02fdb0 con 0x7fa7f015e320 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.710+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3543268402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f015e320 msgr2=0x7fa7f015a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.710+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3543268402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f015e320 0x7fa7f015a2d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa7f015e010 tx=0x7fa7dc02ba20 comp rx=0 tx=0).stop 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.711+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3543268402 shutdown_connections 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.711+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3543268402 >> v2:172.21.15.46:3300/0 conn(0x7fa7f00cedc0 0x7fa7f00cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.711+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3543268402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f015e320 0x7fa7f015a2d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.711+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3543268402 >> 172.21.15.46:0/3543268402 conn(0x7fa7f0066c40 msgr2=0x7fa7f0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.711+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3543268402 shutdown_connections 2024-03-04T08:50:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.711+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3543268402 wait complete. 2024-03-04T08:50:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.714+0000 7fa7f5a00640 1 Processor -- start 2024-03-04T08:50:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.714+0000 7fa7f5a00640 1 -- start start 2024-03-04T08:50:16.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 0x7fa7f01f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f015add0 0x7fa7f01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7f015e320 0x7fa7f0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f015d840 con 0x7fa7f015add0 2024-03-04T08:50:16.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00d03f0 con 0x7fa7f00cedc0 2024-03-04T08:50:16.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f015db20 con 0x7fa7f015e320 2024-03-04T08:50:16.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7efe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 0x7fa7f01f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.716+0000 7fa7f5000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7f015e320 0x7fa7f0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.717+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f015add0 0x7fa7f01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.717+0000 7fa7efe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 0x7fa7f01f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37644/0 (socket says 172.21.15.46:37644) 2024-03-04T08:50:16.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.717+0000 7fa7efe00640 1 -- 172.21.15.46:0/3328953141 learned_addr learned my addr 172.21.15.46:0/3328953141 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.720+0000 7fa7efe00640 1 -- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7f015e320 msgr2=0x7fa7f0151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.720+0000 7fa7efe00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7f015e320 0x7fa7f0151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.721+0000 7fa7efe00640 1 -- 172.21.15.46:0/3328953141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f015add0 msgr2=0x7fa7f01515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.721+0000 7fa7efe00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f015add0 0x7fa7f01515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.721+0000 7fa7efe00640 1 -- 172.21.15.46:0/3328953141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00afc70 con 0x7fa7f00cedc0 2024-03-04T08:50:16.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.723+0000 7fa7efe00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 0x7fa7f01f37b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c7f0 tx=0x7fa7e000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.728+0000 7fa7e7e00640 1 -- 172.21.15.46:0/3328953141 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0016020 con 0x7fa7f00cedc0 2024-03-04T08:50:16.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.728+0000 7fa7e7e00640 1 -- 172.21.15.46:0/3328953141 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0006d50 con 0x7fa7f00cedc0 2024-03-04T08:50:16.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.728+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f01f40e0 con 0x7fa7f00cedc0 2024-03-04T08:50:16.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.728+0000 7fa7e7e00640 1 -- 172.21.15.46:0/3328953141 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0003bb0 con 0x7fa7f00cedc0 2024-03-04T08:50:16.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.729+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f00b0910 con 0x7fa7f00cedc0 2024-03-04T08:50:16.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.734+0000 7fa7f9c2f740 1 Processor -- start 2024-03-04T08:50:16.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.734+0000 7fa7f9c2f740 1 -- start start 2024-03-04T08:50:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.735+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed10390 0x559c1ed10770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.735+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed5a210 0x559c1ed10cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.735+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 0x559c1ed4fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.735+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ec74600 con 0x559c1ed5a210 2024-03-04T08:50:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.735+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ec1d930 con 0x559c1ed10390 2024-03-04T08:50:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.735+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c1ec706a0 con 0x559c1ed0edf0 2024-03-04T08:50:16.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.736+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 0x559c1ed4fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.736+0000 7fa7efe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed5a210 0x559c1ed10cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.737+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 0x559c1ed4fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58318/0 (socket says 172.21.15.46:58318) 2024-03-04T08:50:16.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.737+0000 7fa7ef400640 1 -- 172.21.15.46:0/104460233 learned_addr learned my addr 172.21.15.46:0/104460233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.740+0000 7fa7ef400640 1 -- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed10390 msgr2=0x559c1ed10770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.740+0000 7fa7ef400640 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed10390 0x559c1ed10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.740+0000 7fa7ef400640 1 -- 172.21.15.46:0/104460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed5a210 msgr2=0x559c1ed10cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.740+0000 7fa7ef400640 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed5a210 0x559c1ed10cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.740+0000 7fa7ef400640 1 -- 172.21.15.46:0/104460233 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1e9892d0 con 0x559c1ed0edf0 2024-03-04T08:50:16.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.742+0000 7fa7ef400640 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 0x559c1ed4fbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc02ba60 tx=0x7fa7dc030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b523f1f84138e254 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.746+0000 7fa7e4c00640 1 -- 172.21.15.46:0/104460233 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc047070 con 0x559c1ed0edf0 2024-03-04T08:50:16.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.746+0000 7fa7e4c00640 1 -- 172.21.15.46:0/104460233 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc02f980 con 0x559c1ed0edf0 2024-03-04T08:50:16.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.747+0000 7fa7e4c00640 1 -- 172.21.15.46:0/104460233 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc02fd30 con 0x559c1ed0edf0 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.747+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 msgr2=0x559c1ed4fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.747+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 0x559c1ed4fbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc02ba60 tx=0x7fa7dc030000 comp rx=0 tx=0).stop 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/104460233 shutdown_connections 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed0edf0 0x559c1ed4fbf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed5a210 0x559c1ed10cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/104460233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed10390 0x559c1ed10770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/104460233 >> 172.21.15.46:0/104460233 conn(0x559c1ed0cb00 msgr2=0x559c1ed0f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:16.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/104460233 shutdown_connections 2024-03-04T08:50:16.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.748+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/104460233 wait complete. 2024-03-04T08:50:16.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.749+0000 7fa7f9c2f740 1 -- start start 2024-03-04T08:50:16.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.749+0000 7fa7f9c2f740 1 Processor -- start 2024-03-04T08:50:16.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 0x559c1ed2f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed5a210 0x559c1ed2d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed54000 0x559c1ed54480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed358f0 con 0x559c1ed10390 2024-03-04T08:50:16.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ec30d90 con 0x559c1ed54000 2024-03-04T08:50:16.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed0dcb0 con 0x559c1ed5a210 2024-03-04T08:50:16.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f9c2f740 10 client.0 _ll_register_callbacks cb 0x559c1ec6c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:16.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7f5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 0x559c1ed2f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.751+0000 7fa7efe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed5a210 0x559c1ed2d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.752+0000 7fa7f5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 0x559c1ed2f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32958/0 (socket says 172.21.15.46:32958) 2024-03-04T08:50:16.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.752+0000 7fa7f5000640 1 -- 172.21.15.46:0/1076582086 learned_addr learned my addr 172.21.15.46:0/1076582086 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.755+0000 7fa7f5000640 1 -- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed5a210 msgr2=0x559c1ed2d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.755+0000 7fa7f5000640 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed5a210 0x559c1ed2d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.755+0000 7fa7f5000640 1 -- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed54000 msgr2=0x559c1ed54480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.755+0000 7fa7f5000640 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed54000 0x559c1ed54480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.755+0000 7fa7f5000640 1 -- 172.21.15.46:0/1076582086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c1ea536b0 con 0x559c1ed10390 2024-03-04T08:50:16.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.758+0000 7fa7f5000640 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 0x559c1ed2f7b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8011690 tx=0x7fa7e8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922be954391a1168 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.758+0000 7fa7d9600640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-03-04T08:50:16.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.761+0000 7fa7e7e00640 1 -- 172.21.15.46:0/3328953141 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7e000a850 con 0x7fa7f00cedc0 2024-03-04T08:50:16.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.762+0000 7fa7d9600640 1 -- 172.21.15.46:0/1076582086 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800f740 con 0x559c1ed10390 2024-03-04T08:50:16.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.762+0000 7fa7d9600640 1 -- 172.21.15.46:0/1076582086 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa7e800f8e0 con 0x559c1ed10390 2024-03-04T08:50:16.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.762+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7dc02f980 con 0x559c1ed10390 2024-03-04T08:50:16.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.762+0000 7fa7e7e00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa7d006b490 0x7fa7d006d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.763+0000 7fa7efe00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa7d006b490 0x7fa7d006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.763+0000 7fa7efe00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa7d006b490 0x7fa7d006d950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0055bd0 tx=0x7fa7e0001250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.764+0000 7fa7d9600640 1 -- 172.21.15.46:0/1076582086 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7e8025050 con 0x559c1ed10390 2024-03-04T08:50:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.764+0000 7fa7f9c2f740 10 client.4497 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.764+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559c1ed64a70 con 0x559c1ed10390 2024-03-04T08:50:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.765+0000 7fa7e7e00640 1 -- 172.21.15.46:0/3328953141 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa7e006ee00 con 0x7fa7f00cedc0 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.769+0000 7fa7d9600640 1 -- 172.21.15.46:0/1076582086 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc02f980 con 0x559c1ed10390 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7d9600640 1 -- 172.21.15.46:0/1076582086 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7fa7e800fae0 con 0x559c1ed10390 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7f9c2f740 10 client.4497 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7f9c2f740 10 client.4497 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7f9c2f740 20 client.4497 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed6e480 0x559c1ed70870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7f9c2f740 4 client.4497 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:50:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.770+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 --> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c1ec81b40 con 0x559c1ed6e480 2024-03-04T08:50:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.778+0000 7fa7ef400640 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed6e480 0x559c1ed70870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:16.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.898+0000 7fa7ef400640 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed6e480 0x559c1ed70870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=666c2882f400702c server_cookie=5ec98dbf09cd5faf in_seq=0 out_seq=0 2024-03-04T08:50:16.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:16.898+0000 7fa7d9600640 10 client.4497 ms_handle_connect on v2:172.21.15.73:6837/1890974908 2024-03-04T08:50:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.028+0000 7fa7d9600640 1 -- 172.21.15.46:0/1076582086 <== mds.2 v2:172.21.15.73:6837/1890974908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559c1ec81b40 con 0x559c1ed6e480 2024-03-04T08:50:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.028+0000 7fa7d9600640 10 client.4497 handle_command_reply: tid=0 2024-03-04T08:50:17.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.028+0000 7fa7f9c2f740 1 client.4497 shutdown 2024-03-04T08:50:17.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.028+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 msgr2=0x559c1ed2f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.028+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 0x559c1ed2f7b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8011690 tx=0x7fa7e8011b50 comp rx=0 tx=0).stop 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 shutdown_connections 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed6e480 0x559c1ed70870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed54000 0x559c1ed54480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed5a210 0x559c1ed2d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1076582086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed10390 0x559c1ed2f7b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7d9600640 0 client.4497 ms_handle_reset on v2:172.21.15.73:6837/1890974908 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 >> 172.21.15.46:0/1076582086 conn(0x559c1ed0edf0 msgr2=0x559c1ed51450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 shutdown_connections 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1076582086 wait complete. 2024-03-04T08:50:17.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.029+0000 7fa7f9c2f740 20 client.4497 trim_cache size 0 max 16384 2024-03-04T08:50:17.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.083+0000 7fa7f9c2f740 1 Processor -- start 2024-03-04T08:50:17.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.083+0000 7fa7f9c2f740 1 -- start start 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.084+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed10b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.084+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed27c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.084+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1ed28140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.084+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f015a2b0 con 0x559c1ed54000 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.084+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed52380 con 0x559c1ed0edf0 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.084+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed2e280 con 0x559c1ed10390 2024-03-04T08:50:17.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.085+0000 7fa7f5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed10b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.085+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed27c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.085+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed27c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58338/0 (socket says 172.21.15.46:58338) 2024-03-04T08:50:17.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.085+0000 7fa7ef400640 1 -- 172.21.15.46:0/2541341521 learned_addr learned my addr 172.21.15.46:0/2541341521 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.088+0000 7fa7ef400640 1 -- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 msgr2=0x559c1ed10b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.088+0000 7fa7ef400640 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed10b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.088+0000 7fa7ef400640 1 -- 172.21.15.46:0/2541341521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 msgr2=0x559c1ed28140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.088+0000 7fa7ef400640 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1ed28140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.088+0000 7fa7ef400640 1 -- 172.21.15.46:0/2541341521 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1ed54480 con 0x559c1ed10390 2024-03-04T08:50:17.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.090+0000 7fa7ef400640 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed27c00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00cc7b0 tx=0x7fa7dc009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28f7c4b2a1492f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.094+0000 7fa7dbe00640 1 -- 172.21.15.46:0/2541341521 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc047070 con 0x559c1ed10390 2024-03-04T08:50:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.094+0000 7fa7dbe00640 1 -- 172.21.15.46:0/2541341521 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc004040 con 0x559c1ed10390 2024-03-04T08:50:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.094+0000 7fa7dbe00640 1 -- 172.21.15.46:0/2541341521 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc04c4b0 con 0x559c1ed10390 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.094+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 msgr2=0x559c1ed27c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.094+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed27c00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00cc7b0 tx=0x7fa7dc009240 comp rx=0 tx=0).stop 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/2541341521 shutdown_connections 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1ed28140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed27c00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/2541341521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed10b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/2541341521 >> 172.21.15.46:0/2541341521 conn(0x559c1ed2efd0 msgr2=0x559c1ed05b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/2541341521 shutdown_connections 2024-03-04T08:50:17.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/2541341521 wait complete. 2024-03-04T08:50:17.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.095+0000 7fa7f9c2f740 1 -- start start 2024-03-04T08:50:17.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.096+0000 7fa7f9c2f740 1 Processor -- start 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed28000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed0dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1edbb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed52d10 con 0x559c1ed54000 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed292e0 con 0x559c1ed0edf0 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c1ed53310 con 0x559c1ed10390 2024-03-04T08:50:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f9c2f740 10 client.0 _ll_register_callbacks cb 0x7fa7e80112c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:17.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed28000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed0dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.097+0000 7fa7f5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1edbb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.098+0000 7fa7ef400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed0dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58348/0 (socket says 172.21.15.46:58348) 2024-03-04T08:50:17.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.098+0000 7fa7ef400640 1 -- 172.21.15.46:0/1011813241 learned_addr learned my addr 172.21.15.46:0/1011813241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.101+0000 7fa7f5000640 1 -- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 msgr2=0x559c1ed0dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.101+0000 7fa7f5000640 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed0dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.101+0000 7fa7f5000640 1 -- 172.21.15.46:0/1011813241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 msgr2=0x559c1edbb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.101+0000 7fa7f5000640 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1edbb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.101+0000 7fa7f5000640 1 -- 172.21.15.46:0/1011813241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c1ed4e120 con 0x559c1ed0edf0 2024-03-04T08:50:17.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.104+0000 7fa7f5000640 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed28000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009ce0 tx=0x7fa7e8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa34f4fb4cadfd55 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.104+0000 7fa7d9600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-04T08:50:17.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.106+0000 7fa7d9600640 1 -- 172.21.15.46:0/1011813241 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8014440 con 0x559c1ed0edf0 2024-03-04T08:50:17.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.106+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7dc004040 con 0x559c1ed0edf0 2024-03-04T08:50:17.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.107+0000 7fa7d9600640 1 -- 172.21.15.46:0/1011813241 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa7e8033030 con 0x559c1ed0edf0 2024-03-04T08:50:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.109+0000 7fa7d9600640 1 -- 172.21.15.46:0/1011813241 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7e80145e0 con 0x559c1ed0edf0 2024-03-04T08:50:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.109+0000 7fa7f9c2f740 10 client.4597 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.109+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559c1ed32560 con 0x559c1ed0edf0 2024-03-04T08:50:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.111+0000 7fa7d9600640 1 -- 172.21.15.46:0/1011813241 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc004040 con 0x559c1ed0edf0 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7d9600640 1 -- 172.21.15.46:0/1011813241 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7fa7e8014780 con 0x559c1ed0edf0 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7f9c2f740 10 client.4597 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7f9c2f740 10 client.4597 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7f9c2f740 20 client.4597 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed5a210 0x559c1ed33f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7f9c2f740 4 client.4597 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.113+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 --> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559c1ed4f3b0 con 0x559c1ed5a210 2024-03-04T08:50:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.114+0000 7fa7ef400640 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed5a210 0x559c1ed33f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.117+0000 7fa7ef400640 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed5a210 0x559c1ed33f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e40276cc2b8476fc server_cookie=3108d97e33db0e04 in_seq=0 out_seq=0 2024-03-04T08:50:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.117+0000 7fa7d9600640 10 client.4597 ms_handle_connect on v2:172.21.15.73:6837/1890974908 2024-03-04T08:50:17.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.135+0000 7fa7d9600640 1 -- 172.21.15.46:0/1011813241 <== mds.2 v2:172.21.15.73:6837/1890974908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559c1ed4f3b0 con 0x559c1ed5a210 2024-03-04T08:50:17.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.135+0000 7fa7d9600640 10 client.4597 handle_command_reply: tid=0 2024-03-04T08:50:17.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.135+0000 7fa7f9c2f740 1 client.4597 shutdown 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 msgr2=0x559c1ed28000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed28000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009ce0 tx=0x7fa7e8014000 comp rx=0 tx=0).stop 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 shutdown_connections 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:6837/1890974908,v1:172.21.15.73:6839/1890974908] conn(0x559c1ed5a210 0x559c1ed33f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c1ed54000 0x559c1edbb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7d9600640 0 client.4597 ms_handle_reset on v2:172.21.15.73:6837/1890974908 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c1ed10390 0x559c1ed0dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 --2- 172.21.15.46:0/1011813241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c1ed0edf0 0x559c1ed28000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 >> 172.21.15.46:0/1011813241 conn(0x559c1ed2efd0 msgr2=0x559c1ed0f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.136+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 shutdown_connections 2024-03-04T08:50:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.137+0000 7fa7f9c2f740 1 -- 172.21.15.46:0/1011813241 wait complete. 2024-03-04T08:50:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.137+0000 7fa7f9c2f740 20 client.4597 trim_cache size 0 max 16384 2024-03-04T08:50:17.134 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T08:50:17.134 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "bc679561-c3d1-42a9-8f4c-6c87fdde4dff", 2024-03-04T08:50:17.134 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4262, 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 26.256381795999999, 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 23, 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 47.408640280999997 2024-03-04T08:50:17.135 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa7d006b490 msgr2=0x7fa7d006d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa7d006b490 0x7fa7d006d950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0055bd0 tx=0x7fa7e0001250 comp rx=0 tx=0).stop 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 msgr2=0x7fa7f01f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 0x7fa7f01f37b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c7f0 tx=0x7fa7e000ccb0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 shutdown_connections 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa7d006b490 0x7fa7d006d950 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7f015e320 0x7fa7f0151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f015add0 0x7fa7f01515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 --2- 172.21.15.46:0/3328953141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7f00cedc0 0x7fa7f01f37b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 >> 172.21.15.46:0/3328953141 conn(0x7fa7f0066c40 msgr2=0x7fa7f0158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 shutdown_connections 2024-03-04T08:50:17.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.138+0000 7fa7f5a00640 1 -- 172.21.15.46:0/3328953141 wait complete. 2024-03-04T08:50:17.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-04T08:50:17.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.340+0000 7f915ee00640 1 Processor -- start 2024-03-04T08:50:17.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.340+0000 7f915ee00640 1 -- start start 2024-03-04T08:50:17.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.342+0000 7f915ee00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9158154750 0x7f91580cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.342+0000 7f915ee00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9158154b30 0x7f91580ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.342+0000 7f915ee00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580ca6d0 con 0x7f91580ce650 2024-03-04T08:50:17.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.342+0000 7f915ee00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580ca990 con 0x7f9158154750 2024-03-04T08:50:17.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.342+0000 7f915ee00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580cac70 con 0x7f9158154b30 2024-03-04T08:50:17.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.343+0000 7f9157400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9158154b30 0x7f91580ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.343+0000 7f9157e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9158154750 0x7f91580cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.343+0000 7f9157400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9158154b30 0x7f91580ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37696/0 (socket says 172.21.15.46:37696) 2024-03-04T08:50:17.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.343+0000 7f9157400640 1 -- 172.21.15.46:0/780840006 learned_addr learned my addr 172.21.15.46:0/780840006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.347+0000 7f9157400640 1 -- 172.21.15.46:0/780840006 >> v2:172.21.15.46:3300/0 conn(0x7f9158154750 msgr2=0x7f91580cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.347+0000 7f9157400640 1 --2- 172.21.15.46:0/780840006 >> v2:172.21.15.46:3300/0 conn(0x7f9158154750 0x7f91580cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.347+0000 7f9157400640 1 -- 172.21.15.46:0/780840006 >> v1:172.21.15.46:6789/0 conn(0x7f91580ce650 legacy=0x7f91580cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.347+0000 7f9157400640 1 -- 172.21.15.46:0/780840006 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915815a900 con 0x7f9158154b30 2024-03-04T08:50:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.350+0000 7f9157400640 1 --2- 172.21.15.46:0/780840006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9158154b30 0x7f91580ce110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f915808d890 tx=0x7f914402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a917a25ef8ee4719 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.354+0000 7f9156a00640 1 -- 172.21.15.46:0/780840006 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914402f850 con 0x7f9158154b30 2024-03-04T08:50:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.354+0000 7f9156a00640 1 -- 172.21.15.46:0/780840006 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914402f9f0 con 0x7f9158154b30 2024-03-04T08:50:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.354+0000 7f9156a00640 1 -- 172.21.15.46:0/780840006 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914402fdc0 con 0x7f9158154b30 2024-03-04T08:50:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 -- 172.21.15.46:0/780840006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9158154b30 msgr2=0x7f91580ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 --2- 172.21.15.46:0/780840006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9158154b30 0x7f91580ce110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f915808d890 tx=0x7f914402ba30 comp rx=0 tx=0).stop 2024-03-04T08:50:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 -- 172.21.15.46:0/780840006 shutdown_connections 2024-03-04T08:50:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 --2- 172.21.15.46:0/780840006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9158154b30 0x7f91580ce110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 --2- 172.21.15.46:0/780840006 >> v2:172.21.15.46:3300/0 conn(0x7f9158154750 0x7f91580cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 -- 172.21.15.46:0/780840006 >> 172.21.15.46:0/780840006 conn(0x7f9158066c40 msgr2=0x7f9158067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 -- 172.21.15.46:0/780840006 shutdown_connections 2024-03-04T08:50:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.355+0000 7f915ee00640 1 -- 172.21.15.46:0/780840006 wait complete. 2024-03-04T08:50:17.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.357+0000 7f915ee00640 1 Processor -- start 2024-03-04T08:50:17.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.357+0000 7f915ee00640 1 -- start start 2024-03-04T08:50:17.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f915ee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91580ce650 0x7f91580c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f915ee00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9158154750 0x7f91581562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f915ee00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9158156830 0x7f91580c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f915ee00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915815a5b0 con 0x7f9158156830 2024-03-04T08:50:17.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f915ee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915815aec0 con 0x7f91580ce650 2024-03-04T08:50:17.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f915ee00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915815b3e0 con 0x7f9158154750 2024-03-04T08:50:17.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.358+0000 7f9157e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91580ce650 0x7f91580c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.359+0000 7f915ce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9158156830 0x7f91580c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.359+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9158154750 0x7f91581562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.359+0000 7f9157e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91580ce650 0x7f91580c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37710/0 (socket says 172.21.15.46:37710) 2024-03-04T08:50:17.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.359+0000 7f9157e00640 1 -- 172.21.15.46:0/3255485959 learned_addr learned my addr 172.21.15.46:0/3255485959 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.362+0000 7f915ce00640 1 -- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9158154750 msgr2=0x7f91581562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.362+0000 7f915ce00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9158154750 0x7f91581562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.362+0000 7f915ce00640 1 -- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91580ce650 msgr2=0x7f91580c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.362+0000 7f915ce00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91580ce650 0x7f91580c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.362+0000 7f915ce00640 1 -- 172.21.15.46:0/3255485959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91581508c0 con 0x7f9158156830 2024-03-04T08:50:17.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.365+0000 7f915ce00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9158156830 0x7f91580c8ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f915000c690 tx=0x7f915000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.370+0000 7f914fe00640 1 -- 172.21.15.46:0/3255485959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150003b70 con 0x7f9158156830 2024-03-04T08:50:17.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.370+0000 7f914fe00640 1 -- 172.21.15.46:0/3255485959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150003d10 con 0x7f9158156830 2024-03-04T08:50:17.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.370+0000 7f914fe00640 1 -- 172.21.15.46:0/3255485959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150005310 con 0x7f9158156830 2024-03-04T08:50:17.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.370+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91580c82f0 con 0x7f9158156830 2024-03-04T08:50:17.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.370+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91581576b0 con 0x7f9158156830 2024-03-04T08:50:17.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.374+0000 7f9161bea740 1 Processor -- start 2024-03-04T08:50:17.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.374+0000 7f9161bea740 1 -- start start 2024-03-04T08:50:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.375+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.375+0000 7f9161bea740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87684030 0x55ff8763aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.375+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87638c10 0x55ff87679a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.375+0000 7f9161bea740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8759e600 con 0x55ff87684030 2024-03-04T08:50:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.375+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff87547930 con 0x55ff87638c10 2024-03-04T08:50:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.375+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff8759a6a0 con 0x55ff8763a1b0 2024-03-04T08:50:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.376+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.376+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87638c10 0x55ff87679a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.376+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58370/0 (socket says 172.21.15.46:58370) 2024-03-04T08:50:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.376+0000 7f9157400640 1 -- 172.21.15.46:0/2067501573 learned_addr learned my addr 172.21.15.46:0/2067501573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.379+0000 7f9157400640 1 -- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 msgr2=0x55ff8763a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.379+0000 7f9157400640 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.379+0000 7f9157400640 1 -- 172.21.15.46:0/2067501573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87684030 msgr2=0x55ff8763aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.379+0000 7f9157400640 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87684030 0x55ff8763aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.379+0000 7f9157400640 1 -- 172.21.15.46:0/2067501573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff872b32d0 con 0x55ff87638c10 2024-03-04T08:50:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.382+0000 7f9157400640 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87638c10 0x55ff87679a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91440090b0 tx=0x7f9144008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26497dc4acd238a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.387+0000 7f914cc00640 1 -- 172.21.15.46:0/2067501573 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914404c070 con 0x55ff87638c10 2024-03-04T08:50:17.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.387+0000 7f914cc00640 1 -- 172.21.15.46:0/2067501573 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9144004030 con 0x55ff87638c10 2024-03-04T08:50:17.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.387+0000 7f914cc00640 1 -- 172.21.15.46:0/2067501573 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144004400 con 0x55ff87638c10 2024-03-04T08:50:17.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.387+0000 7f9161bea740 1 -- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87638c10 msgr2=0x55ff87679a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.387+0000 7f9161bea740 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87638c10 0x55ff87679a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91440090b0 tx=0x7f9144008030 comp rx=0 tx=0).stop 2024-03-04T08:50:17.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 -- 172.21.15.46:0/2067501573 shutdown_connections 2024-03-04T08:50:17.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87638c10 0x55ff87679a10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87684030 0x55ff8763aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 --2- 172.21.15.46:0/2067501573 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 -- 172.21.15.46:0/2067501573 >> 172.21.15.46:0/2067501573 conn(0x55ff87636920 msgr2=0x55ff87639260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 -- 172.21.15.46:0/2067501573 shutdown_connections 2024-03-04T08:50:17.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.388+0000 7f9161bea740 1 -- 172.21.15.46:0/2067501573 wait complete. 2024-03-04T08:50:17.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.389+0000 7f9161bea740 1 -- start start 2024-03-04T08:50:17.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.389+0000 7f9161bea740 1 Processor -- start 2024-03-04T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 0x55ff8767ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87676df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff8765e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8765f710 con 0x55ff87660450 2024-03-04T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8755ad90 con 0x55ff8763a1b0 2024-03-04T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff87637ad0 con 0x55ff87684030 2024-03-04T08:50:17.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9161bea740 10 client.0 _ll_register_callbacks cb 0x55ff87596350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:17.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.390+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 0x55ff8767ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.391+0000 7f9157e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87676df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.391+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 0x55ff8767ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37726/0 (socket says 172.21.15.46:37726) 2024-03-04T08:50:17.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.391+0000 7f9157400640 1 -- 172.21.15.46:0/3493802354 learned_addr learned my addr 172.21.15.46:0/3493802354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.395+0000 7f9157400640 1 -- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 msgr2=0x55ff87676df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.395+0000 7f9157400640 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87676df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.395+0000 7f9157400640 1 -- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 msgr2=0x55ff8765e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.395+0000 7f9157400640 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff8765e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.395+0000 7f9157400640 1 -- 172.21.15.46:0/3493802354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff8737d6b0 con 0x55ff8763a1b0 2024-03-04T08:50:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.398+0000 7f9157400640 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 0x55ff8767ff20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9144009930 tx=0x7f91440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef46f4b179bd5762 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.398+0000 7f9141600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-04T08:50:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.402+0000 7f9141600640 1 -- 172.21.15.46:0/3493802354 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914404c030 con 0x55ff8763a1b0 2024-03-04T08:50:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.402+0000 7f9141600640 1 -- 172.21.15.46:0/3493802354 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9144003a20 con 0x55ff8763a1b0 2024-03-04T08:50:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.402+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9144004030 con 0x55ff8763a1b0 2024-03-04T08:50:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.404+0000 7f9141600640 1 -- 172.21.15.46:0/3493802354 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f914405a050 con 0x55ff8763a1b0 2024-03-04T08:50:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.404+0000 7f9161bea740 10 client.4609 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.404+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ff87677330 con 0x55ff8763a1b0 2024-03-04T08:50:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.404+0000 7f914fe00640 1 -- 172.21.15.46:0/3255485959 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f91500054b0 con 0x7f9158156830 2024-03-04T08:50:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.405+0000 7f914fe00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f913806b490 0x7f913806d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.405+0000 7f9157e00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f913806b490 0x7f913806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.406+0000 7f9157e00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f913806b490 0x7f913806d950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55ff87684430 tx=0x7f91480046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.408+0000 7f914fe00640 1 -- 172.21.15.46:0/3255485959 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f91500057a0 con 0x7f9158156830 2024-03-04T08:50:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9141600640 1 -- 172.21.15.46:0/3493802354 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9144004030 con 0x55ff8763a1b0 2024-03-04T08:50:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9141600640 1 -- 172.21.15.46:0/3493802354 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7f914405d020 con 0x55ff8763a1b0 2024-03-04T08:50:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9161bea740 10 client.4609 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9161bea740 10 client.4609 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-04T08:50:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9161bea740 20 client.4609 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9161bea740 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff8768ba70 0x55ff8769a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9161bea740 4 client.4609 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:50:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.409+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 --> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff875abb40 con 0x55ff8768ba70 2024-03-04T08:50:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.410+0000 7f9157400640 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff8768ba70 0x55ff8769a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.465+0000 7f9141600640 10 client.4609 ms_handle_connect on v2:172.21.15.46:6832/1752138796 2024-03-04T08:50:17.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.465+0000 7f9157400640 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff8768ba70 0x55ff8769a4a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c70b3a9e485528f server_cookie=884b4e9bef00e471 in_seq=0 out_seq=0 2024-03-04T08:50:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.654+0000 7f9141600640 1 -- 172.21.15.46:0/3493802354 <== mds.1 v2:172.21.15.46:6832/1752138796 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ff875abb40 con 0x55ff8768ba70 2024-03-04T08:50:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.654+0000 7f9141600640 10 client.4609 handle_command_reply: tid=0 2024-03-04T08:50:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.654+0000 7f9161bea740 1 client.4609 shutdown 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 msgr2=0x55ff8767ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 0x55ff8767ff20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9144009930 tx=0x7f91440046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 shutdown_connections 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff8768ba70 0x55ff8769a4a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff8765e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87676df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 --2- 172.21.15.46:0/3493802354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff8763a1b0 0x55ff8767ff20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9141600640 0 client.4609 ms_handle_reset on v2:172.21.15.46:6832/1752138796 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 >> 172.21.15.46:0/3493802354 conn(0x55ff87638c10 msgr2=0x55ff8767a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 shutdown_connections 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.655+0000 7f9161bea740 1 -- 172.21.15.46:0/3493802354 wait complete. 2024-03-04T08:50:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.656+0000 7f9161bea740 20 client.4609 trim_cache size 0 max 16384 2024-03-04T08:50:17.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.684+0000 7f9161bea740 1 Processor -- start 2024-03-04T08:50:17.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.684+0000 7f9161bea740 1 -- start start 2024-03-04T08:50:17.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.685+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.685+0000 7f9161bea740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff87674360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.685+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 0x55ff876748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.685+0000 7f9161bea740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581f0020 con 0x55ff87660450 2024-03-04T08:50:17.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.685+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff87676030 con 0x55ff87684030 2024-03-04T08:50:17.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.685+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff87676360 con 0x55ff8763a1b0 2024-03-04T08:50:17.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.686+0000 7f9157e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.686+0000 7f915ce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 0x55ff876748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.686+0000 7f915ce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 0x55ff876748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37736/0 (socket says 172.21.15.46:37736) 2024-03-04T08:50:17.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.686+0000 7f915ce00640 1 -- 172.21.15.46:0/194773084 learned_addr learned my addr 172.21.15.46:0/194773084 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.689+0000 7f9157400640 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff87674360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.689+0000 7f915ce00640 1 -- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 msgr2=0x55ff8763bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.689+0000 7f915ce00640 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.689+0000 7f915ce00640 1 -- 172.21.15.46:0/194773084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 msgr2=0x55ff87674360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.689+0000 7f915ce00640 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff87674360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.690+0000 7f915ce00640 1 -- 172.21.15.46:0/194773084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff876765f0 con 0x55ff87684030 2024-03-04T08:50:17.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.694+0000 7f915ce00640 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 0x55ff876748a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f91500607e0 tx=0x7f915005c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d89c7312acbd63 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.699+0000 7f9143e00640 1 -- 172.21.15.46:0/194773084 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150086070 con 0x55ff87684030 2024-03-04T08:50:17.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.699+0000 7f9143e00640 1 -- 172.21.15.46:0/194773084 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150057b00 con 0x55ff87684030 2024-03-04T08:50:17.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.699+0000 7f9143e00640 1 -- 172.21.15.46:0/194773084 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150070030 con 0x55ff87684030 2024-03-04T08:50:17.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 -- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 msgr2=0x55ff876748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 0x55ff876748a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f91500607e0 tx=0x7f915005c890 comp rx=0 tx=0).stop 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 -- 172.21.15.46:0/194773084 shutdown_connections 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87684030 0x55ff876748a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff87660450 0x55ff87674360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 --2- 172.21.15.46:0/194773084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff8763a1b0 0x55ff8763bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 -- 172.21.15.46:0/194773084 >> 172.21.15.46:0/194773084 conn(0x55ff87638c10 msgr2=0x55ff8762fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 -- 172.21.15.46:0/194773084 shutdown_connections 2024-03-04T08:50:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.700+0000 7f9161bea740 1 -- 172.21.15.46:0/194773084 wait complete. 2024-03-04T08:50:17.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.701+0000 7f9161bea740 1 -- start start 2024-03-04T08:50:17.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.702+0000 7f9161bea740 1 Processor -- start 2024-03-04T08:50:17.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff8763a1b0 0x55ff8769e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87660450 0x55ff876780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87688d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8768b8f0 con 0x55ff8763a1b0 2024-03-04T08:50:17.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8768f730 con 0x55ff87660450 2024-03-04T08:50:17.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff8768bef0 con 0x55ff87684030 2024-03-04T08:50:17.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.703+0000 7f9161bea740 10 client.0 _ll_register_callbacks cb 0x7f914404a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:17.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.704+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87660450 0x55ff876780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.704+0000 7f915ce00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87688d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.704+0000 7f9157e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff8763a1b0 0x55ff8769e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.704+0000 7f9157400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87660450 0x55ff876780f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37740/0 (socket says 172.21.15.46:37740) 2024-03-04T08:50:17.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.704+0000 7f9157400640 1 -- 172.21.15.46:0/2341385049 learned_addr learned my addr 172.21.15.46:0/2341385049 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.708+0000 7f9157e00640 1 -- 172.21.15.46:0/2341385049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 msgr2=0x55ff87688d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.708+0000 7f9157e00640 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87688d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.708+0000 7f9157e00640 1 -- 172.21.15.46:0/2341385049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87660450 msgr2=0x55ff876780f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.708+0000 7f9157e00640 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87660450 0x55ff876780f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.708+0000 7f9157e00640 1 -- 172.21.15.46:0/2341385049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff87678820 con 0x55ff8763a1b0 2024-03-04T08:50:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.711+0000 7f9157e00640 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff8763a1b0 0x55ff8769e4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9148014c60 tx=0x7f9148004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df54213b9b56c4ea server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.711+0000 7f9141600640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-03-04T08:50:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.715+0000 7f9141600640 1 -- 172.21.15.46:0/2341385049 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914801b070 con 0x55ff8763a1b0 2024-03-04T08:50:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.715+0000 7f9141600640 1 -- 172.21.15.46:0/2341385049 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f914802db10 con 0x55ff8763a1b0 2024-03-04T08:50:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.715+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9150057b00 con 0x55ff8763a1b0 2024-03-04T08:50:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.717+0000 7f9141600640 1 -- 172.21.15.46:0/2341385049 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f914802dd10 con 0x55ff8763a1b0 2024-03-04T08:50:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.717+0000 7f9161bea740 10 client.4509 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.717+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ff876588b0 con 0x55ff8763a1b0 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9141600640 1 -- 172.21.15.46:0/2341385049 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150057b00 con 0x55ff8763a1b0 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9141600640 1 -- 172.21.15.46:0/2341385049 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7f9148034050 con 0x55ff8763a1b0 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9161bea740 10 client.4509 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9161bea740 10 client.4509 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9161bea740 20 client.4509 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9161bea740 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff876eea20 0x55ff876eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9161bea740 4 client.4509 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.722+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 --> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ff876791d0 con 0x55ff876eea20 2024-03-04T08:50:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.723+0000 7f9157400640 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff876eea20 0x55ff876eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.727+0000 7f9157400640 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff876eea20 0x55ff876eee00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5270f5f5a2d660 server_cookie=8ba95dde0a0016f9 in_seq=0 out_seq=0 2024-03-04T08:50:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.727+0000 7f9141600640 10 client.4509 ms_handle_connect on v2:172.21.15.46:6832/1752138796 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.758+0000 7f9141600640 1 -- 172.21.15.46:0/2341385049 <== mds.1 v2:172.21.15.46:6832/1752138796 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ff876791d0 con 0x55ff876eea20 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.758+0000 7f9141600640 10 client.4509 handle_command_reply: tid=0 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.758+0000 7f9161bea740 1 client.4509 shutdown 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.758+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff8763a1b0 msgr2=0x55ff8769e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.758+0000 7f9161bea740 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff8763a1b0 0x55ff8769e4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9148014c60 tx=0x7f9148004730 comp rx=0 tx=0).stop 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 shutdown_connections 2024-03-04T08:50:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:6832/1752138796,v1:172.21.15.46:6833/1752138796] conn(0x55ff876eea20 0x55ff876eee00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ff87660450 0x55ff876780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55ff87684030 0x55ff87688d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 --2- 172.21.15.46:0/2341385049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff8763a1b0 0x55ff8769e4c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 >> 172.21.15.46:0/2341385049 conn(0x55ff87638c10 msgr2=0x55ff87633620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9141600640 0 client.4509 ms_handle_reset on v2:172.21.15.46:6832/1752138796 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 shutdown_connections 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 1 -- 172.21.15.46:0/2341385049 wait complete. 2024-03-04T08:50:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.759+0000 7f9161bea740 20 client.4509 trim_cache size 0 max 16384 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "bc679561-c3d1-42a9-8f4c-6c87fdde4dff", 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4267, 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 29.772699963000001, 2024-03-04T08:50:17.757 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-03-04T08:50:17.758 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-03-04T08:50:17.758 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 23, 2024-03-04T08:50:17.758 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 47.363092936999998 2024-03-04T08:50:17.758 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T08:50:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f913806b490 msgr2=0x7f913806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f913806b490 0x7f913806d950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55ff87684430 tx=0x7f91480046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9158156830 msgr2=0x7f91580c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9158156830 0x7f91580c8ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f915000c690 tx=0x7f915000cb50 comp rx=0 tx=0).stop 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 shutdown_connections 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f913806b490 0x7f913806d950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9158156830 0x7f91580c8ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9158154750 0x7f91581562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 --2- 172.21.15.46:0/3255485959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91580ce650 0x7f91580c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 >> 172.21.15.46:0/3255485959 conn(0x7f9158066c40 msgr2=0x7f91580cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 shutdown_connections 2024-03-04T08:50:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.761+0000 7f915ee00640 1 -- 172.21.15.46:0/3255485959 wait complete. 2024-03-04T08:50:17.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-04T08:50:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.980+0000 7ffa85e00640 1 Processor -- start 2024-03-04T08:50:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.981+0000 7ffa85e00640 1 -- start start 2024-03-04T08:50:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.982+0000 7ffa85e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa80151f70 0x7ffa80158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.982+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa8015b700 0x7ffa8006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:17.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.982+0000 7ffa85e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa800c10b0 con 0x7ffa80152350 2024-03-04T08:50:17.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.982+0000 7ffa85e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800c0e80 con 0x7ffa80151f70 2024-03-04T08:50:17.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.982+0000 7ffa85e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c1370 con 0x7ffa8015b700 2024-03-04T08:50:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.983+0000 7ffa7ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa80151f70 0x7ffa80158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.983+0000 7ffa7f400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ffa80152350 0x7ffa800c5230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50760/0 (socket says 172.21.15.46:50760) 2024-03-04T08:50:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.983+0000 7ffa7f400640 1 -- 172.21.15.46:0/406994657 learned_addr learned my addr 172.21.15.46:0/406994657 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T08:50:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.984+0000 7ffa7e000640 1 --2- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa8015b700 0x7ffa8006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.987+0000 7ffa7ea00640 1 -- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa8015b700 msgr2=0x7ffa8006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.987+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa8015b700 0x7ffa8006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.987+0000 7ffa7ea00640 1 -- 172.21.15.46:0/406994657 >> v1:172.21.15.73:6789/0 conn(0x7ffa80152350 legacy=0x7ffa800c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.987+0000 7ffa7ea00640 1 -- 172.21.15.46:0/406994657 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800c1650 con 0x7ffa80151f70 2024-03-04T08:50:17.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.991+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa80158b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097a0 tx=0x7ffa7002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24abd1ca0605ab4e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:17.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.995+0000 7ffa7d600640 1 -- 172.21.15.46:0/406994657 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70034070 con 0x7ffa80151f70 2024-03-04T08:50:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.998+0000 7ffa7d600640 1 -- 172.21.15.46:0/406994657 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70030800 con 0x7ffa80151f70 2024-03-04T08:50:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.998+0000 7ffa7d600640 1 -- 172.21.15.46:0/406994657 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70030bd0 con 0x7ffa80151f70 2024-03-04T08:50:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 -- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 msgr2=0x7ffa80158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 --2- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa80158b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097a0 tx=0x7ffa7002b940 comp rx=0 tx=0).stop 2024-03-04T08:50:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 -- 172.21.15.46:0/406994657 shutdown_connections 2024-03-04T08:50:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 --2- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa8015b700 0x7ffa8006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 --2- 172.21.15.46:0/406994657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa80158b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:17.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 -- 172.21.15.46:0/406994657 >> 172.21.15.46:0/406994657 conn(0x7ffa8006aff0 msgr2=0x7ffa8006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:17.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 -- 172.21.15.46:0/406994657 shutdown_connections 2024-03-04T08:50:17.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:17.999+0000 7ffa85e00640 1 -- 172.21.15.46:0/406994657 wait complete. 2024-03-04T08:50:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.002+0000 7ffa85e00640 1 Processor -- start 2024-03-04T08:50:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.002+0000 7ffa85e00640 1 -- start start 2024-03-04T08:50:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.003+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa801f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.003+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa80152350 0x7ffa801508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.003+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa8015b700 0x7ffa800ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.003+0000 7ffa85e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80158600 con 0x7ffa8015b700 2024-03-04T08:50:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.003+0000 7ffa85e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80158320 con 0x7ffa80151f70 2024-03-04T08:50:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.003+0000 7ffa85e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80159060 con 0x7ffa80152350 2024-03-04T08:50:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.004+0000 7ffa7ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa801f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.004+0000 7ffa7e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa80152350 0x7ffa801508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.004+0000 7ffa7ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa801f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37758/0 (socket says 172.21.15.46:37758) 2024-03-04T08:50:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.004+0000 7ffa7ea00640 1 -- 172.21.15.46:0/2911273848 learned_addr learned my addr 172.21.15.46:0/2911273848 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.009+0000 7ffa7ea00640 1 -- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa80152350 msgr2=0x7ffa801508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.009+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa80152350 0x7ffa801508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.009+0000 7ffa7ea00640 1 -- 172.21.15.46:0/2911273848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa8015b700 msgr2=0x7ffa800ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.009+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa8015b700 0x7ffa800ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.009+0000 7ffa7ea00640 1 -- 172.21.15.46:0/2911273848 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa801f3c10 con 0x7ffa80151f70 2024-03-04T08:50:18.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.013+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa801f43d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009890 tx=0x7ffa700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.018+0000 7ffa77400640 1 -- 172.21.15.46:0/2911273848 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70034040 con 0x7ffa80151f70 2024-03-04T08:50:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.018+0000 7ffa77400640 1 -- 172.21.15.46:0/2911273848 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7003add0 con 0x7ffa80151f70 2024-03-04T08:50:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.018+0000 7ffa77400640 1 -- 172.21.15.46:0/2911273848 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70006e10 con 0x7ffa80151f70 2024-03-04T08:50:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.018+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa800cb700 con 0x7ffa80151f70 2024-03-04T08:50:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.018+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800cbcc0 con 0x7ffa80151f70 2024-03-04T08:50:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.023+0000 7ffa88b76740 1 Processor -- start 2024-03-04T08:50:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.023+0000 7ffa88b76740 1 -- start start 2024-03-04T08:50:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f2b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f2bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f29c10 0x564a26f6aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa88b76740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26e8f600 con 0x564a26f29c10 2024-03-04T08:50:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26e38930 con 0x564a26f75030 2024-03-04T08:50:18.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a26e8b6a0 con 0x564a26f2b1b0 2024-03-04T08:50:18.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.025+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f2b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.026+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f2b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58426/0 (socket says 172.21.15.46:58426) 2024-03-04T08:50:18.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.026+0000 7ffa7f400640 1 -- 172.21.15.46:0/3829928715 learned_addr learned my addr 172.21.15.46:0/3829928715 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.028+0000 7ffa7f400640 1 -- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 msgr2=0x564a26f2bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.028+0000 7ffa7f400640 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f2bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.028+0000 7ffa7f400640 1 -- 172.21.15.46:0/3829928715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f29c10 msgr2=0x564a26f6aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.028+0000 7ffa7f400640 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f29c10 0x564a26f6aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.028+0000 7ffa7f400640 1 -- 172.21.15.46:0/3829928715 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a26ba42d0 con 0x564a26f2b1b0 2024-03-04T08:50:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.030+0000 7ffa7f400640 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f2b590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa78002090 tx=0x7ffa7800c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e358d0542d789f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.034+0000 7ffa6b400640 1 -- 172.21.15.46:0/3829928715 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78017070 con 0x564a26f2b1b0 2024-03-04T08:50:18.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.034+0000 7ffa6b400640 1 -- 172.21.15.46:0/3829928715 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa780072d0 con 0x564a26f2b1b0 2024-03-04T08:50:18.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.034+0000 7ffa6b400640 1 -- 172.21.15.46:0/3829928715 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780076c0 con 0x564a26f2b1b0 2024-03-04T08:50:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 -- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 msgr2=0x564a26f2b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f2b590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa78002090 tx=0x7ffa7800c4b0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 -- 172.21.15.46:0/3829928715 shutdown_connections 2024-03-04T08:50:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f2bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f29c10 0x564a26f6aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 --2- 172.21.15.46:0/3829928715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f2b590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 -- 172.21.15.46:0/3829928715 >> 172.21.15.46:0/3829928715 conn(0x564a26f27920 msgr2=0x564a26f2a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 -- 172.21.15.46:0/3829928715 shutdown_connections 2024-03-04T08:50:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.035+0000 7ffa88b76740 1 -- 172.21.15.46:0/3829928715 wait complete. 2024-03-04T08:50:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.036+0000 7ffa88b76740 1 -- start start 2024-03-04T08:50:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.036+0000 7ffa88b76740 1 Processor -- start 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f7dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f51030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f67380 0x564a26f53dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26f50710 con 0x564a26f67380 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26e4bd90 con 0x564a26f75030 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a26f28ad0 con 0x564a26f2b1b0 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.038+0000 7ffa88b76740 10 client.0 _ll_register_callbacks cb 0x564a26e87350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:18.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.039+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f7dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.039+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f7dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58434/0 (socket says 172.21.15.46:58434) 2024-03-04T08:50:18.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.039+0000 7ffa7f400640 1 -- 172.21.15.46:0/842559493 learned_addr learned my addr 172.21.15.46:0/842559493 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.042+0000 7ffa7f400640 1 -- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 msgr2=0x564a26f51030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.042+0000 7ffa7f400640 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f51030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.042+0000 7ffa7f400640 1 -- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f67380 msgr2=0x564a26f53dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.042+0000 7ffa7f400640 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f67380 0x564a26f53dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.042+0000 7ffa7f400640 1 -- 172.21.15.46:0/842559493 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a26c6e6b0 con 0x564a26f2b1b0 2024-03-04T08:50:18.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.048+0000 7ffa7f400640 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f7dec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa78002090 tx=0x7ffa780014a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd2a70be061fac server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.048+0000 7ffa5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-03-04T08:50:18.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.049+0000 7ffa77400640 1 -- 172.21.15.46:0/2911273848 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa70037070 con 0x7ffa80151f70 2024-03-04T08:50:18.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.051+0000 7ffa77400640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa6006b490 0x7ffa6006d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.052+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa6006b490 0x7ffa6006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.052+0000 7ffa7ea00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa6006b490 0x7ffa6006d950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa7002bed0 tx=0x7ffa70009740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.056+0000 7ffa77400640 1 -- 172.21.15.46:0/2911273848 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffa700aa570 con 0x7ffa80151f70 2024-03-04T08:50:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.095+0000 7ffa5fe00640 1 -- 172.21.15.46:0/842559493 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78017070 con 0x564a26f2b1b0 2024-03-04T08:50:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.095+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa780072d0 con 0x564a26f2b1b0 2024-03-04T08:50:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.096+0000 7ffa5fe00640 1 -- 172.21.15.46:0/842559493 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffa78028440 con 0x564a26f2b1b0 2024-03-04T08:50:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.099+0000 7ffa5fe00640 1 -- 172.21.15.46:0/842559493 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa78028640 con 0x564a26f2b1b0 2024-03-04T08:50:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.099+0000 7ffa88b76740 10 client.4565 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:18.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.099+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564a26f68c50 con 0x564a26f2b1b0 2024-03-04T08:50:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.103+0000 7ffa5fe00640 1 -- 172.21.15.46:0/842559493 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa780072d0 con 0x564a26f2b1b0 2024-03-04T08:50:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa5fe00640 1 -- 172.21.15.46:0/842559493 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7ffa780287e0 con 0x564a26f2b1b0 2024-03-04T08:50:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa88b76740 10 client.4565 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa88b76740 10 client.4565 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-04T08:50:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa88b76740 20 client.4565 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa88b76740 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26f7fa10 0x564a26f8b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa88b76740 4 client.4565 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:50:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.104+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 --> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a26e9cb40 con 0x564a26f7fa10 2024-03-04T08:50:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.106+0000 7ffa7e000640 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26f7fa10 0x564a26f8b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.182+0000 7ffa7e000640 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26f7fa10 0x564a26f8b090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcb7527adc365c5 server_cookie=a8cfb6661663a5d5 in_seq=0 out_seq=0 2024-03-04T08:50:18.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.182+0000 7ffa5fe00640 10 client.4565 ms_handle_connect on v2:172.21.15.46:6835/3649809556 2024-03-04T08:50:18.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.395+0000 7ffa5fe00640 1 -- 172.21.15.46:0/842559493 <== mds.0 v2:172.21.15.46:6835/3649809556 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564a26e9cb40 con 0x564a26f7fa10 2024-03-04T08:50:18.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.395+0000 7ffa5fe00640 10 client.4565 handle_command_reply: tid=0 2024-03-04T08:50:18.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.395+0000 7ffa88b76740 1 client.4565 shutdown 2024-03-04T08:50:18.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.395+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 msgr2=0x564a26f7dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.395+0000 7ffa88b76740 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f7dec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa78002090 tx=0x7ffa780014a0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 shutdown_connections 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26f7fa10 0x564a26f8b090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f51030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f67380 0x564a26f53dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa5fe00640 0 client.4565 ms_handle_reset on v2:172.21.15.46:6835/3649809556 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 --2- 172.21.15.46:0/842559493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26f7dec0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 >> 172.21.15.46:0/842559493 conn(0x564a26f29c10 msgr2=0x564a26f2c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 shutdown_connections 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 1 -- 172.21.15.46:0/842559493 wait complete. 2024-03-04T08:50:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.396+0000 7ffa88b76740 20 client.4565 trim_cache size 0 max 16384 2024-03-04T08:50:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.454+0000 7ffa88b76740 1 Processor -- start 2024-03-04T08:50:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.455+0000 7ffa88b76740 1 -- start start 2024-03-04T08:50:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.456+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f2b1b0 0x564a26f2a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.456+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f67380 0x564a26f2a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.456+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f73500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.456+0000 7ffa88b76740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c3a50 con 0x564a26f2b1b0 2024-03-04T08:50:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.456+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26f7d9a0 con 0x564a26f75030 2024-03-04T08:50:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.456+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a26f51570 con 0x564a26f67380 2024-03-04T08:50:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.457+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f2b1b0 0x564a26f2a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.457+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f73500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.457+0000 7ffa7e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f67380 0x564a26f2a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.457+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f2b1b0 0x564a26f2a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33036/0 (socket says 172.21.15.46:33036) 2024-03-04T08:50:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.457+0000 7ffa7f400640 1 -- 172.21.15.46:0/1284784352 learned_addr learned my addr 172.21.15.46:0/1284784352 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.459+0000 7ffa7e000640 1 -- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 msgr2=0x564a26f73500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.459+0000 7ffa7e000640 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f73500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.459+0000 7ffa7e000640 1 -- 172.21.15.46:0/1284784352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f2b1b0 msgr2=0x564a26f2a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.459+0000 7ffa7e000640 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f2b1b0 0x564a26f2a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.459+0000 7ffa7e000640 1 -- 172.21.15.46:0/1284784352 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a26f242c0 con 0x564a26f67380 2024-03-04T08:50:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.461+0000 7ffa7e000640 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f67380 0x564a26f2a660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x564a26f50030 tx=0x7ffa6c006a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b1cf167e5e6bfff server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.464+0000 7ffa6aa00640 1 -- 172.21.15.46:0/1284784352 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c009e30 con 0x564a26f67380 2024-03-04T08:50:18.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.466+0000 7ffa6aa00640 1 -- 172.21.15.46:0/1284784352 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c004030 con 0x564a26f67380 2024-03-04T08:50:18.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.466+0000 7ffa6aa00640 1 -- 172.21.15.46:0/1284784352 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0043e0 con 0x564a26f67380 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 -- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f67380 msgr2=0x564a26f2a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f67380 0x564a26f2a660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x564a26f50030 tx=0x7ffa6c006a20 comp rx=0 tx=0).stop 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 -- 172.21.15.46:0/1284784352 shutdown_connections 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f75030 0x564a26f73500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f67380 0x564a26f2a660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 --2- 172.21.15.46:0/1284784352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f2b1b0 0x564a26f2a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 -- 172.21.15.46:0/1284784352 >> 172.21.15.46:0/1284784352 conn(0x564a26f29c10 msgr2=0x564a26f2b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.467+0000 7ffa88b76740 1 -- 172.21.15.46:0/1284784352 shutdown_connections 2024-03-04T08:50:18.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.468+0000 7ffa88b76740 1 -- 172.21.15.46:0/1284784352 wait complete. 2024-03-04T08:50:18.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.469+0000 7ffa88b76740 1 -- start start 2024-03-04T08:50:18.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.469+0000 7ffa88b76740 1 Processor -- start 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26fdfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 0x564a26f82980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f75030 0x564a26f84050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26f7f890 con 0x564a26f75030 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a26f70ea0 con 0x564a26f67380 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a26f7fe90 con 0x564a26f2b1b0 2024-03-04T08:50:18.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.470+0000 7ffa88b76740 10 client.0 _ll_register_callbacks cb 0x7ffa78015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:18.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.471+0000 7ffa7e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 0x564a26f82980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.471+0000 7ffa7f400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26fdfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.472+0000 7ffa7e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 0x564a26f82980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37786/0 (socket says 172.21.15.46:37786) 2024-03-04T08:50:18.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.472+0000 7ffa7e000640 1 -- 172.21.15.46:0/2050545658 learned_addr learned my addr 172.21.15.46:0/2050545658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.472+0000 7ffa7f400640 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f75030 0x564a26f84050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.475+0000 7ffa7e000640 1 -- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 msgr2=0x564a26fdfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.475+0000 7ffa7e000640 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26fdfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.475+0000 7ffa7e000640 1 -- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f75030 msgr2=0x564a26f84050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.475+0000 7ffa7e000640 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f75030 0x564a26f84050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.475+0000 7ffa7e000640 1 -- 172.21.15.46:0/2050545658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a26f82ec0 con 0x564a26f67380 2024-03-04T08:50:18.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.478+0000 7ffa7e000640 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 0x564a26f82980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8015b480 tx=0x7ffa6c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5978335a5f3a922 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.478+0000 7ffa5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-04T08:50:18.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.482+0000 7ffa5fe00640 1 -- 172.21.15.46:0/2050545658 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c016950 con 0x564a26f67380 2024-03-04T08:50:18.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.482+0000 7ffa5fe00640 1 -- 172.21.15.46:0/2050545658 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffa6c016af0 con 0x564a26f67380 2024-03-04T08:50:18.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.482+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa6c004030 con 0x564a26f67380 2024-03-04T08:50:18.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.484+0000 7ffa5fe00640 1 -- 172.21.15.46:0/2050545658 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa6c016d30 con 0x564a26f67380 2024-03-04T08:50:18.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.484+0000 7ffa88b76740 10 client.4627 fetch_fsmap learned FSMap version 17 2024-03-04T08:50:18.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.484+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564a26fe01f0 con 0x564a26f67380 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.489+0000 7ffa5fe00640 1 -- 172.21.15.46:0/2050545658 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c004030 con 0x564a26f67380 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.489+0000 7ffa5fe00640 1 -- 172.21.15.46:0/2050545658 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) v1 ==== 4544+0+0 (secure 0 0 0) 0x7ffa6c02c650 con 0x564a26f67380 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.489+0000 7ffa88b76740 10 client.4627 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.489+0000 7ffa88b76740 10 client.4627 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.490+0000 7ffa88b76740 20 client.4627 populate_metadata read hostname 'smithi046' 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.490+0000 7ffa88b76740 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26fd5ef0 0x564a26fd62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.490+0000 7ffa88b76740 4 client.4627 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:50:18.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.490+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 --> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564a26e96e90 con 0x564a26fd5ef0 2024-03-04T08:50:18.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.491+0000 7ffa7f400640 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26fd5ef0 0x564a26fd62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.496+0000 7ffa5fe00640 10 client.4627 ms_handle_connect on v2:172.21.15.46:6835/3649809556 2024-03-04T08:50:18.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.496+0000 7ffa7f400640 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26fd5ef0 0x564a26fd62d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62865eaabd4a4a17 server_cookie=cbf4dd90422c1d52 in_seq=0 out_seq=0 2024-03-04T08:50:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa5fe00640 1 -- 172.21.15.46:0/2050545658 <== mds.0 v2:172.21.15.46:6835/3649809556 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564a26e96e90 con 0x564a26fd5ef0 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa5fe00640 10 client.4627 handle_command_reply: tid=0 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 client.4627 shutdown 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 msgr2=0x564a26f82980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 0x564a26f82980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8015b480 tx=0x7ffa6c01a000 comp rx=0 tx=0).stop 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 shutdown_connections 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:6835/3649809556,v1:172.21.15.46:6837/3649809556] conn(0x564a26fd5ef0 0x564a26fd62d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564a26f67380 0x564a26f82980 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a26f75030 0x564a26f84050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 --2- 172.21.15.46:0/2050545658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564a26f2b1b0 0x564a26fdfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 >> 172.21.15.46:0/2050545658 conn(0x564a26f29c10 msgr2=0x564a26f2a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa5fe00640 0 client.4627 ms_handle_reset on v2:172.21.15.46:6835/3649809556 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 shutdown_connections 2024-03-04T08:50:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.523+0000 7ffa88b76740 1 -- 172.21.15.46:0/2050545658 wait complete. 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa88b76740 20 client.4627 trim_cache size 0 max 16384 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "bc679561-c3d1-42a9-8f4c-6c87fdde4dff", 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4273, 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-03-04T08:50:18.521 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 36.391092567000001, 2024-03-04T08:50:18.522 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-03-04T08:50:18.522 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-03-04T08:50:18.522 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 23, 2024-03-04T08:50:18.522 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 47.951775458 2024-03-04T08:50:18.522 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa6006b490 msgr2=0x7ffa6006d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa6006b490 0x7ffa6006d950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa7002bed0 tx=0x7ffa70009740 comp rx=0 tx=0).stop 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 msgr2=0x7ffa801f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa801f43d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009890 tx=0x7ffa700046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 shutdown_connections 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa6006b490 0x7ffa6006d950 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa8015b700 0x7ffa800ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa80152350 0x7ffa801508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 --2- 172.21.15.46:0/2911273848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa80151f70 0x7ffa801f43d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.524+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 >> 172.21.15.46:0/2911273848 conn(0x7ffa8006aff0 msgr2=0x7ffa800c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.525+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 shutdown_connections 2024-03-04T08:50:18.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.525+0000 7ffa85e00640 1 -- 172.21.15.46:0/2911273848 wait complete. 2024-03-04T08:50:18.542 INFO:teuthology.run_tasks:Running task kclient... 2024-03-04T08:50:18.567 INFO:tasks.kclient:Mounting kernel clients... 2024-03-04T08:50:18.568 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-04T08:50:18.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:18.568 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-03-04T08:50:18.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:18.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-03-04T08:50:18.730 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-03-04T08:50:18.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:50:18.736 INFO:tasks.kclient:client.0 config is {} 2024-03-04T08:50:18.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T08:50:18.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:18.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:50:18.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.933+0000 7f8fe6200640 1 Processor -- start 2024-03-04T08:50:18.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.933+0000 7f8fe6200640 1 -- start start 2024-03-04T08:50:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.934+0000 7f8fe6200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 0x7f8fe00cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.934+0000 7f8fe6200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fe00cea80 0x7f8fe0164d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.934+0000 7f8fe6200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00cc390 con 0x7f8fe00ce530 2024-03-04T08:50:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.934+0000 7f8fe6200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe00cd9c0 con 0x7f8fe00cea80 2024-03-04T08:50:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.934+0000 7f8fe6200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00cd540 con 0x7f8fe00cefd0 2024-03-04T08:50:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.935+0000 7f8fdf400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 0x7f8fe00cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.935+0000 7f8fdfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fe00cea80 0x7f8fe0164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.935+0000 7f8fdf400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 0x7f8fe00cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58470/0 (socket says 172.21.15.46:58470) 2024-03-04T08:50:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.935+0000 7f8fdf400640 1 -- 172.21.15.46:0/1373991456 learned_addr learned my addr 172.21.15.46:0/1373991456 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.935+0000 7f8fdea00640 1 --1- 172.21.15.46:0/1373991456 >> v1:172.21.15.46:6789/0 conn(0x7f8fe00ce530 0x7f8fe015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38216/0 (socket says 172.21.15.46:38216) 2024-03-04T08:50:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.937+0000 7f8fdf400640 1 -- 172.21.15.46:0/1373991456 >> v2:172.21.15.46:3300/0 conn(0x7f8fe00cea80 msgr2=0x7f8fe0164d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.937+0000 7f8fdf400640 1 --2- 172.21.15.46:0/1373991456 >> v2:172.21.15.46:3300/0 conn(0x7f8fe00cea80 0x7f8fe0164d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.937+0000 7f8fdf400640 1 -- 172.21.15.46:0/1373991456 >> v1:172.21.15.46:6789/0 conn(0x7f8fe00ce530 legacy=0x7f8fe015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.938+0000 7f8fdf400640 1 -- 172.21.15.46:0/1373991456 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00cdbf0 con 0x7f8fe00cefd0 2024-03-04T08:50:18.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.940+0000 7f8fdf400640 1 --2- 172.21.15.46:0/1373991456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 0x7f8fe00cf3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009870 tx=0x7f8fc802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3a8ac11bef9fb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.943+0000 7f8fde000640 1 -- 172.21.15.46:0/1373991456 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc802f840 con 0x7f8fe00cefd0 2024-03-04T08:50:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.943+0000 7f8fde000640 1 -- 172.21.15.46:0/1373991456 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc802f9e0 con 0x7f8fe00cefd0 2024-03-04T08:50:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.943+0000 7f8fde000640 1 -- 172.21.15.46:0/1373991456 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc802fdb0 con 0x7f8fe00cefd0 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 -- 172.21.15.46:0/1373991456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 msgr2=0x7f8fe00cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1373991456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 0x7f8fe00cf3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009870 tx=0x7f8fc802ba20 comp rx=0 tx=0).stop 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 -- 172.21.15.46:0/1373991456 shutdown_connections 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1373991456 >> v2:172.21.15.46:3300/0 conn(0x7f8fe00cea80 0x7f8fe0164d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1373991456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00cefd0 0x7f8fe00cf3b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 -- 172.21.15.46:0/1373991456 >> 172.21.15.46:0/1373991456 conn(0x7f8fe00b16d0 msgr2=0x7f8fe00b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 -- 172.21.15.46:0/1373991456 shutdown_connections 2024-03-04T08:50:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.944+0000 7f8fe6200640 1 -- 172.21.15.46:0/1373991456 wait complete. 2024-03-04T08:50:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.946+0000 7f8fe6200640 1 Processor -- start 2024-03-04T08:50:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.946+0000 7f8fe6200640 1 -- start start 2024-03-04T08:50:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.947+0000 7f8fe6200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00ce530 0x7f8fe015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.947+0000 7f8fe6200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 0x7f8fe00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.947+0000 7f8fe6200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe00cefd0 0x7f8fe01f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.947+0000 7f8fe6200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00cc600 con 0x7f8fe00cefd0 2024-03-04T08:50:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.947+0000 7f8fe6200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00ce190 con 0x7f8fe00cea80 2024-03-04T08:50:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.947+0000 7f8fe6200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00cc8e0 con 0x7f8fe00ce530 2024-03-04T08:50:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.948+0000 7f8fdea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 0x7f8fe00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.948+0000 7f8fdfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe00cefd0 0x7f8fe01f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.948+0000 7f8fdf400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00ce530 0x7f8fe015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.948+0000 7f8fdea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 0x7f8fe00b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:37800/0 (socket says 172.21.15.46:37800) 2024-03-04T08:50:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.948+0000 7f8fdea00640 1 -- 172.21.15.46:0/1380278687 learned_addr learned my addr 172.21.15.46:0/1380278687 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T08:50:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.952+0000 7f8fdea00640 1 -- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00ce530 msgr2=0x7f8fe015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.952+0000 7f8fdea00640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00ce530 0x7f8fe015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.952+0000 7f8fdea00640 1 -- 172.21.15.46:0/1380278687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe00cefd0 msgr2=0x7f8fe01f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.952+0000 7f8fdea00640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe00cefd0 0x7f8fe01f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.952+0000 7f8fdea00640 1 -- 172.21.15.46:0/1380278687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00c5910 con 0x7f8fe00cea80 2024-03-04T08:50:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.954+0000 7f8fdea00640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 0x7f8fe00b2a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000c730 tx=0x7f8fd000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.959+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0017070 con 0x7f8fe00cea80 2024-03-04T08:50:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.959+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000ce40 con 0x7f8fe00cea80 2024-03-04T08:50:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.959+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe00c5bf0 con 0x7f8fe00cea80 2024-03-04T08:50:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.959+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000a860 con 0x7f8fe00cea80 2024-03-04T08:50:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.959+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00c61b0 con 0x7f8fe00cea80 2024-03-04T08:50:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.960+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe00680b0 con 0x7f8fe00cea80 2024-03-04T08:50:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.981+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fd001a070 con 0x7f8fe00cea80 2024-03-04T08:50:18.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.983+0000 7f8fd7400640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8fbc06b550 0x7f8fbc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:18.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.984+0000 7f8fdf400640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8fbc06b550 0x7f8fbc06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:18.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:18.984+0000 7f8fdf400640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8fbc06b550 0x7f8fbc06da10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8036000 tx=0x7f8fc8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:19.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.242+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8fd0056480 con 0x7f8fe00cea80 2024-03-04T08:50:19.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.253+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8fd0021020 con 0x7f8fe00cea80 2024-03-04T08:50:19.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.520+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fe00c9fd0 con 0x7f8fe00cea80 2024-03-04T08:50:19.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.526+0000 7f8fd7400640 1 -- 172.21.15.46:0/1380278687 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8fd00583e0 con 0x7f8fe00cea80 2024-03-04T08:50:19.523 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8fbc06b550 msgr2=0x7f8fbc06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8fbc06b550 0x7f8fbc06da10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8036000 tx=0x7f8fc8008030 comp rx=0 tx=0).stop 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 msgr2=0x7f8fe00b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 0x7f8fe00b2a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000c730 tx=0x7f8fd000cbf0 comp rx=0 tx=0).stop 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 shutdown_connections 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8fbc06b550 0x7f8fbc06da10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:19.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fe00cea80 0x7f8fe00b2a90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:19.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe00cefd0 0x7f8fe01f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:19.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 --2- 172.21.15.46:0/1380278687 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8fe00ce530 0x7f8fe015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:19.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 >> 172.21.15.46:0/1380278687 conn(0x7f8fe00b16d0 msgr2=0x7f8fe00c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:19.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 shutdown_connections 2024-03-04T08:50:19.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T08:50:19.529+0000 7f8fe6200640 1 -- 172.21.15.46:0/1380278687 wait complete. 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:50:19.544 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:50:19.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:19.545 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-03-04T08:50:19.588 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:19.589 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42085sec preferred_lft 42085sec 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-03-04T08:50:19.590 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:19.591 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:19.591 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:19.591 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-03-04T08:50:19.591 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-04T08:50:19.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:19.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-03-04T08:50:19.592 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-03-04T08:50:19.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-03-04T08:50:19.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-03-04T08:50:19.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-03-04T08:50:19.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-04T08:50:19.592 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-03-04T08:50:20.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:20.054 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:50:20.129 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-03-04T08:50:20.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:20.133 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-03-04T08:50:20.186 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-03-04T08:50:20.187 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:50:20.187 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:50:20.187 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:50:20.187 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:50:20.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:20.187 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-03-04T08:50:20.187 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-03-04T08:50:20.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:50:20.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:50:20.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:50:20.188 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-03-04T08:50:20.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:20.889 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-03-04T08:50:20.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:20.934 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-03-04T08:50:21.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:21.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-03-04T08:50:21.014 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-03-04T08:50:21.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:21.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-04T08:50:21.015 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-03-04T08:50:21.190 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-04T08:50:21.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-04T08:50:21.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-04T08:50:21.191 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-03-04T08:50:21.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-03-04T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-03-04T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-03-04T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-03-04T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-03-04T08:50:21.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:50:21.614 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:21.657 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:50:21.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:50:21.657 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:21.740 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-04T08:50:21.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:21.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-04T08:50:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-04T08:50:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-04T08:50:22.895 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-04T08:50:22.895 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-04T08:50:22.895 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2024-03-04T08:50:22.895 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@bc679561-c3d1-42a9-8f4c-6c87fdde4dff.cephfs=/ 2024-03-04T08:50:22.895 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.73:3300/172.21.15.73:3301" will pass to kernel 2024-03-04T08:50:22.900 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-04T08:50:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-03-04T08:50:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-04T08:50:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-03-04T08:50:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-04T08:50:22.905 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-04T08:50:22.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:22.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:23.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:23.289 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-04T08:50:23.795 INFO:teuthology.orchestra.run.smithi046.stdout:client4527 2024-03-04T08:50:23.795 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:50:23.795 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:50:23.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:23.848 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-04T08:50:24.353 INFO:teuthology.orchestra.run.smithi046.stdout:client4527 2024-03-04T08:50:24.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:24.353 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-04T08:50:24.900 INFO:teuthology.orchestra.run.smithi046.stdout:client4527 2024-03-04T08:50:24.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:24.900 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bc679561-c3d1-42a9-8f4c-6c87fdde4dff.client4527/status') 2024-03-04T08:50:25.274 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.4527 (3)192.168.0.1:0/730603862 2024-03-04T08:50:25.274 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2024-03-04T08:50:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2024-03-04T08:50:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2024-03-04T08:50:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:68 bytes copied, 5.6021e-05 s, 1.2 MB/s 2024-03-04T08:50:25.281 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T08:50:25.314 INFO:tasks.workunit:Pulling workunits from ref 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:50:25.314 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T08:50:25.314 INFO:tasks.workunit:timeout=6h 2024-03-04T08:50:25.315 INFO:tasks.workunit:cleanup=True 2024-03-04T08:50:25.315 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:25.363 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:25.363 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-04T08:50:25.363 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-03-04T08:50:25.363 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:50:25.363 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-04T08:50:25.363 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-04T08:50:25.364 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-04 08:49:42.482262559 +0000 2024-03-04T08:50:25.364 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-04 08:50:22.977226175 +0000 2024-03-04T08:50:25.364 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-04 08:49:42.482262559 +0000 2024-03-04T08:50:25.364 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:25.364 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-04T08:50:25.980 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:50:26.032 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T08:50:39.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:39.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:09.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:09.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:39.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:39.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:07.821 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 61% (7592/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-04T08:52:08.519 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'. 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.520 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-03-04T08:52:08.521 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.521 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-03-04T08:52:08.521 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.521 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T08:52:08.521 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-04T08:52:08.521 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 1bc250c7129 mds/quiesce-db: incorporate review comments 2024-03-04T08:52:08.525 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T08:52:08.577 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T08:52:08.582 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T08:52:08.582 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T08:52:09.452 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T08:52:09.550 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T08:52:09.634 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T08:52:09.639 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T08:52:09.639 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T08:52:09.710 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T08:52:09.718 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T08:52:09.718 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T08:52:09.757 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-04T08:52:09.758 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-04T08:52:09.758 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-04T08:52:09.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:09.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:10.019 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p fsstress 2024-03-04T08:52:10.049 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd fsstress 2024-03-04T08:52:10.049 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-04T08:52:10.049 INFO:tasks.workunit.client.0.smithi046.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-04T08:52:10.784 INFO:tasks.workunit.client.0.smithi046.stderr:+ tar xzf ltp-full.tgz 2024-03-04T08:52:40.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:40.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:10.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:10.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:40.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:40.345 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:54:10.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:54:10.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:54:40.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:54:40.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:55:10.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:55:10.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:55:40.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:55:40.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:56:11.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:56:11.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:56:41.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:56:41.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:57:11.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:57:11.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:57:41.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:57:41.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:57:53.260 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:04.068 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.364 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:04.235 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.423 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:04.231 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.430 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:09:04.301 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.435 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:04.306 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.484 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:09:04.356 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.904 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:09:04.775 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.946 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:04.817 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T08:57:53.958 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:04.766 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T08:58:11.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:58:11.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:58:41.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:58:41.788 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:59:11.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:59:11.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:59:42.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:59:42.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:00:12.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:00:12.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:00:24.464 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:11:35.272 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.470 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:11:35.278 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.474 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:11:35.345 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.478 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:11:35.350 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.484 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:11:35.355 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.486 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:11:35.358 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.583 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:11:35.391 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.586 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:11:35.457 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:24.599 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:11:35.470 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:00:42.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:00:42.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:01:12.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:01:12.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:01:42.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:01:42.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:02:12.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:02:12.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:02:42.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:02:42.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:03:13.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:03:13.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:03:43.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:03:43.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:04:13.326 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:04:13.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:04:33.064 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:15:43.872 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.079 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:15:43.887 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.124 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:15:43.996 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.126 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:15:43.998 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.164 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:15:44.036 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.166 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:15:44.038 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.208 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:15:44.016 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.253 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:15:44.125 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:33.296 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:15:44.168 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:04:43.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:04:43.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:05:13.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:05:13.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:05:43.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:05:43.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:06:13.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:06:13.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:06:17.160 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:17:28.032 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.161 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:17:28.033 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.197 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:28.005 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.198 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:17:28.070 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.204 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:28.012 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.279 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:28.087 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.289 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:28.161 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.291 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:28.162 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:17.326 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:28.197 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:06:44.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:06:44.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:07:14.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:07:14.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:07:44.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:07:44.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:08:14.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:08:14.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:08:41.576 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:19:52.383 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.586 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:19:52.394 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.588 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:19:52.460 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.640 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:19:52.512 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.651 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:19:52.523 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.655 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:19:52.526 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.678 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:19:52.486 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.701 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:19:52.572 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:41.712 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:19:52.584 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:08:44.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:08:44.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:09:14.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:09:14.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:09:44.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:09:44.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:10:14.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:10:14.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:10:45.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:10:45.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:11:15.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:11:15.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:11:45.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:11:45.395 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:12:15.515 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:12:15.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:12:45.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:12:45.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:13:14.734 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:25.541 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.741 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:25.549 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.799 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:24:25.670 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.800 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:24:25.671 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.828 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:24:25.699 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.830 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:24:25.701 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.902 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:25.709 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.933 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:24:25.804 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:14.992 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:24:25.861 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:13:15.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:13:15.781 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:13:45.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:13:45.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:14:15.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:14:16.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:14:40.249 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:51.056 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.362 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:51.169 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.416 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:25:51.287 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.421 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:25:51.293 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.468 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:51.339 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.474 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:25:51.345 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.479 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:51.350 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.488 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:51.296 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:40.525 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:51.396 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:14:46.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:14:46.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:15:16.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:15:16.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:15:46.382 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:15:46.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:16:16.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:16:16.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:16:46.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:16:46.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:16:55.286 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:28:06.093 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.292 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:28:06.164 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.295 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:28:06.166 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.302 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:28:06.173 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.307 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:28:06.175 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.308 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:28:06.116 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.351 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:28:06.222 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.362 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:28:06.233 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:16:55.543 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:28:06.350 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:17:16.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:17:16.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:17:46.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:17:46.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:18:17.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:18:17.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:18:47.134 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:18:47.142 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:19:17.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:19:17.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:19:47.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:19:47.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:20:17.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:20:17.621 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:20:47.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:20:47.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:21:04.310 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:15.117 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.325 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:15.196 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.326 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:32:15.198 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.328 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:15.199 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.329 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:32:15.200 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.335 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:15.142 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.423 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:32:15.294 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.470 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:15.341 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:04.500 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:15.307 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:17.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:21:17.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:21:33.747 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:44.554 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.752 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:44.559 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.800 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:44.607 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.824 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:44.695 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.828 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:44.699 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.836 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:32:44.707 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.840 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:32:44.711 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.860 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:44.731 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:33.862 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:32:44.733 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:21:47.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:21:47.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:22:01.740 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-04T09:22:02.641 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-04T09:22:02.641 INFO:tasks.workunit.client.0.smithi046.stderr:+ make 2024-03-04T09:22:03.908 INFO:tasks.workunit.client.0.smithi046.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-04T09:22:07.760 INFO:tasks.workunit.client.0.smithi046.stderr:++ readlink -f fsstress 2024-03-04T09:22:07.763 INFO:tasks.workunit.client.0.smithi046.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-04T09:22:07.763 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-03-04T09:22:07.764 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-04T09:22:07.764 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-03-04T09:22:07.764 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-04T09:22:07.764 INFO:tasks.workunit.client.0.smithi046.stderr:++ mktemp -d -p . 2024-03-04T09:22:07.845 INFO:tasks.workunit.client.0.smithi046.stderr:+ T=./tmp.Is72PUMa20 2024-03-04T09:22:07.845 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Is72PUMa20 -l 1 -n 1000 -p 10 -v 2024-03-04T09:22:07.888 INFO:tasks.workunit.client.0.smithi046.stdout:seed = 1709706411 2024-03-04T09:22:08.050 INFO:tasks.workunit.client.0.smithi046.stdout:0/0: dwrite - no filename 2024-03-04T09:22:08.050 INFO:tasks.workunit.client.0.smithi046.stdout:0/1: dwrite - no filename 2024-03-04T09:22:08.050 INFO:tasks.workunit.client.0.smithi046.stdout:0/2: chown . 14 1 2024-03-04T09:22:08.116 INFO:tasks.workunit.client.0.smithi046.stdout:0/3: mknod c0 0 2024-03-04T09:22:08.217 INFO:tasks.workunit.client.0.smithi046.stdout:0/4: creat f1 x:0 0 0 2024-03-04T09:22:08.218 INFO:tasks.workunit.client.0.smithi046.stdout:0/5: creat f2 x:0 0 0 2024-03-04T09:22:09.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/0: rename - no filename 2024-03-04T09:22:09.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/1: write - no filename 2024-03-04T09:22:09.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/2: dread - no filename 2024-03-04T09:22:09.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/3: write - no filename 2024-03-04T09:22:09.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/6: symlink l3 0 2024-03-04T09:22:09.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/0: symlink l0 0 2024-03-04T09:22:09.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/1: stat l0 0 2024-03-04T09:22:18.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:22:18.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:22:48.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:22:48.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:22:50.905 INFO:tasks.workunit.client.0.smithi046.stdout:3/4: creat f0 x:0 0 0 2024-03-04T09:22:50.905 INFO:tasks.workunit.client.0.smithi046.stdout:3/5: rmdir - no directory 2024-03-04T09:22:50.998 INFO:tasks.workunit.client.0.smithi046.stdout:3/6: dwrite f0 [0,4194304] 0 2024-03-04T09:22:51.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/7: mknod c4 0 2024-03-04T09:22:51.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/8: fsync f2 0 2024-03-04T09:22:51.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/2: creat f1 x:0 0 0 2024-03-04T09:22:51.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/3: write f1 [321191,83266] 0 2024-03-04T09:22:51.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/4: chown f1 970 1 2024-03-04T09:22:51.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/7: mkdir d1 0 2024-03-04T09:22:51.879 INFO:tasks.workunit.client.0.smithi046.stdout:0/9: rename l3 to l5 0 2024-03-04T09:22:51.918 INFO:tasks.workunit.client.0.smithi046.stdout:2/5: mknod c2 0 2024-03-04T09:22:51.918 INFO:tasks.workunit.client.0.smithi046.stdout:2/6: chown c2 103 1 2024-03-04T09:22:51.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/10: dwrite f1 [0,4194304] 0 2024-03-04T09:22:52.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/11: dwrite f2 [0,4194304] 0 2024-03-04T09:22:52.117 INFO:tasks.workunit.client.0.smithi046.stdout:0/12: dwrite f1 [0,4194304] 0 2024-03-04T09:22:52.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/13: mknod c6 0 2024-03-04T09:22:53.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/14: rename f2 to f7 0 2024-03-04T09:22:53.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/15: creat f8 x:0 0 0 2024-03-04T09:22:53.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/16: chown c0 1899842170 1 2024-03-04T09:22:55.069 INFO:tasks.workunit.client.0.smithi046.stdout:1/0: sync 2024-03-04T09:22:55.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/8: truncate f0 1941226 0 2024-03-04T09:22:55.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/7: getdents . 0 2024-03-04T09:22:55.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/8: write f1 [893604,99057] 0 2024-03-04T09:22:55.331 INFO:tasks.workunit.client.0.smithi046.stdout:0/17: unlink c4 0 2024-03-04T09:22:55.332 INFO:tasks.workunit.client.0.smithi046.stdout:1/1: symlink l0 0 2024-03-04T09:22:55.332 INFO:tasks.workunit.client.0.smithi046.stdout:1/2: rmdir - no directory 2024-03-04T09:22:55.332 INFO:tasks.workunit.client.0.smithi046.stdout:1/3: write - no filename 2024-03-04T09:22:55.333 INFO:tasks.workunit.client.0.smithi046.stdout:2/9: rename f1 to f3 0 2024-03-04T09:22:55.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/4: unlink l0 0 2024-03-04T09:22:55.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/5: rmdir - no directory 2024-03-04T09:22:55.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/18: dwrite f7 [4194304,4194304] 0 2024-03-04T09:22:55.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/19: truncate f8 535828 0 2024-03-04T09:22:55.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/20: creat f9 x:0 0 0 2024-03-04T09:22:55.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/21: creat fa x:0 0 0 2024-03-04T09:22:55.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/22: chown fa 912623816 1 2024-03-04T09:22:55.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/23: chown f7 349310 1 2024-03-04T09:22:55.443 INFO:tasks.workunit.client.0.smithi046.stdout:2/10: dwrite f3 [0,4194304] 0 2024-03-04T09:22:55.459 INFO:tasks.workunit.client.0.smithi046.stdout:2/11: write f3 [3455779,99836] 0 2024-03-04T09:22:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/0: read - no filename 2024-03-04T09:22:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/1: dread - no filename 2024-03-04T09:22:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/2: dread - no filename 2024-03-04T09:22:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/3: fsync - no filename 2024-03-04T09:22:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/4: readlink - no filename 2024-03-04T09:22:55.749 INFO:tasks.workunit.client.0.smithi046.stdout:4/5: dread - no filename 2024-03-04T09:22:55.759 INFO:tasks.workunit.client.0.smithi046.stdout:3/9: write f0 [826540,8925] 0 2024-03-04T09:22:55.762 INFO:tasks.workunit.client.0.smithi046.stdout:3/10: fdatasync f0 0 2024-03-04T09:22:55.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/6: mkdir d1 0 2024-03-04T09:22:56.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/12: chown c2 1 1 2024-03-04T09:22:56.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/0: readlink - no filename 2024-03-04T09:22:56.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/13: dread f3 [0,4194304] 0 2024-03-04T09:22:56.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/6: mkdir d0 0 2024-03-04T09:22:56.196 INFO:tasks.workunit.client.0.smithi046.stdout:3/11: unlink f0 0 2024-03-04T09:22:56.196 INFO:tasks.workunit.client.0.smithi046.stdout:3/12: truncate - no filename 2024-03-04T09:22:56.196 INFO:tasks.workunit.client.0.smithi046.stdout:3/13: link - no file 2024-03-04T09:22:56.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/7: getdents d0 0 2024-03-04T09:22:56.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/8: readlink - no filename 2024-03-04T09:22:56.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/9: chown d0 93045 1 2024-03-04T09:22:56.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/10: dwrite - no filename 2024-03-04T09:22:56.329 INFO:tasks.workunit.client.0.smithi046.stdout:1/7: mknod d1/c2 0 2024-03-04T09:22:56.329 INFO:tasks.workunit.client.0.smithi046.stdout:1/8: fsync - no filename 2024-03-04T09:22:56.654 INFO:tasks.workunit.client.0.smithi046.stdout:6/0: write - no filename 2024-03-04T09:22:56.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/14: symlink d1/l2 0 2024-03-04T09:22:56.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/15: write - no filename 2024-03-04T09:22:56.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/16: dread - no filename 2024-03-04T09:22:56.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/17: chown d1 26132334 1 2024-03-04T09:22:57.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/11: creat d0/f1 x:0 0 0 2024-03-04T09:22:57.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/24: getdents . 0 2024-03-04T09:22:57.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/9: creat d1/f3 x:0 0 0 2024-03-04T09:22:57.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/0: chown . 262558 1 2024-03-04T09:22:57.979 INFO:tasks.workunit.client.0.smithi046.stdout:6/1: creat f0 x:0 0 0 2024-03-04T09:22:57.980 INFO:tasks.workunit.client.0.smithi046.stdout:6/2: dread - f0 zero size 2024-03-04T09:22:58.101 INFO:tasks.workunit.client.0.smithi046.stdout:2/14: truncate f3 522660 0 2024-03-04T09:22:58.398 INFO:tasks.workunit.client.0.smithi046.stdout:3/18: mknod d1/c3 0 2024-03-04T09:22:58.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/12: rename d0/f1 to d0/f2 0 2024-03-04T09:22:58.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/13: readlink - no filename 2024-03-04T09:22:58.479 INFO:tasks.workunit.client.0.smithi046.stdout:4/14: dwrite d0/f2 [0,4194304] 0 2024-03-04T09:22:58.481 INFO:tasks.workunit.client.0.smithi046.stdout:0/25: mknod cb 0 2024-03-04T09:22:58.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/1: mkdir d0 0 2024-03-04T09:22:58.996 INFO:tasks.workunit.client.0.smithi046.stdout:3/19: mkdir d1/d4 0 2024-03-04T09:22:59.253 INFO:tasks.workunit.client.0.smithi046.stdout:4/15: mkdir d0/d3 0 2024-03-04T09:22:59.254 INFO:tasks.workunit.client.0.smithi046.stdout:4/16: chown d0/f2 1204258 1 2024-03-04T09:22:59.419 INFO:tasks.workunit.client.0.smithi046.stdout:1/10: getdents d1 0 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/0: mknod c0 0 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/1: chown c0 0 1 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/2: dread - no filename 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/3: dwrite - no filename 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/4: read - no filename 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/5: truncate - no filename 2024-03-04T09:22:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/6: chown c0 2 1 2024-03-04T09:22:59.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/15: write f3 [145733,90903] 0 2024-03-04T09:22:59.549 INFO:tasks.workunit.client.0.smithi046.stdout:5/1: sync 2024-03-04T09:22:59.606 INFO:tasks.workunit.client.0.smithi046.stdout:7/2: symlink d0/l1 0 2024-03-04T09:22:59.607 INFO:tasks.workunit.client.0.smithi046.stdout:7/3: write - no filename 2024-03-04T09:22:59.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/3: getdents . 0 2024-03-04T09:23:00.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/20: rename d1/d4 to d1/d5 0 2024-03-04T09:23:00.100 INFO:tasks.workunit.client.0.smithi046.stdout:4/17: creat d0/d3/f4 x:0 0 0 2024-03-04T09:23:00.101 INFO:tasks.workunit.client.0.smithi046.stdout:4/18: creat d0/f5 x:0 0 0 2024-03-04T09:23:00.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/11: link d1/f3 d1/f4 0 2024-03-04T09:23:00.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/0: mknod c0 0 2024-03-04T09:23:00.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/1: fdatasync - no filename 2024-03-04T09:23:00.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/2: dwrite - no filename 2024-03-04T09:23:00.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/7: symlink l1 0 2024-03-04T09:23:00.640 INFO:tasks.workunit.client.0.smithi046.stdout:2/16: creat f4 x:0 0 0 2024-03-04T09:23:00.641 INFO:tasks.workunit.client.0.smithi046.stdout:2/17: stat f4 0 2024-03-04T09:23:00.641 INFO:tasks.workunit.client.0.smithi046.stdout:2/18: write f4 [442342,99506] 0 2024-03-04T09:23:00.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/19: dwrite f4 [0,4194304] 0 2024-03-04T09:23:00.809 INFO:tasks.workunit.client.0.smithi046.stdout:2/20: dwrite f4 [0,4194304] 0 2024-03-04T09:23:00.867 INFO:tasks.workunit.client.0.smithi046.stdout:7/4: creat d0/f2 x:0 0 0 2024-03-04T09:23:01.007 INFO:tasks.workunit.client.0.smithi046.stdout:6/4: mknod c1 0 2024-03-04T09:23:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:3/21: mknod d1/c6 0 2024-03-04T09:23:01.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/26: link fa fc 0 2024-03-04T09:23:01.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/3: mkdir d1 0 2024-03-04T09:23:01.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/4: dread - no filename 2024-03-04T09:23:01.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/5: dwrite - no filename 2024-03-04T09:23:01.891 INFO:tasks.workunit.client.0.smithi046.stdout:8/8: creat f2 x:0 0 0 2024-03-04T09:23:02.014 INFO:tasks.workunit.client.0.smithi046.stdout:8/9: dwrite f2 [0,4194304] 0 2024-03-04T09:23:02.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/2: sync 2024-03-04T09:23:02.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/5: creat f2 x:0 0 0 2024-03-04T09:23:02.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/22: mknod d1/c7 0 2024-03-04T09:23:02.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/23: fdatasync - no filename 2024-03-04T09:23:02.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/24: truncate - no filename 2024-03-04T09:23:02.457 INFO:tasks.workunit.client.0.smithi046.stdout:3/25: dread - no filename 2024-03-04T09:23:02.457 INFO:tasks.workunit.client.0.smithi046.stdout:3/26: read - no filename 2024-03-04T09:23:02.570 INFO:tasks.workunit.client.0.smithi046.stdout:4/19: unlink d0/f5 0 2024-03-04T09:23:02.570 INFO:tasks.workunit.client.0.smithi046.stdout:4/20: creat d0/d3/f6 x:0 0 0 2024-03-04T09:23:02.728 INFO:tasks.workunit.client.0.smithi046.stdout:0/27: fsync f8 0 2024-03-04T09:23:02.831 INFO:tasks.workunit.client.0.smithi046.stdout:1/12: mknod d1/c5 0 2024-03-04T09:23:03.460 INFO:tasks.workunit.client.0.smithi046.stdout:9/6: mkdir d1/d2 0 2024-03-04T09:23:03.460 INFO:tasks.workunit.client.0.smithi046.stdout:9/7: dwrite - no filename 2024-03-04T09:23:03.460 INFO:tasks.workunit.client.0.smithi046.stdout:9/8: dwrite - no filename 2024-03-04T09:23:03.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/10: symlink l3 0 2024-03-04T09:23:03.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/11: creat f4 x:0 0 0 2024-03-04T09:23:03.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/12: dread - f4 zero size 2024-03-04T09:23:03.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/13: chown c0 3 1 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:8/14: write f4 [497143,31039] 0 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/21: mkdir d5 0 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/22: getdents d5 0 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/23: truncate f4 4233743 0 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/24: rename d5 to d5/d6 22 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/25: chown f4 13235 1 2024-03-04T09:23:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/26: getdents d5 0 2024-03-04T09:23:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/3: mknod c0 0 2024-03-04T09:23:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/4: chown c0 4618861 1 2024-03-04T09:23:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/5: getdents d0 0 2024-03-04T09:23:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/6: rename d0 to d0/d3 22 2024-03-04T09:23:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:6/6: mknod c3 0 2024-03-04T09:23:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:6/7: creat f4 x:0 0 0 2024-03-04T09:23:03.496 INFO:tasks.workunit.client.0.smithi046.stdout:2/27: dread f3 [0,4194304] 0 2024-03-04T09:23:03.555 INFO:tasks.workunit.client.0.smithi046.stdout:6/8: dwrite f2 [0,4194304] 0 2024-03-04T09:23:03.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/9: creat f5 x:0 0 0 2024-03-04T09:23:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:3/27: mkdir d1/d8 0 2024-03-04T09:23:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:3/28: getdents d1/d5 0 2024-03-04T09:23:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:3/29: chown d1 888030986 1 2024-03-04T09:23:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:3/30: truncate - no filename 2024-03-04T09:23:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:3/31: chown d1 2 1 2024-03-04T09:23:03.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/32: fsync - no filename 2024-03-04T09:23:03.971 INFO:tasks.workunit.client.0.smithi046.stdout:4/21: symlink d0/l7 0 2024-03-04T09:23:04.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/28: dwrite f7 [4194304,4194304] 0 2024-03-04T09:23:04.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/9: mknod d1/c3 0 2024-03-04T09:23:04.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/10: truncate - no filename 2024-03-04T09:23:04.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/11: write - no filename 2024-03-04T09:23:04.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/12: dread - no filename 2024-03-04T09:23:04.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/15: mknod c5 0 2024-03-04T09:23:04.463 INFO:tasks.workunit.client.0.smithi046.stdout:8/16: dread f2 [0,4194304] 0 2024-03-04T09:23:04.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/5: mkdir d1 0 2024-03-04T09:23:04.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/6: read - no filename 2024-03-04T09:23:04.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/7: dread - no filename 2024-03-04T09:23:04.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/8: dread - no filename 2024-03-04T09:23:04.557 INFO:tasks.workunit.client.0.smithi046.stdout:7/7: mkdir d0/d4 0 2024-03-04T09:23:04.739 INFO:tasks.workunit.client.0.smithi046.stdout:2/28: creat d5/f7 x:0 0 0 2024-03-04T09:23:04.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/29: dread f3 [0,4194304] 0 2024-03-04T09:23:04.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/30: dread - d5/f7 zero size 2024-03-04T09:23:04.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/31: read - d5/f7 zero size 2024-03-04T09:23:04.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/32: write f4 [4215453,77502] 0 2024-03-04T09:23:05.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/10: mknod c6 0 2024-03-04T09:23:05.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/11: rmdir - no directory 2024-03-04T09:23:05.069 INFO:tasks.workunit.client.0.smithi046.stdout:6/12: write f5 [976279,64588] 0 2024-03-04T09:23:05.139 INFO:tasks.workunit.client.0.smithi046.stdout:6/13: dwrite f5 [0,4194304] 0 2024-03-04T09:23:05.140 INFO:tasks.workunit.client.0.smithi046.stdout:6/14: creat f7 x:0 0 0 2024-03-04T09:23:05.183 INFO:tasks.workunit.client.0.smithi046.stdout:3/33: creat d1/f9 x:0 0 0 2024-03-04T09:23:05.349 INFO:tasks.workunit.client.0.smithi046.stdout:0/29: creat fd x:0 0 0 2024-03-04T09:23:05.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/30: write fa [642732,9462] 0 2024-03-04T09:23:05.391 INFO:tasks.workunit.client.0.smithi046.stdout:0/31: dwrite f7 [0,4194304] 0 2024-03-04T09:23:05.391 INFO:tasks.workunit.client.0.smithi046.stdout:0/32: stat f7 0 2024-03-04T09:23:05.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/13: mknod d1/c6 0 2024-03-04T09:23:05.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/14: dread - d1/f4 zero size 2024-03-04T09:23:05.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/15: chown d1 16056286 1 2024-03-04T09:23:05.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/16: stat d1/c6 0 2024-03-04T09:23:05.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/13: creat d1/d2/f4 x:0 0 0 2024-03-04T09:23:05.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/9: creat d1/f2 x:0 0 0 2024-03-04T09:23:05.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/10: dread - d1/f2 zero size 2024-03-04T09:23:05.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/11: write d1/f2 [326327,69256] 0 2024-03-04T09:23:05.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/12: readlink - no filename 2024-03-04T09:23:05.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/13: fdatasync d1/f2 0 2024-03-04T09:23:06.006 INFO:tasks.workunit.client.0.smithi046.stdout:7/8: link d0/f2 d0/d4/f5 0 2024-03-04T09:23:06.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/9: fdatasync d0/f2 0 2024-03-04T09:23:06.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/10: read - d0/f2 zero size 2024-03-04T09:23:06.182 INFO:tasks.workunit.client.0.smithi046.stdout:2/33: symlink d5/l8 0 2024-03-04T09:23:06.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/33: creat fe x:0 0 0 2024-03-04T09:23:06.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/34: rmdir - no directory 2024-03-04T09:23:06.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/17: creat d1/f7 x:0 0 0 2024-03-04T09:23:06.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/18: chown d1/c6 47 1 2024-03-04T09:23:06.778 INFO:tasks.workunit.client.0.smithi046.stdout:1/19: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:23:06.779 INFO:tasks.workunit.client.0.smithi046.stdout:1/20: write d1/f4 [310560,90020] 0 2024-03-04T09:23:06.906 INFO:tasks.workunit.client.0.smithi046.stdout:9/14: mknod d1/c5 0 2024-03-04T09:23:06.915 INFO:tasks.workunit.client.0.smithi046.stdout:5/14: mkdir d1/d3 0 2024-03-04T09:23:07.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/11: unlink d0/f2 0 2024-03-04T09:23:07.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/12: chown d0 1396 1 2024-03-04T09:23:07.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/13: chown d0/d4 131 1 2024-03-04T09:23:07.128 INFO:tasks.workunit.client.0.smithi046.stdout:2/34: symlink d5/l9 0 2024-03-04T09:23:07.128 INFO:tasks.workunit.client.0.smithi046.stdout:2/35: write d5/f7 [686311,78105] 0 2024-03-04T09:23:07.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/15: rmdir d1 39 2024-03-04T09:23:07.895 INFO:tasks.workunit.client.0.smithi046.stdout:5/15: creat d1/d3/f4 x:0 0 0 2024-03-04T09:23:07.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/22: sync 2024-03-04T09:23:08.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/14: mknod d0/c6 0 2024-03-04T09:23:08.023 INFO:tasks.workunit.client.0.smithi046.stdout:8/17: sync 2024-03-04T09:23:08.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/34: rmdir d1/d5 0 2024-03-04T09:23:08.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/35: write d1/f9 [737623,117718] 0 2024-03-04T09:23:08.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/36: readlink d1/l2 0 2024-03-04T09:23:08.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/37: dread d1/f9 [0,4194304] 0 2024-03-04T09:23:08.583 INFO:tasks.workunit.client.0.smithi046.stdout:6/15: fsync f7 0 2024-03-04T09:23:08.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/35: truncate f7 3426254 0 2024-03-04T09:23:08.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/21: mknod d1/c8 0 2024-03-04T09:23:08.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/22: chown d1/c6 1073 1 2024-03-04T09:23:08.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/23: chown d1/c8 113242616 1 2024-03-04T09:23:08.644 INFO:tasks.workunit.client.0.smithi046.stdout:6/16: dwrite f4 [0,4194304] 0 2024-03-04T09:23:08.644 INFO:tasks.workunit.client.0.smithi046.stdout:6/17: read - f7 zero size 2024-03-04T09:23:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:9/16: mkdir d1/d2/d6 0 2024-03-04T09:23:09.020 INFO:tasks.workunit.client.0.smithi046.stdout:9/17: dwrite d1/d2/f4 [0,4194304] 0 2024-03-04T09:23:09.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/36: getdents d5 0 2024-03-04T09:23:09.766 INFO:tasks.workunit.client.0.smithi046.stdout:8/18: truncate f2 1554215 0 2024-03-04T09:23:09.935 INFO:tasks.workunit.client.0.smithi046.stdout:3/38: link d1/l2 d1/la 0 2024-03-04T09:23:09.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/39: dread d1/f9 [0,4194304] 0 2024-03-04T09:23:09.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/40: write d1/f9 [1119498,104908] 0 2024-03-04T09:23:10.494 INFO:tasks.workunit.client.0.smithi046.stdout:5/16: rmdir d1/d3 39 2024-03-04T09:23:10.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/36: dwrite f7 [0,4194304] 0 2024-03-04T09:23:10.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/37: truncate fa 1483473 0 2024-03-04T09:23:11.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/15: mknod d0/d4/c7 0 2024-03-04T09:23:11.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/16: chown d0/c6 16 1 2024-03-04T09:23:11.004 INFO:tasks.workunit.client.0.smithi046.stdout:2/37: mkdir d5/da 0 2024-03-04T09:23:11.069 INFO:tasks.workunit.client.0.smithi046.stdout:2/38: dwrite f3 [0,4194304] 0 2024-03-04T09:23:11.090 INFO:tasks.workunit.client.0.smithi046.stdout:8/19: mknod c6 0 2024-03-04T09:23:11.090 INFO:tasks.workunit.client.0.smithi046.stdout:8/20: chown f4 577787 1 2024-03-04T09:23:11.090 INFO:tasks.workunit.client.0.smithi046.stdout:8/21: chown c0 1 1 2024-03-04T09:23:11.168 INFO:tasks.workunit.client.0.smithi046.stdout:3/41: symlink d1/d8/lb 0 2024-03-04T09:23:11.404 INFO:tasks.workunit.client.0.smithi046.stdout:5/17: getdents d1/d3 0 2024-03-04T09:23:11.405 INFO:tasks.workunit.client.0.smithi046.stdout:5/18: fdatasync d1/d3/f4 0 2024-03-04T09:23:11.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/19: read d1/f2 [204402,80412] 0 2024-03-04T09:23:11.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/20: readlink - no filename 2024-03-04T09:23:11.423 INFO:tasks.workunit.client.0.smithi046.stdout:5/21: dread d1/f2 [0,4194304] 0 2024-03-04T09:23:11.508 INFO:tasks.workunit.client.0.smithi046.stdout:0/38: creat ff x:0 0 0 2024-03-04T09:23:11.733 INFO:tasks.workunit.client.0.smithi046.stdout:2/39: creat d5/fb x:0 0 0 2024-03-04T09:23:11.733 INFO:tasks.workunit.client.0.smithi046.stdout:2/40: rename d5/da to d5/da/dc 22 2024-03-04T09:23:11.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/22: mkdir d7 0 2024-03-04T09:23:11.914 INFO:tasks.workunit.client.0.smithi046.stdout:3/42: mknod d1/d8/cc 0 2024-03-04T09:23:12.018 INFO:tasks.workunit.client.0.smithi046.stdout:1/24: link d1/c2 d1/c9 0 2024-03-04T09:23:12.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/25: dread d1/f4 [0,4194304] 0 2024-03-04T09:23:12.442 INFO:tasks.workunit.client.0.smithi046.stdout:9/18: write d1/d2/f4 [4775673,49209] 0 2024-03-04T09:23:12.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/19: dwrite d1/d2/f4 [0,4194304] 0 2024-03-04T09:23:12.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/20: write d1/d2/f4 [5274844,94469] 0 2024-03-04T09:23:12.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/21: creat d1/d2/f7 x:0 0 0 2024-03-04T09:23:12.522 INFO:tasks.workunit.client.0.smithi046.stdout:9/22: write d1/d2/f4 [4525832,121795] 0 2024-03-04T09:23:12.614 INFO:tasks.workunit.client.0.smithi046.stdout:2/41: creat d5/fd x:0 0 0 2024-03-04T09:23:12.698 INFO:tasks.workunit.client.0.smithi046.stdout:2/42: dwrite d5/fd [0,4194304] 0 2024-03-04T09:23:12.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/17: symlink d0/d4/l8 0 2024-03-04T09:23:12.726 INFO:tasks.workunit.client.0.smithi046.stdout:6/18: sync 2024-03-04T09:23:12.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/23: sync 2024-03-04T09:23:12.726 INFO:tasks.workunit.client.0.smithi046.stdout:6/19: stat f4 0 2024-03-04T09:23:12.760 INFO:tasks.workunit.client.0.smithi046.stdout:6/20: dread f5 [0,4194304] 0 2024-03-04T09:23:12.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/24: read d0/f2 [3801120,102632] 0 2024-03-04T09:23:12.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/25: dread - d0/d3/f4 zero size 2024-03-04T09:23:12.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/26: dread - d0/d3/f6 zero size 2024-03-04T09:23:12.822 INFO:tasks.workunit.client.0.smithi046.stdout:6/21: dwrite f0 [0,4194304] 0 2024-03-04T09:23:12.823 INFO:tasks.workunit.client.0.smithi046.stdout:6/22: creat f8 x:0 0 0 2024-03-04T09:23:12.823 INFO:tasks.workunit.client.0.smithi046.stdout:6/23: fdatasync f0 0 2024-03-04T09:23:12.846 INFO:tasks.workunit.client.0.smithi046.stdout:4/27: dwrite d0/f2 [0,4194304] 0 2024-03-04T09:23:12.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/23: symlink d7/l8 0 2024-03-04T09:23:12.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/26: unlink d1/c8 0 2024-03-04T09:23:12.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/27: chown d1/c2 7 1 2024-03-04T09:23:13.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/24: dread f4 [0,4194304] 0 2024-03-04T09:23:13.022 INFO:tasks.workunit.client.0.smithi046.stdout:8/25: write f2 [538966,40064] 0 2024-03-04T09:23:13.022 INFO:tasks.workunit.client.0.smithi046.stdout:8/26: chown d7/l8 3157 1 2024-03-04T09:23:13.026 INFO:tasks.workunit.client.0.smithi046.stdout:0/39: mkdir d10 0 2024-03-04T09:23:13.202 INFO:tasks.workunit.client.0.smithi046.stdout:9/23: mkdir d1/d2/d6/d8 0 2024-03-04T09:23:13.203 INFO:tasks.workunit.client.0.smithi046.stdout:9/24: truncate d1/d2/f7 493696 0 2024-03-04T09:23:13.293 INFO:tasks.workunit.client.0.smithi046.stdout:9/25: dwrite d1/d2/f7 [0,4194304] 0 2024-03-04T09:23:13.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/18: creat d0/f9 x:0 0 0 2024-03-04T09:23:13.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/24: rename f7 to f9 0 2024-03-04T09:23:13.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/25: read - f9 zero size 2024-03-04T09:23:13.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/26: stat c3 0 2024-03-04T09:23:14.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/28: mknod d0/d3/c8 0 2024-03-04T09:23:14.031 INFO:tasks.workunit.client.0.smithi046.stdout:1/28: creat d1/fa x:0 0 0 2024-03-04T09:23:14.031 INFO:tasks.workunit.client.0.smithi046.stdout:1/29: fdatasync d1/f7 0 2024-03-04T09:23:14.065 INFO:tasks.workunit.client.0.smithi046.stdout:6/27: dwrite f5 [0,4194304] 0 2024-03-04T09:23:14.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/40: creat d10/f11 x:0 0 0 2024-03-04T09:23:14.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/41: fdatasync fa 0 2024-03-04T09:23:14.616 INFO:tasks.workunit.client.0.smithi046.stdout:9/26: unlink d1/d2/f4 0 2024-03-04T09:23:14.617 INFO:tasks.workunit.client.0.smithi046.stdout:3/43: truncate d1/f9 2177 0 2024-03-04T09:23:14.617 INFO:tasks.workunit.client.0.smithi046.stdout:3/44: chown d1/f9 75674 1 2024-03-04T09:23:14.695 INFO:tasks.workunit.client.0.smithi046.stdout:9/27: dwrite d1/d2/f7 [0,4194304] 0 2024-03-04T09:23:14.728 INFO:tasks.workunit.client.0.smithi046.stdout:9/28: write d1/d2/f7 [481277,91789] 0 2024-03-04T09:23:14.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/43: mknod d5/ce 0 2024-03-04T09:23:14.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/44: fdatasync f3 0 2024-03-04T09:23:14.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/22: sync 2024-03-04T09:23:14.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/23: fdatasync d1/d3/f4 0 2024-03-04T09:23:14.859 INFO:tasks.workunit.client.0.smithi046.stdout:5/24: write d1/d3/f4 [237548,84203] 0 2024-03-04T09:23:14.859 INFO:tasks.workunit.client.0.smithi046.stdout:5/25: creat d1/f5 x:0 0 0 2024-03-04T09:23:14.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/26: dread d1/f2 [0,4194304] 0 2024-03-04T09:23:14.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/27: chown d1/f2 523 1 2024-03-04T09:23:14.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/28: truncate d1/d3/f4 1171826 0 2024-03-04T09:23:14.910 INFO:tasks.workunit.client.0.smithi046.stdout:7/19: dwrite d0/d4/f5 [0,4194304] 0 2024-03-04T09:23:15.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/29: rename d0/l7 to d0/l9 0 2024-03-04T09:23:15.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/30: readlink d0/l9 0 2024-03-04T09:23:15.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/31: readlink d0/l9 0 2024-03-04T09:23:15.223 INFO:tasks.workunit.client.0.smithi046.stdout:6/28: mkdir da 0 2024-03-04T09:23:15.223 INFO:tasks.workunit.client.0.smithi046.stdout:6/29: getdents da 0 2024-03-04T09:23:15.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/30: dread d1/f3 [0,4194304] 0 2024-03-04T09:23:15.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/31: write d1/fa [965617,15477] 0 2024-03-04T09:23:15.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/32: truncate d1/f4 1136594 0 2024-03-04T09:23:15.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/33: truncate d1/f4 1210033 0 2024-03-04T09:23:15.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/30: write f4 [1549821,40892] 0 2024-03-04T09:23:15.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/42: write f9 [531389,22268] 0 2024-03-04T09:23:15.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/43: read f8 [239416,127031] 0 2024-03-04T09:23:15.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/44: stat fa 0 2024-03-04T09:23:15.541 INFO:tasks.workunit.client.0.smithi046.stdout:0/45: dwrite f9 [0,4194304] 0 2024-03-04T09:23:15.736 INFO:tasks.workunit.client.0.smithi046.stdout:2/45: creat d5/ff x:0 0 0 2024-03-04T09:23:15.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/46: dwrite f3 [0,4194304] 0 2024-03-04T09:23:15.850 INFO:tasks.workunit.client.0.smithi046.stdout:2/47: write d5/fd [1426778,16185] 0 2024-03-04T09:23:15.850 INFO:tasks.workunit.client.0.smithi046.stdout:2/48: write d5/fd [3537055,105647] 0 2024-03-04T09:23:15.996 INFO:tasks.workunit.client.0.smithi046.stdout:5/29: link c0 d1/c6 0 2024-03-04T09:23:15.996 INFO:tasks.workunit.client.0.smithi046.stdout:5/30: dread - d1/f5 zero size 2024-03-04T09:23:15.997 INFO:tasks.workunit.client.0.smithi046.stdout:5/31: creat d1/f7 x:0 0 0 2024-03-04T09:23:16.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/32: rename d0/f2 to d0/d3/fa 0 2024-03-04T09:23:16.535 INFO:tasks.workunit.client.0.smithi046.stdout:6/31: unlink f8 0 2024-03-04T09:23:16.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/46: mkdir d10/d12 0 2024-03-04T09:23:16.734 INFO:tasks.workunit.client.0.smithi046.stdout:2/49: creat d5/f10 x:0 0 0 2024-03-04T09:23:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:9/29: write d1/d2/f7 [5197358,101044] 0 2024-03-04T09:23:17.261 INFO:tasks.workunit.client.0.smithi046.stdout:3/45: truncate d1/f9 313499 0 2024-03-04T09:23:17.276 INFO:tasks.workunit.client.0.smithi046.stdout:8/27: sync 2024-03-04T09:23:17.276 INFO:tasks.workunit.client.0.smithi046.stdout:8/28: fdatasync f2 0 2024-03-04T09:23:17.293 INFO:tasks.workunit.client.0.smithi046.stdout:8/29: dread f4 [0,4194304] 0 2024-03-04T09:23:17.685 INFO:tasks.workunit.client.0.smithi046.stdout:1/34: mknod d1/cb 0 2024-03-04T09:23:17.820 INFO:tasks.workunit.client.0.smithi046.stdout:6/32: truncate f2 437213 0 2024-03-04T09:23:17.820 INFO:tasks.workunit.client.0.smithi046.stdout:6/33: readlink - no filename 2024-03-04T09:23:17.820 INFO:tasks.workunit.client.0.smithi046.stdout:6/34: readlink - no filename 2024-03-04T09:23:17.924 INFO:tasks.workunit.client.0.smithi046.stdout:4/33: mknod d0/cb 0 2024-03-04T09:23:18.058 INFO:tasks.workunit.client.0.smithi046.stdout:0/47: symlink d10/d12/l13 0 2024-03-04T09:23:18.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/48: dwrite fd [0,4194304] 0 2024-03-04T09:23:18.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/49: creat d10/f14 x:0 0 0 2024-03-04T09:23:18.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:23:18.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:23:18.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/20: sync 2024-03-04T09:23:18.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/21: read - d0/f9 zero size 2024-03-04T09:23:18.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/22: dread - d0/f9 zero size 2024-03-04T09:23:18.523 INFO:tasks.workunit.client.0.smithi046.stdout:3/46: dread d1/f9 [0,4194304] 0 2024-03-04T09:23:18.590 INFO:tasks.workunit.client.0.smithi046.stdout:7/23: dwrite d0/d4/f5 [0,4194304] 0 2024-03-04T09:23:19.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/32: link d1/f7 d1/f8 0 2024-03-04T09:23:19.297 INFO:tasks.workunit.client.0.smithi046.stdout:1/35: creat d1/fc x:0 0 0 2024-03-04T09:23:19.301 INFO:tasks.workunit.client.0.smithi046.stdout:1/36: write d1/f4 [117254,59061] 0 2024-03-04T09:23:19.318 INFO:tasks.workunit.client.0.smithi046.stdout:1/37: dread d1/f4 [0,4194304] 0 2024-03-04T09:23:19.318 INFO:tasks.workunit.client.0.smithi046.stdout:1/38: readlink - no filename 2024-03-04T09:23:19.429 INFO:tasks.workunit.client.0.smithi046.stdout:6/35: mknod da/cb 0 2024-03-04T09:23:19.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/36: dread f4 [0,4194304] 0 2024-03-04T09:23:19.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/34: mkdir d0/d3/dc 0 2024-03-04T09:23:19.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/35: dread d0/d3/fa [0,4194304] 0 2024-03-04T09:23:20.046 INFO:tasks.workunit.client.0.smithi046.stdout:0/50: unlink f8 0 2024-03-04T09:23:20.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/50: symlink d5/l11 0 2024-03-04T09:23:20.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/51: truncate d5/fb 754565 0 2024-03-04T09:23:20.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/52: write d5/f10 [978395,63072] 0 2024-03-04T09:23:20.097 INFO:tasks.workunit.client.0.smithi046.stdout:2/53: write d5/fb [683060,9991] 0 2024-03-04T09:23:20.097 INFO:tasks.workunit.client.0.smithi046.stdout:2/54: getdents d5/da 0 2024-03-04T09:23:20.345 INFO:tasks.workunit.client.0.smithi046.stdout:3/47: creat d1/d8/fd x:0 0 0 2024-03-04T09:23:20.345 INFO:tasks.workunit.client.0.smithi046.stdout:9/30: rename d1/c3 to d1/d2/d6/c9 0 2024-03-04T09:23:20.346 INFO:tasks.workunit.client.0.smithi046.stdout:9/31: creat d1/d2/fa x:0 0 0 2024-03-04T09:23:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/32: dwrite d1/d2/f7 [0,4194304] 0 2024-03-04T09:23:20.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/33: stat d1/c6 0 2024-03-04T09:23:20.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/39: creat d1/fd x:0 0 0 2024-03-04T09:23:20.717 INFO:tasks.workunit.client.0.smithi046.stdout:1/40: write d1/f4 [372946,72328] 0 2024-03-04T09:23:20.719 INFO:tasks.workunit.client.0.smithi046.stdout:1/41: write d1/f3 [983734,605] 0 2024-03-04T09:23:20.719 INFO:tasks.workunit.client.0.smithi046.stdout:1/42: write d1/fa [1193822,51190] 0 2024-03-04T09:23:20.966 INFO:tasks.workunit.client.0.smithi046.stdout:6/37: mknod da/cc 0 2024-03-04T09:23:20.966 INFO:tasks.workunit.client.0.smithi046.stdout:4/36: mkdir d0/d3/dd 0 2024-03-04T09:23:21.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/38: dread f0 [0,4194304] 0 2024-03-04T09:23:21.028 INFO:tasks.workunit.client.0.smithi046.stdout:0/51: mknod d10/c15 0 2024-03-04T09:23:21.097 INFO:tasks.workunit.client.0.smithi046.stdout:0/52: dwrite fc [0,4194304] 0 2024-03-04T09:23:21.098 INFO:tasks.workunit.client.0.smithi046.stdout:0/53: creat d10/f16 x:0 0 0 2024-03-04T09:23:21.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/55: mkdir d5/da/d12 0 2024-03-04T09:23:21.516 INFO:tasks.workunit.client.0.smithi046.stdout:3/48: rmdir d1 39 2024-03-04T09:23:21.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/33: link c0 d1/d2/d6/d8/cb 0 2024-03-04T09:23:21.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/34: read - d1/d2/fa zero size 2024-03-04T09:23:21.547 INFO:tasks.workunit.client.0.smithi046.stdout:9/35: write d1/d2/f7 [1741818,44890] 0 2024-03-04T09:23:21.599 INFO:tasks.workunit.client.0.smithi046.stdout:5/34: mknod d1/c9 0 2024-03-04T09:23:21.676 INFO:tasks.workunit.client.0.smithi046.stdout:5/35: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:23:21.715 INFO:tasks.workunit.client.0.smithi046.stdout:5/36: dwrite d1/f8 [0,4194304] 0 2024-03-04T09:23:21.748 INFO:tasks.workunit.client.0.smithi046.stdout:1/43: creat d1/fe x:0 0 0 2024-03-04T09:23:21.767 INFO:tasks.workunit.client.0.smithi046.stdout:5/37: dwrite d1/f2 [0,4194304] 0 2024-03-04T09:23:21.767 INFO:tasks.workunit.client.0.smithi046.stdout:5/38: fsync d1/f7 0 2024-03-04T09:23:21.768 INFO:tasks.workunit.client.0.smithi046.stdout:5/39: getdents d1/d3 0 2024-03-04T09:23:21.791 INFO:tasks.workunit.client.0.smithi046.stdout:4/37: symlink d0/d3/dd/le 0 2024-03-04T09:23:21.791 INFO:tasks.workunit.client.0.smithi046.stdout:4/38: truncate d0/d3/f6 1015085 0 2024-03-04T09:23:21.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/39: mkdir da/dd 0 2024-03-04T09:23:22.285 INFO:tasks.workunit.client.0.smithi046.stdout:7/24: mkdir d0/da 0 2024-03-04T09:23:22.285 INFO:tasks.workunit.client.0.smithi046.stdout:7/25: chown d0/da 29 1 2024-03-04T09:23:22.289 INFO:tasks.workunit.client.0.smithi046.stdout:8/30: sync 2024-03-04T09:23:22.392 INFO:tasks.workunit.client.0.smithi046.stdout:7/26: dwrite d0/f9 [0,4194304] 0 2024-03-04T09:23:23.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/49: mkdir d1/d8/de 0 2024-03-04T09:23:23.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/50: dread - d1/d8/fd zero size 2024-03-04T09:23:23.626 INFO:tasks.workunit.client.0.smithi046.stdout:5/40: link d1/f8 d1/d3/fa 0 2024-03-04T09:23:23.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/41: dread d1/f8 [0,4194304] 0 2024-03-04T09:23:23.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/31: creat d7/f9 x:0 0 0 2024-03-04T09:23:23.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/32: write f4 [585401,39193] 0 2024-03-04T09:23:24.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/56: sync 2024-03-04T09:23:24.577 INFO:tasks.workunit.client.0.smithi046.stdout:4/39: mknod d0/cf 0 2024-03-04T09:23:24.629 INFO:tasks.workunit.client.0.smithi046.stdout:4/40: dwrite d0/d3/f6 [0,4194304] 0 2024-03-04T09:23:24.842 INFO:tasks.workunit.client.0.smithi046.stdout:1/44: mknod d1/cf 0 2024-03-04T09:23:24.842 INFO:tasks.workunit.client.0.smithi046.stdout:1/45: stat d1/f4 0 2024-03-04T09:23:24.843 INFO:tasks.workunit.client.0.smithi046.stdout:1/46: chown d1 294 1 2024-03-04T09:23:24.849 INFO:tasks.workunit.client.0.smithi046.stdout:1/47: write d1/fa [241450,84105] 0 2024-03-04T09:23:25.029 INFO:tasks.workunit.client.0.smithi046.stdout:5/42: mkdir d1/d3/db 0 2024-03-04T09:23:25.164 INFO:tasks.workunit.client.0.smithi046.stdout:7/27: mkdir d0/d4/db 0 2024-03-04T09:23:25.263 INFO:tasks.workunit.client.0.smithi046.stdout:2/57: creat d5/f13 x:0 0 0 2024-03-04T09:23:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/41: creat d0/d3/dd/f10 x:0 0 0 2024-03-04T09:23:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/42: chown d0/d3/f6 7 1 2024-03-04T09:23:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/43: chown d0/l9 0 1 2024-03-04T09:23:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/28: write d0/f9 [4332408,91464] 0 2024-03-04T09:23:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/29: chown d0/f9 252981 1 2024-03-04T09:23:25.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/51: rmdir d1/d8 39 2024-03-04T09:23:25.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/33: getdents d7 0 2024-03-04T09:23:26.400 INFO:tasks.workunit.client.0.smithi046.stdout:3/52: rmdir d1/d8 39 2024-03-04T09:23:26.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/44: creat d0/f11 x:0 0 0 2024-03-04T09:23:26.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/53: dread d1/f9 [0,4194304] 0 2024-03-04T09:23:26.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/54: readlink d1/d8/lb 0 2024-03-04T09:23:26.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/55: chown d1/la 11437 1 2024-03-04T09:23:26.489 INFO:tasks.workunit.client.0.smithi046.stdout:3/56: dwrite d1/f9 [0,4194304] 0 2024-03-04T09:23:26.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/48: symlink d1/l10 0 2024-03-04T09:23:26.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/49: truncate d1/fc 792263 0 2024-03-04T09:23:26.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/50: fsync d1/f3 0 2024-03-04T09:23:26.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/57: dwrite d1/d8/fd [0,4194304] 0 2024-03-04T09:23:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/58: truncate d5/f7 249746 0 2024-03-04T09:23:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/54: rename c0 to d10/c17 0 2024-03-04T09:23:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/55: write ff [454301,73114] 0 2024-03-04T09:23:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/56: fdatasync fa 0 2024-03-04T09:23:27.181 INFO:tasks.workunit.client.0.smithi046.stdout:3/58: mknod d1/d8/cf 0 2024-03-04T09:23:27.212 INFO:tasks.workunit.client.0.smithi046.stdout:3/59: dread d1/d8/fd [0,4194304] 0 2024-03-04T09:23:27.269 INFO:tasks.workunit.client.0.smithi046.stdout:3/60: dwrite d1/f9 [0,4194304] 0 2024-03-04T09:23:27.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/61: dread d1/f9 [0,4194304] 0 2024-03-04T09:23:27.505 INFO:tasks.workunit.client.0.smithi046.stdout:9/36: link d1/d2/d6/c9 d1/d2/cc 0 2024-03-04T09:23:27.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/59: rmdir d5/da/d12 0 2024-03-04T09:23:27.664 INFO:tasks.workunit.client.0.smithi046.stdout:6/40: rename f0 to da/dd/fe 0 2024-03-04T09:23:27.935 INFO:tasks.workunit.client.0.smithi046.stdout:4/45: rmdir d0/d3/dd 39 2024-03-04T09:23:28.098 INFO:tasks.workunit.client.0.smithi046.stdout:3/62: write d1/f9 [5145898,78107] 0 2024-03-04T09:23:28.146 INFO:tasks.workunit.client.0.smithi046.stdout:1/51: rmdir d1 39 2024-03-04T09:23:28.486 INFO:tasks.workunit.client.0.smithi046.stdout:9/37: creat d1/d2/d6/d8/fd x:0 0 0 2024-03-04T09:23:28.486 INFO:tasks.workunit.client.0.smithi046.stdout:9/38: stat d1/d2/d6/d8 0 2024-03-04T09:23:28.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/60: creat d5/da/f14 x:0 0 0 2024-03-04T09:23:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/43: rename d1/f8 to d1/d3/fc 0 2024-03-04T09:23:28.808 INFO:tasks.workunit.client.0.smithi046.stdout:5/44: write d1/d3/fc [549962,95755] 0 2024-03-04T09:23:28.828 INFO:tasks.workunit.client.0.smithi046.stdout:5/45: dread d1/f7 [0,4194304] 0 2024-03-04T09:23:29.411 INFO:tasks.workunit.client.0.smithi046.stdout:0/57: rmdir d10 39 2024-03-04T09:23:29.743 INFO:tasks.workunit.client.0.smithi046.stdout:4/46: symlink d0/d3/dd/l12 0 2024-03-04T09:23:30.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/61: symlink d5/da/l15 0 2024-03-04T09:23:30.408 INFO:tasks.workunit.client.0.smithi046.stdout:7/30: rename d0/l1 to d0/da/lc 0 2024-03-04T09:23:30.408 INFO:tasks.workunit.client.0.smithi046.stdout:7/31: write d0/d4/f5 [4954864,46159] 0 2024-03-04T09:23:30.499 INFO:tasks.workunit.client.0.smithi046.stdout:6/41: dwrite f2 [0,4194304] 0 2024-03-04T09:23:30.499 INFO:tasks.workunit.client.0.smithi046.stdout:6/42: chown da/dd/fe 1512 1 2024-03-04T09:23:30.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/46: rmdir d1/d3/db 0 2024-03-04T09:23:30.531 INFO:tasks.workunit.client.0.smithi046.stdout:5/47: read d1/f2 [658059,73521] 0 2024-03-04T09:23:30.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/58: mknod d10/c18 0 2024-03-04T09:23:30.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/47: mknod d0/d3/dc/c13 0 2024-03-04T09:23:30.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/59: dwrite fd [0,4194304] 0 2024-03-04T09:23:30.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/60: write f9 [2208775,57437] 0 2024-03-04T09:23:30.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/63: truncate d1/d8/fd 3960180 0 2024-03-04T09:23:31.012 INFO:tasks.workunit.client.0.smithi046.stdout:1/52: symlink d1/l11 0 2024-03-04T09:23:31.013 INFO:tasks.workunit.client.0.smithi046.stdout:1/53: write d1/fd [840698,63885] 0 2024-03-04T09:23:31.297 INFO:tasks.workunit.client.0.smithi046.stdout:8/34: rename f4 to d7/fa 0 2024-03-04T09:23:31.536 INFO:tasks.workunit.client.0.smithi046.stdout:9/39: dwrite d1/d2/f7 [0,4194304] 0 2024-03-04T09:23:31.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/40: chown d1/d2/d6/d8/cb 102 1 2024-03-04T09:23:31.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/41: fsync d1/d2/f7 0 2024-03-04T09:23:31.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/43: symlink da/dd/lf 0 2024-03-04T09:23:31.723 INFO:tasks.workunit.client.0.smithi046.stdout:6/44: dwrite f4 [0,4194304] 0 2024-03-04T09:23:31.723 INFO:tasks.workunit.client.0.smithi046.stdout:6/45: fdatasync f5 0 2024-03-04T09:23:31.735 INFO:tasks.workunit.client.0.smithi046.stdout:5/48: creat d1/d3/fd x:0 0 0 2024-03-04T09:23:31.753 INFO:tasks.workunit.client.0.smithi046.stdout:6/46: write f2 [3896153,53738] 0 2024-03-04T09:23:31.753 INFO:tasks.workunit.client.0.smithi046.stdout:6/47: chown da 285179 1 2024-03-04T09:23:31.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/48: dwrite f5 [0,4194304] 0 2024-03-04T09:23:31.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/49: chown f2 94 1 2024-03-04T09:23:31.842 INFO:tasks.workunit.client.0.smithi046.stdout:6/50: dread f5 [0,4194304] 0 2024-03-04T09:23:31.871 INFO:tasks.workunit.client.0.smithi046.stdout:6/51: write f4 [2622783,82175] 0 2024-03-04T09:23:31.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/52: read da/dd/fe [2377852,3176] 0 2024-03-04T09:23:31.983 INFO:tasks.workunit.client.0.smithi046.stdout:0/61: rmdir d10 39 2024-03-04T09:23:31.983 INFO:tasks.workunit.client.0.smithi046.stdout:0/62: write d10/f16 [738633,95535] 0 2024-03-04T09:23:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:1/54: creat d1/f12 x:0 0 0 2024-03-04T09:23:32.079 INFO:tasks.workunit.client.0.smithi046.stdout:1/55: write d1/f7 [128510,44310] 0 2024-03-04T09:23:32.132 INFO:tasks.workunit.client.0.smithi046.stdout:4/48: mkdir d0/d3/d14 0 2024-03-04T09:23:32.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/49: dwrite d0/f11 [0,4194304] 0 2024-03-04T09:23:32.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/50: creat d0/f15 x:0 0 0 2024-03-04T09:23:32.226 INFO:tasks.workunit.client.0.smithi046.stdout:2/62: symlink d5/l16 0 2024-03-04T09:23:32.226 INFO:tasks.workunit.client.0.smithi046.stdout:2/63: chown d5/ce 487407 1 2024-03-04T09:23:32.227 INFO:tasks.workunit.client.0.smithi046.stdout:2/64: chown d5/f7 290929075 1 2024-03-04T09:23:32.227 INFO:tasks.workunit.client.0.smithi046.stdout:2/65: creat d5/da/f17 x:0 0 0 2024-03-04T09:23:32.426 INFO:tasks.workunit.client.0.smithi046.stdout:8/35: rename l3 to d7/lb 0 2024-03-04T09:23:32.557 INFO:tasks.workunit.client.0.smithi046.stdout:7/32: link d0/d4/f5 d0/d4/fd 0 2024-03-04T09:23:32.590 INFO:tasks.workunit.client.0.smithi046.stdout:3/64: dread d1/d8/fd [0,4194304] 0 2024-03-04T09:23:32.602 INFO:tasks.workunit.client.0.smithi046.stdout:7/33: dread d0/d4/fd [0,4194304] 0 2024-03-04T09:23:32.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/34: dread d0/d4/fd [0,4194304] 0 2024-03-04T09:23:32.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/35: stat d0/d4/f5 0 2024-03-04T09:23:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:5/49: unlink d1/d3/fd 0 2024-03-04T09:23:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:5/50: readlink - no filename 2024-03-04T09:23:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:6/53: creat da/dd/f10 x:0 0 0 2024-03-04T09:23:33.330 INFO:tasks.workunit.client.0.smithi046.stdout:6/54: dread f5 [0,4194304] 0 2024-03-04T09:23:33.330 INFO:tasks.workunit.client.0.smithi046.stdout:6/55: write da/dd/fe [3012387,37353] 0 2024-03-04T09:23:33.351 INFO:tasks.workunit.client.0.smithi046.stdout:6/56: dread f2 [0,4194304] 0 2024-03-04T09:23:33.983 INFO:tasks.workunit.client.0.smithi046.stdout:4/51: rename d0/d3/dd to d0/d3/d16 0 2024-03-04T09:23:34.289 INFO:tasks.workunit.client.0.smithi046.stdout:2/66: symlink d5/da/l18 0 2024-03-04T09:23:34.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/42: rename c0 to d1/d2/d6/d8/ce 0 2024-03-04T09:23:34.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/43: truncate d1/d2/f7 5978356 0 2024-03-04T09:23:34.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/44: chown d1/d2/d6/d8/cb 1247227 1 2024-03-04T09:23:34.542 INFO:tasks.workunit.client.0.smithi046.stdout:8/36: creat d7/fc x:0 0 0 2024-03-04T09:23:34.542 INFO:tasks.workunit.client.0.smithi046.stdout:8/37: creat d7/fd x:0 0 0 2024-03-04T09:23:34.950 INFO:tasks.workunit.client.0.smithi046.stdout:5/51: mkdir d1/d3/de 0 2024-03-04T09:23:35.161 INFO:tasks.workunit.client.0.smithi046.stdout:6/57: mknod da/dd/c11 0 2024-03-04T09:23:35.161 INFO:tasks.workunit.client.0.smithi046.stdout:6/58: chown c6 383129945 1 2024-03-04T09:23:35.271 INFO:tasks.workunit.client.0.smithi046.stdout:1/56: rmdir d1 39 2024-03-04T09:23:35.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/52: mkdir d0/d3/d16/d17 0 2024-03-04T09:23:35.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/53: truncate d0/f15 122667 0 2024-03-04T09:23:35.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/54: chown d0/d3/f4 6163 1 2024-03-04T09:23:35.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/67: mknod d5/da/c19 0 2024-03-04T09:23:35.722 INFO:tasks.workunit.client.0.smithi046.stdout:9/45: creat d1/ff x:0 0 0 2024-03-04T09:23:35.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/46: write d1/ff [189670,44895] 0 2024-03-04T09:23:35.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/47: read - d1/d2/fa zero size 2024-03-04T09:23:35.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/48: truncate d1/d2/d6/d8/fd 885251 0 2024-03-04T09:23:35.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/49: read d1/d2/f7 [747418,81002] 0 2024-03-04T09:23:36.088 INFO:tasks.workunit.client.0.smithi046.stdout:5/52: symlink d1/lf 0 2024-03-04T09:23:36.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/55: mknod d0/d3/d16/d17/c18 0 2024-03-04T09:23:36.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/56: readlink d0/d3/d16/l12 0 2024-03-04T09:23:36.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/68: mkdir d5/da/d1a 0 2024-03-04T09:23:36.627 INFO:tasks.workunit.client.0.smithi046.stdout:9/50: creat d1/d2/d6/f10 x:0 0 0 2024-03-04T09:23:37.199 INFO:tasks.workunit.client.0.smithi046.stdout:0/63: rename c6 to d10/c19 0 2024-03-04T09:23:37.200 INFO:tasks.workunit.client.0.smithi046.stdout:5/53: creat d1/d3/de/f10 x:0 0 0 2024-03-04T09:23:37.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/57: link d1/c9 d1/c13 0 2024-03-04T09:23:37.227 INFO:tasks.workunit.client.0.smithi046.stdout:1/58: write d1/f4 [277083,88393] 0 2024-03-04T09:23:37.227 INFO:tasks.workunit.client.0.smithi046.stdout:1/59: read - d1/fe zero size 2024-03-04T09:23:37.271 INFO:tasks.workunit.client.0.smithi046.stdout:0/64: dwrite d10/f11 [0,4194304] 0 2024-03-04T09:23:37.284 INFO:tasks.workunit.client.0.smithi046.stdout:0/65: dread d10/f16 [0,4194304] 0 2024-03-04T09:23:37.289 INFO:tasks.workunit.client.0.smithi046.stdout:1/60: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:23:37.333 INFO:tasks.workunit.client.0.smithi046.stdout:2/69: rmdir d5/da/d1a 0 2024-03-04T09:23:37.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/70: dwrite f3 [0,4194304] 0 2024-03-04T09:23:37.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/71: fsync d5/da/f17 0 2024-03-04T09:23:37.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/51: unlink d1/d2/d6/f10 0 2024-03-04T09:23:37.520 INFO:tasks.workunit.client.0.smithi046.stdout:9/52: dwrite d1/d2/d6/d8/fd [0,4194304] 0 2024-03-04T09:23:37.871 INFO:tasks.workunit.client.0.smithi046.stdout:7/36: rename d0/c6 to d0/da/ce 0 2024-03-04T09:23:38.248 INFO:tasks.workunit.client.0.smithi046.stdout:0/66: mknod d10/c1a 0 2024-03-04T09:23:38.248 INFO:tasks.workunit.client.0.smithi046.stdout:8/38: rmdir d7 39 2024-03-04T09:23:38.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/67: dwrite d10/f16 [0,4194304] 0 2024-03-04T09:23:38.310 INFO:tasks.workunit.client.0.smithi046.stdout:0/68: stat fc 0 2024-03-04T09:23:38.310 INFO:tasks.workunit.client.0.smithi046.stdout:0/69: chown d10/c1a 3648 1 2024-03-04T09:23:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:0/70: dwrite fc [0,4194304] 0 2024-03-04T09:23:38.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/65: rename d1/la to d1/l10 0 2024-03-04T09:23:38.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/66: chown d1/l2 108 1 2024-03-04T09:23:38.620 INFO:tasks.workunit.client.0.smithi046.stdout:2/72: chown d5/l9 53682 1 2024-03-04T09:23:39.888 INFO:tasks.workunit.client.0.smithi046.stdout:8/39: mkdir d7/de 0 2024-03-04T09:23:39.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/71: dwrite d10/f11 [4194304,4194304] 0 2024-03-04T09:23:39.998 INFO:tasks.workunit.client.0.smithi046.stdout:0/72: dread fd [0,4194304] 0 2024-03-04T09:23:40.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/61: link d1/cf d1/c14 0 2024-03-04T09:23:40.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/62: readlink d1/l10 0 2024-03-04T09:23:40.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/63: readlink d1/l10 0 2024-03-04T09:23:40.195 INFO:tasks.workunit.client.0.smithi046.stdout:3/67: creat d1/d8/de/f11 x:0 0 0 2024-03-04T09:23:40.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/64: write d1/f12 [546408,5303] 0 2024-03-04T09:23:40.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/68: write d1/d8/fd [635173,108643] 0 2024-03-04T09:23:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/69: write d1/f9 [888884,74176] 0 2024-03-04T09:23:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/70: readlink d1/l2 0 2024-03-04T09:23:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:3/71: read d1/d8/fd [520710,34795] 0 2024-03-04T09:23:40.417 INFO:tasks.workunit.client.0.smithi046.stdout:2/73: unlink d5/da/c19 0 2024-03-04T09:23:40.417 INFO:tasks.workunit.client.0.smithi046.stdout:2/74: dread - d5/da/f14 zero size 2024-03-04T09:23:40.417 INFO:tasks.workunit.client.0.smithi046.stdout:4/57: symlink d0/l19 0 2024-03-04T09:23:40.417 INFO:tasks.workunit.client.0.smithi046.stdout:4/58: chown d0/l19 1 1 2024-03-04T09:23:40.417 INFO:tasks.workunit.client.0.smithi046.stdout:4/59: write d0/d3/d16/f10 [412727,86667] 0 2024-03-04T09:23:40.885 INFO:tasks.workunit.client.0.smithi046.stdout:9/53: rename d1/d2 to d1/d11 0 2024-03-04T09:23:40.885 INFO:tasks.workunit.client.0.smithi046.stdout:9/54: truncate d1/ff 309275 0 2024-03-04T09:23:40.885 INFO:tasks.workunit.client.0.smithi046.stdout:9/55: dread - d1/d11/fa zero size 2024-03-04T09:23:40.993 INFO:tasks.workunit.client.0.smithi046.stdout:8/40: link c6 d7/cf 0 2024-03-04T09:23:41.237 INFO:tasks.workunit.client.0.smithi046.stdout:1/65: unlink d1/cf 0 2024-03-04T09:23:41.237 INFO:tasks.workunit.client.0.smithi046.stdout:1/66: write d1/f3 [44222,27288] 0 2024-03-04T09:23:41.343 INFO:tasks.workunit.client.0.smithi046.stdout:2/75: mkdir d5/da/d1b 0 2024-03-04T09:23:41.382 INFO:tasks.workunit.client.0.smithi046.stdout:2/76: dread f3 [0,4194304] 0 2024-03-04T09:23:41.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/60: write d0/f15 [35689,24271] 0 2024-03-04T09:23:41.503 INFO:tasks.workunit.client.0.smithi046.stdout:9/56: mkdir d1/d11/d6/d8/d12 0 2024-03-04T09:23:41.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/57: write d1/ff [625120,39647] 0 2024-03-04T09:23:41.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/58: chown d1/d11/d6/d8/fd 62 1 2024-03-04T09:23:41.997 INFO:tasks.workunit.client.0.smithi046.stdout:4/61: creat d0/d3/d16/f1a x:0 0 0 2024-03-04T09:23:41.997 INFO:tasks.workunit.client.0.smithi046.stdout:4/62: fsync d0/d3/fa 0 2024-03-04T09:23:42.058 INFO:tasks.workunit.client.0.smithi046.stdout:4/63: dwrite d0/d3/f4 [0,4194304] 0 2024-03-04T09:23:42.076 INFO:tasks.workunit.client.0.smithi046.stdout:0/73: truncate fc 1072352 0 2024-03-04T09:23:42.259 INFO:tasks.workunit.client.0.smithi046.stdout:9/59: mkdir d1/d11/d6/d8/d13 0 2024-03-04T09:23:42.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/67: mknod d1/c15 0 2024-03-04T09:23:42.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/68: stat d1/fd 0 2024-03-04T09:23:42.280 INFO:tasks.workunit.client.0.smithi046.stdout:1/69: write d1/f7 [3962834,59533] 0 2024-03-04T09:23:42.573 INFO:tasks.workunit.client.0.smithi046.stdout:4/64: creat d0/d3/d16/d17/f1b x:0 0 0 2024-03-04T09:23:42.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/65: dwrite d0/d3/f4 [0,4194304] 0 2024-03-04T09:23:42.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/66: dwrite d0/d3/d16/f1a [0,4194304] 0 2024-03-04T09:23:42.768 INFO:tasks.workunit.client.0.smithi046.stdout:4/67: read d0/d3/d16/f1a [2309676,59625] 0 2024-03-04T09:23:42.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/60: mknod d1/d11/d6/d8/c14 0 2024-03-04T09:23:42.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/61: dwrite d1/d11/d6/d8/fd [0,4194304] 0 2024-03-04T09:23:43.287 INFO:tasks.workunit.client.0.smithi046.stdout:4/68: creat d0/d3/d14/f1c x:0 0 0 2024-03-04T09:23:43.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/69: dread d0/d3/fa [0,4194304] 0 2024-03-04T09:23:43.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/70: read d0/d3/fa [1115751,47384] 0 2024-03-04T09:23:43.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/71: write d0/d3/d16/f1a [2707698,56637] 0 2024-03-04T09:23:43.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/72: write d0/d3/fa [3281019,18386] 0 2024-03-04T09:23:43.433 INFO:tasks.workunit.client.0.smithi046.stdout:9/62: creat d1/d11/d6/d8/f15 x:0 0 0 2024-03-04T09:23:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:9/63: dwrite d1/ff [0,4194304] 0 2024-03-04T09:23:43.554 INFO:tasks.workunit.client.0.smithi046.stdout:1/70: mknod d1/c16 0 2024-03-04T09:23:43.554 INFO:tasks.workunit.client.0.smithi046.stdout:1/71: stat d1/l10 0 2024-03-04T09:23:43.847 INFO:tasks.workunit.client.0.smithi046.stdout:4/73: rename d0/d3/dc/c13 to d0/d3/dc/c1d 0 2024-03-04T09:23:43.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/74: dwrite d0/d3/f4 [0,4194304] 0 2024-03-04T09:23:43.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/75: truncate d0/d3/d14/f1c 1022847 0 2024-03-04T09:23:44.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/59: rename f4 to da/dd/f12 0 2024-03-04T09:23:44.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/77: write d5/f7 [853989,96046] 0 2024-03-04T09:23:44.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/74: read fc [621265,47001] 0 2024-03-04T09:23:44.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/75: readlink d10/d12/l13 0 2024-03-04T09:23:44.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/78: dwrite d5/f7 [0,4194304] 0 2024-03-04T09:23:44.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/79: write d5/fd [3913256,101652] 0 2024-03-04T09:23:44.904 INFO:tasks.workunit.client.0.smithi046.stdout:0/76: dwrite fd [0,4194304] 0 2024-03-04T09:23:45.528 INFO:tasks.workunit.client.0.smithi046.stdout:1/72: creat d1/f17 x:0 0 0 2024-03-04T09:23:45.756 INFO:tasks.workunit.client.0.smithi046.stdout:5/54: rename d1/c9 to d1/d3/c11 0 2024-03-04T09:23:46.102 INFO:tasks.workunit.client.0.smithi046.stdout:0/77: creat d10/d12/f1b x:0 0 0 2024-03-04T09:23:46.102 INFO:tasks.workunit.client.0.smithi046.stdout:0/78: creat d10/d12/f1c x:0 0 0 2024-03-04T09:23:46.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/79: dread - d10/f14 zero size 2024-03-04T09:23:46.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/80: chown d10/c18 134427 1 2024-03-04T09:23:46.338 INFO:tasks.workunit.client.0.smithi046.stdout:3/72: rename d1/d8/de/f11 to d1/f12 0 2024-03-04T09:23:46.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/37: sync 2024-03-04T09:23:46.904 INFO:tasks.workunit.client.0.smithi046.stdout:8/41: rename c5 to d7/c10 0 2024-03-04T09:23:46.904 INFO:tasks.workunit.client.0.smithi046.stdout:8/42: getdents d7/de 0 2024-03-04T09:23:46.904 INFO:tasks.workunit.client.0.smithi046.stdout:8/43: chown c0 1346 1 2024-03-04T09:23:47.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/73: creat d1/d8/f13 x:0 0 0 2024-03-04T09:23:47.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/74: fdatasync d1/d8/fd 0 2024-03-04T09:23:47.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/75: dread - d1/d8/f13 zero size 2024-03-04T09:23:47.163 INFO:tasks.workunit.client.0.smithi046.stdout:7/38: symlink d0/da/lf 0 2024-03-04T09:23:47.427 INFO:tasks.workunit.client.0.smithi046.stdout:0/81: truncate f1 3987515 0 2024-03-04T09:23:47.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/44: creat d7/de/f11 x:0 0 0 2024-03-04T09:23:47.648 INFO:tasks.workunit.client.0.smithi046.stdout:9/64: write d1/ff [4836957,41406] 0 2024-03-04T09:23:48.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/73: creat d1/f18 x:0 0 0 2024-03-04T09:23:48.143 INFO:tasks.workunit.client.0.smithi046.stdout:7/39: creat d0/d4/db/f10 x:0 0 0 2024-03-04T09:23:48.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/82: symlink d10/d12/l1d 0 2024-03-04T09:23:48.161 INFO:tasks.workunit.client.0.smithi046.stdout:7/40: dread d0/d4/fd [0,4194304] 0 2024-03-04T09:23:48.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/45: mkdir d7/de/d12 0 2024-03-04T09:23:48.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/46: dwrite d7/de/f11 [0,4194304] 0 2024-03-04T09:23:48.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/47: fsync d7/fc 0 2024-03-04T09:23:48.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/48: fdatasync d7/fc 0 2024-03-04T09:23:48.435 INFO:tasks.workunit.client.0.smithi046.stdout:2/80: unlink d5/l11 0 2024-03-04T09:23:48.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:23:48.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:23:48.474 INFO:tasks.workunit.client.0.smithi046.stdout:6/60: dwrite da/dd/f12 [4194304,4194304] 0 2024-03-04T09:23:48.475 INFO:tasks.workunit.client.0.smithi046.stdout:6/61: write da/dd/f10 [510552,18139] 0 2024-03-04T09:23:48.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/55: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:23:48.518 INFO:tasks.workunit.client.0.smithi046.stdout:6/62: dwrite da/dd/fe [0,4194304] 0 2024-03-04T09:23:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:2/81: link d5/l16 d5/da/d1b/l1c 0 2024-03-04T09:23:49.160 INFO:tasks.workunit.client.0.smithi046.stdout:2/82: dwrite d5/da/f14 [0,4194304] 0 2024-03-04T09:23:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:5/56: mknod d1/d3/c12 0 2024-03-04T09:23:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/57: dread d1/d3/fa [0,4194304] 0 2024-03-04T09:23:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/58: chown d1/d3/de/f10 31862906 1 2024-03-04T09:23:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:5/59: chown d1 0 1 2024-03-04T09:23:50.301 INFO:tasks.workunit.client.0.smithi046.stdout:6/63: getdents da/dd 0 2024-03-04T09:23:50.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/74: rename d1/f3 to d1/f19 0 2024-03-04T09:23:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/60: mknod d1/d3/de/c13 0 2024-03-04T09:23:50.629 INFO:tasks.workunit.client.0.smithi046.stdout:4/76: rename d0/d3/d14 to d0/d3/d16/d1e 0 2024-03-04T09:23:50.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/64: creat da/dd/f13 x:0 0 0 2024-03-04T09:23:50.876 INFO:tasks.workunit.client.0.smithi046.stdout:1/75: chown d1/f12 102 1 2024-03-04T09:23:50.876 INFO:tasks.workunit.client.0.smithi046.stdout:1/76: stat d1/f19 0 2024-03-04T09:23:51.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/61: symlink d1/d3/l14 0 2024-03-04T09:23:51.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/77: mkdir d0/d1f 0 2024-03-04T09:23:51.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/62: dwrite d1/d3/fc [0,4194304] 0 2024-03-04T09:23:51.246 INFO:tasks.workunit.client.0.smithi046.stdout:5/63: dwrite d1/f5 [0,4194304] 0 2024-03-04T09:23:51.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/83: dwrite f1 [0,4194304] 0 2024-03-04T09:23:51.406 INFO:tasks.workunit.client.0.smithi046.stdout:5/64: dread d1/d3/fa [0,4194304] 0 2024-03-04T09:23:51.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/83: truncate d5/da/f14 2268226 0 2024-03-04T09:23:51.424 INFO:tasks.workunit.client.0.smithi046.stdout:6/65: mkdir da/d14 0 2024-03-04T09:23:51.749 INFO:tasks.workunit.client.0.smithi046.stdout:3/76: sync 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/65: sync 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/41: sync 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/66: getdents d1/d11/d6/d8/d12 0 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/49: sync 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/50: chown d7/lb 92966944 1 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/67: rename d1/d11 to d1/d11/d6/d8/d13/d16 22 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/51: write d7/fd [240280,7952] 0 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/52: chown d7/de 72 1 2024-03-04T09:23:51.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/77: write d1/f12 [595473,42324] 0 2024-03-04T09:23:51.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/78: fdatasync d1/f12 0 2024-03-04T09:23:51.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/79: stat d1/c6 0 2024-03-04T09:23:51.862 INFO:tasks.workunit.client.0.smithi046.stdout:0/84: symlink d10/l1e 0 2024-03-04T09:23:52.033 INFO:tasks.workunit.client.0.smithi046.stdout:1/77: unlink d1/c9 0 2024-03-04T09:23:52.122 INFO:tasks.workunit.client.0.smithi046.stdout:5/65: mknod d1/d3/c15 0 2024-03-04T09:23:52.123 INFO:tasks.workunit.client.0.smithi046.stdout:5/66: readlink d1/lf 0 2024-03-04T09:23:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:2/84: creat d5/f1d x:0 0 0 2024-03-04T09:23:52.312 INFO:tasks.workunit.client.0.smithi046.stdout:6/66: creat da/f15 x:0 0 0 2024-03-04T09:23:52.312 INFO:tasks.workunit.client.0.smithi046.stdout:6/67: stat f2 0 2024-03-04T09:23:52.312 INFO:tasks.workunit.client.0.smithi046.stdout:6/68: dread - da/f15 zero size 2024-03-04T09:23:52.312 INFO:tasks.workunit.client.0.smithi046.stdout:6/69: write da/f15 [246416,58285] 0 2024-03-04T09:23:52.493 INFO:tasks.workunit.client.0.smithi046.stdout:7/42: rename d0/d4/db/f10 to d0/f11 0 2024-03-04T09:23:52.493 INFO:tasks.workunit.client.0.smithi046.stdout:5/67: rename d1 to d1/d16 22 2024-03-04T09:23:52.493 INFO:tasks.workunit.client.0.smithi046.stdout:5/68: fsync d1/f7 0 2024-03-04T09:23:52.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/53: mkdir d7/de/d13 0 2024-03-04T09:23:52.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/54: fsync d7/fd 0 2024-03-04T09:23:52.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/78: mkdir d0/d3/d20 0 2024-03-04T09:23:53.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/85: mkdir d10/d12/d1f 0 2024-03-04T09:23:53.858 INFO:tasks.workunit.client.0.smithi046.stdout:6/70: creat da/d14/f16 x:0 0 0 2024-03-04T09:23:54.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/69: rename d1/d3/c15 to d1/d3/c17 0 2024-03-04T09:23:54.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/70: fsync d1/d3/de/f10 0 2024-03-04T09:23:54.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/55: symlink d7/de/d13/l14 0 2024-03-04T09:23:54.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/56: truncate d7/fd 470581 0 2024-03-04T09:23:54.774 INFO:tasks.workunit.client.0.smithi046.stdout:1/78: symlink d1/l1a 0 2024-03-04T09:23:55.150 INFO:tasks.workunit.client.0.smithi046.stdout:5/71: symlink d1/d3/l18 0 2024-03-04T09:23:55.151 INFO:tasks.workunit.client.0.smithi046.stdout:8/57: creat d7/de/d12/f15 x:0 0 0 2024-03-04T09:23:55.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/72: write d1/f7 [1318031,110576] 0 2024-03-04T09:23:55.199 INFO:tasks.workunit.client.0.smithi046.stdout:5/73: dread d1/f2 [0,4194304] 0 2024-03-04T09:23:55.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/80: rename d1/d8 to d1/d14 0 2024-03-04T09:23:55.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/81: fdatasync d1/f12 0 2024-03-04T09:23:55.275 INFO:tasks.workunit.client.0.smithi046.stdout:3/82: dwrite d1/d14/fd [0,4194304] 0 2024-03-04T09:23:55.275 INFO:tasks.workunit.client.0.smithi046.stdout:3/83: write d1/f9 [2627575,5818] 0 2024-03-04T09:23:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/79: creat d1/f1b x:0 0 0 2024-03-04T09:23:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/80: fdatasync d1/f19 0 2024-03-04T09:23:55.468 INFO:tasks.workunit.client.0.smithi046.stdout:6/71: getdents da 0 2024-03-04T09:23:55.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/58: symlink d7/de/d12/l16 0 2024-03-04T09:23:55.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/59: read - d7/f9 zero size 2024-03-04T09:23:55.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/60: readlink d7/de/d13/l14 0 2024-03-04T09:23:55.731 INFO:tasks.workunit.client.0.smithi046.stdout:5/74: rename d1/d3/fa to d1/d3/f19 0 2024-03-04T09:23:55.732 INFO:tasks.workunit.client.0.smithi046.stdout:5/75: write d1/f5 [4697698,69598] 0 2024-03-04T09:23:55.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/76: dread d1/f5 [0,4194304] 0 2024-03-04T09:23:55.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/77: write d1/f2 [459744,168] 0 2024-03-04T09:23:55.786 INFO:tasks.workunit.client.0.smithi046.stdout:5/78: read d1/d3/f4 [1087308,78855] 0 2024-03-04T09:23:55.787 INFO:tasks.workunit.client.0.smithi046.stdout:8/61: dwrite d7/de/d12/f15 [0,4194304] 0 2024-03-04T09:23:55.819 INFO:tasks.workunit.client.0.smithi046.stdout:3/84: mkdir d1/d14/d15 0 2024-03-04T09:23:55.819 INFO:tasks.workunit.client.0.smithi046.stdout:3/85: write d1/f12 [1560215,9097] 0 2024-03-04T09:23:55.866 INFO:tasks.workunit.client.0.smithi046.stdout:8/62: dwrite f2 [0,4194304] 0 2024-03-04T09:23:55.868 INFO:tasks.workunit.client.0.smithi046.stdout:3/86: dwrite d1/d14/fd [0,4194304] 0 2024-03-04T09:23:55.870 INFO:tasks.workunit.client.0.smithi046.stdout:3/87: fdatasync d1/f12 0 2024-03-04T09:23:56.052 INFO:tasks.workunit.client.0.smithi046.stdout:6/72: mkdir da/d14/d17 0 2024-03-04T09:23:56.265 INFO:tasks.workunit.client.0.smithi046.stdout:5/79: mknod d1/d3/de/c1a 0 2024-03-04T09:23:56.265 INFO:tasks.workunit.client.0.smithi046.stdout:5/80: truncate d1/f5 5142630 0 2024-03-04T09:23:56.369 INFO:tasks.workunit.client.0.smithi046.stdout:5/81: dwrite d1/f5 [0,4194304] 0 2024-03-04T09:23:56.411 INFO:tasks.workunit.client.0.smithi046.stdout:0/86: creat d10/f20 x:0 0 0 2024-03-04T09:23:56.412 INFO:tasks.workunit.client.0.smithi046.stdout:0/87: creat d10/d12/f21 x:0 0 0 2024-03-04T09:23:56.412 INFO:tasks.workunit.client.0.smithi046.stdout:0/88: creat d10/f22 x:0 0 0 2024-03-04T09:23:56.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/89: dread - d10/f14 zero size 2024-03-04T09:23:56.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/90: write d10/d12/f1c [363222,80344] 0 2024-03-04T09:23:56.428 INFO:tasks.workunit.client.0.smithi046.stdout:5/82: dwrite d1/d3/f19 [0,4194304] 0 2024-03-04T09:23:56.498 INFO:tasks.workunit.client.0.smithi046.stdout:5/83: dwrite d1/d3/f19 [0,4194304] 0 2024-03-04T09:23:56.531 INFO:tasks.workunit.client.0.smithi046.stdout:5/84: dread d1/f2 [0,4194304] 0 2024-03-04T09:23:56.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/85: fdatasync d1/f7 0 2024-03-04T09:23:56.757 INFO:tasks.workunit.client.0.smithi046.stdout:8/63: creat d7/de/d13/f17 x:0 0 0 2024-03-04T09:23:56.757 INFO:tasks.workunit.client.0.smithi046.stdout:2/85: rename d5/l9 to d5/da/l1e 0 2024-03-04T09:23:56.757 INFO:tasks.workunit.client.0.smithi046.stdout:8/64: creat d7/de/f18 x:0 0 0 2024-03-04T09:23:56.757 INFO:tasks.workunit.client.0.smithi046.stdout:8/65: write d7/de/f18 [270004,14914] 0 2024-03-04T09:23:56.757 INFO:tasks.workunit.client.0.smithi046.stdout:8/66: write d7/fa [1411746,27828] 0 2024-03-04T09:23:56.780 INFO:tasks.workunit.client.0.smithi046.stdout:2/86: read f4 [3185734,86967] 0 2024-03-04T09:23:56.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/81: symlink d1/l1c 0 2024-03-04T09:23:56.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/82: fsync d1/f18 0 2024-03-04T09:23:56.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/73: mknod da/d14/c18 0 2024-03-04T09:23:56.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/74: truncate da/dd/f13 270907 0 2024-03-04T09:23:56.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/75: dread f2 [0,4194304] 0 2024-03-04T09:23:57.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/91: link fe d10/d12/f23 0 2024-03-04T09:23:57.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/92: truncate d10/f20 412762 0 2024-03-04T09:23:57.114 INFO:tasks.workunit.client.0.smithi046.stdout:0/93: dwrite fa [0,4194304] 0 2024-03-04T09:23:57.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/94: dread - d10/f14 zero size 2024-03-04T09:23:57.228 INFO:tasks.workunit.client.0.smithi046.stdout:9/68: sync 2024-03-04T09:23:58.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/67: symlink d7/de/d12/l19 0 2024-03-04T09:23:58.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/87: creat d5/f1f x:0 0 0 2024-03-04T09:23:58.044 INFO:tasks.workunit.client.0.smithi046.stdout:1/83: creat d1/f1d x:0 0 0 2024-03-04T09:23:58.138 INFO:tasks.workunit.client.0.smithi046.stdout:2/88: dwrite d5/f1f [0,4194304] 0 2024-03-04T09:23:58.138 INFO:tasks.workunit.client.0.smithi046.stdout:2/89: creat d5/da/f20 x:0 0 0 2024-03-04T09:23:58.138 INFO:tasks.workunit.client.0.smithi046.stdout:2/90: creat d5/da/f21 x:0 0 0 2024-03-04T09:23:58.153 INFO:tasks.workunit.client.0.smithi046.stdout:6/76: dwrite da/dd/f12 [0,4194304] 0 2024-03-04T09:23:58.153 INFO:tasks.workunit.client.0.smithi046.stdout:6/77: write f9 [196998,18438] 0 2024-03-04T09:23:58.153 INFO:tasks.workunit.client.0.smithi046.stdout:6/78: creat da/d14/f19 x:0 0 0 2024-03-04T09:23:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/68: creat d7/f1a x:0 0 0 2024-03-04T09:23:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/69: creat d7/de/f1b x:0 0 0 2024-03-04T09:23:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/70: write d7/fc [602686,39366] 0 2024-03-04T09:23:58.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/84: chown d1/fd 2092 1 2024-03-04T09:23:58.301 INFO:tasks.workunit.client.0.smithi046.stdout:1/85: dwrite d1/f19 [0,4194304] 0 2024-03-04T09:23:58.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/79: sync 2024-03-04T09:23:58.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/43: sync 2024-03-04T09:23:58.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/80: fdatasync d0/f15 0 2024-03-04T09:23:58.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/81: readlink d0/d3/d16/le 0 2024-03-04T09:23:58.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/44: write d0/d4/f5 [200547,8686] 0 2024-03-04T09:23:59.141 INFO:tasks.workunit.client.0.smithi046.stdout:5/86: sync 2024-03-04T09:23:59.316 INFO:tasks.workunit.client.0.smithi046.stdout:3/88: rename d1/d14/cf to d1/c16 0 2024-03-04T09:23:59.317 INFO:tasks.workunit.client.0.smithi046.stdout:0/95: rename d10/d12/d1f to d10/d12/d1f/d24 22 2024-03-04T09:23:59.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/91: mknod d5/da/d1b/c22 0 2024-03-04T09:23:59.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/69: rename d1/d11 to d1/d11/d17 22 2024-03-04T09:23:59.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/70: dread - d1/d11/fa zero size 2024-03-04T09:23:59.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/92: creat d5/da/f23 x:0 0 0 2024-03-04T09:23:59.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/93: dwrite d5/f13 [0,4194304] 0 2024-03-04T09:23:59.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/94: read d5/da/f14 [4570,64950] 0 2024-03-04T09:23:59.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/95: write d5/f10 [2072442,93214] 0 2024-03-04T09:23:59.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/96: creat d5/da/f24 x:0 0 0 2024-03-04T09:23:59.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/97: chown d5/da/f14 28377776 1 2024-03-04T09:23:59.441 INFO:tasks.workunit.client.0.smithi046.stdout:0/96: dwrite fc [0,4194304] 0 2024-03-04T09:23:59.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/97: write f7 [3235856,105146] 0 2024-03-04T09:23:59.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/98: chown ff 14361999 1 2024-03-04T09:23:59.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/99: write ff [1396420,43198] 0 2024-03-04T09:23:59.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/98: dwrite d5/f1d [0,4194304] 0 2024-03-04T09:23:59.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/99: chown d5/da/f17 22 1 2024-03-04T09:23:59.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/82: getdents d0/d3 0 2024-03-04T09:23:59.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/86: stat d1/c16 0 2024-03-04T09:23:59.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/87: fdatasync d1/f17 0 2024-03-04T09:23:59.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/83: truncate d0/d3/f6 4983806 0 2024-03-04T09:23:59.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/84: write d0/d3/d16/d17/f1b [904110,111055] 0 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:7/45: mkdir d0/d4/db/d12 0 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:7/46: readlink d0/d4/l8 0 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:7/47: fdatasync d0/f11 0 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/87: creat d1/f1b x:0 0 0 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/88: chown d1/d3/de/c1a 0 1 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/89: read - d1/f1b zero size 2024-03-04T09:23:59.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/90: chown d1/f1b 10041 1 2024-03-04T09:24:00.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/89: unlink d1/c3 0 2024-03-04T09:24:00.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/90: chown d1/d14/de 38 1 2024-03-04T09:24:00.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/85: dwrite d0/d3/d16/f1a [4194304,4194304] 0 2024-03-04T09:24:00.027 INFO:tasks.workunit.client.0.smithi046.stdout:5/91: dread d1/f7 [0,4194304] 0 2024-03-04T09:24:00.042 INFO:tasks.workunit.client.0.smithi046.stdout:9/71: creat d1/d11/f18 x:0 0 0 2024-03-04T09:24:00.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/48: dwrite d0/d4/fd [0,4194304] 0 2024-03-04T09:24:00.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/49: read d0/f9 [558996,100480] 0 2024-03-04T09:24:00.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/100: symlink d10/d12/d1f/l25 0 2024-03-04T09:24:00.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/101: write fe [79849,115223] 0 2024-03-04T09:24:00.411 INFO:tasks.workunit.client.0.smithi046.stdout:2/100: rename d5/f7 to d5/da/d1b/f25 0 2024-03-04T09:24:00.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/79: mkdir da/dd/d1a 0 2024-03-04T09:24:00.414 INFO:tasks.workunit.client.0.smithi046.stdout:1/88: creat d1/f1e x:0 0 0 2024-03-04T09:24:00.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/101: dread d5/f13 [0,4194304] 0 2024-03-04T09:24:00.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/102: write d5/fd [2372443,41079] 0 2024-03-04T09:24:00.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/91: link d1/c7 d1/d14/c17 0 2024-03-04T09:24:00.913 INFO:tasks.workunit.client.0.smithi046.stdout:3/92: dwrite d1/f12 [0,4194304] 0 2024-03-04T09:24:00.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/93: write d1/f12 [1560732,65515] 0 2024-03-04T09:24:01.747 INFO:tasks.workunit.client.0.smithi046.stdout:0/102: rename d10/f11 to d10/f26 0 2024-03-04T09:24:02.001 INFO:tasks.workunit.client.0.smithi046.stdout:4/86: rename d0/d3/fa to d0/d3/d20/f21 0 2024-03-04T09:24:02.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/87: read d0/f11 [2788861,37378] 0 2024-03-04T09:24:02.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/88: dwrite d0/d3/d16/f1a [0,4194304] 0 2024-03-04T09:24:02.141 INFO:tasks.workunit.client.0.smithi046.stdout:4/89: dwrite d0/d3/d16/f1a [0,4194304] 0 2024-03-04T09:24:02.282 INFO:tasks.workunit.client.0.smithi046.stdout:2/103: link d5/da/l1e d5/da/l26 0 2024-03-04T09:24:02.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/94: creat d1/d14/de/f18 x:0 0 0 2024-03-04T09:24:02.736 INFO:tasks.workunit.client.0.smithi046.stdout:8/71: rmdir d7 39 2024-03-04T09:24:02.739 INFO:tasks.workunit.client.0.smithi046.stdout:8/72: write d7/fd [63321,7795] 0 2024-03-04T09:24:02.739 INFO:tasks.workunit.client.0.smithi046.stdout:8/73: fdatasync d7/f9 0 2024-03-04T09:24:02.740 INFO:tasks.workunit.client.0.smithi046.stdout:8/74: truncate d7/de/f18 409502 0 2024-03-04T09:24:02.834 INFO:tasks.workunit.client.0.smithi046.stdout:0/103: creat d10/d12/d1f/f27 x:0 0 0 2024-03-04T09:24:02.909 INFO:tasks.workunit.client.0.smithi046.stdout:0/104: dwrite d10/d12/d1f/f27 [0,4194304] 0 2024-03-04T09:24:02.909 INFO:tasks.workunit.client.0.smithi046.stdout:0/105: readlink d10/d12/d1f/l25 0 2024-03-04T09:24:03.093 INFO:tasks.workunit.client.0.smithi046.stdout:7/50: rename d0/da/lc to d0/d4/db/l13 0 2024-03-04T09:24:03.125 INFO:tasks.workunit.client.0.smithi046.stdout:7/51: dread d0/d4/f5 [0,4194304] 0 2024-03-04T09:24:03.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/80: link da/dd/fe da/d14/d17/f1b 0 2024-03-04T09:24:03.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/92: sync 2024-03-04T09:24:03.353 INFO:tasks.workunit.client.0.smithi046.stdout:9/72: sync 2024-03-04T09:24:03.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/73: dread d1/d11/d6/d8/fd [0,4194304] 0 2024-03-04T09:24:03.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/74: chown d1/d11/cc 864981874 1 2024-03-04T09:24:03.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/75: write d1/d11/d6/d8/f15 [844309,9335] 0 2024-03-04T09:24:03.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/90: mknod d0/d3/d16/d17/c22 0 2024-03-04T09:24:03.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/89: mknod d1/c1f 0 2024-03-04T09:24:03.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/104: mknod d5/da/c27 0 2024-03-04T09:24:03.941 INFO:tasks.workunit.client.0.smithi046.stdout:2/105: write d5/ff [797965,23479] 0 2024-03-04T09:24:03.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/95: symlink d1/d14/de/l19 0 2024-03-04T09:24:04.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/75: getdents d7/de/d13 0 2024-03-04T09:24:04.101 INFO:tasks.workunit.client.0.smithi046.stdout:8/76: write d7/fc [89207,106799] 0 2024-03-04T09:24:04.102 INFO:tasks.workunit.client.0.smithi046.stdout:8/77: write d7/fd [963804,85583] 0 2024-03-04T09:24:04.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/78: write f2 [309293,129241] 0 2024-03-04T09:24:04.822 INFO:tasks.workunit.client.0.smithi046.stdout:6/81: rmdir da/dd/d1a 0 2024-03-04T09:24:05.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/76: creat d1/d11/d6/d8/d12/f19 x:0 0 0 2024-03-04T09:24:05.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/77: creat d1/d11/d6/d8/f1a x:0 0 0 2024-03-04T09:24:05.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/78: chown d1/d11/d6/d8/ce 12152920 1 2024-03-04T09:24:05.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/91: dread d0/d3/f6 [4194304,4194304] 0 2024-03-04T09:24:05.274 INFO:tasks.workunit.client.0.smithi046.stdout:1/90: chown d1/fc 255 1 2024-03-04T09:24:05.274 INFO:tasks.workunit.client.0.smithi046.stdout:1/91: dread - d1/f1b zero size 2024-03-04T09:24:05.908 INFO:tasks.workunit.client.0.smithi046.stdout:3/96: link d1/c16 d1/c1a 0 2024-03-04T09:24:06.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/79: mknod d7/de/d13/c1c 0 2024-03-04T09:24:06.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/80: chown d7/de/d12/l19 67 1 2024-03-04T09:24:06.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/81: write d7/f1a [823781,79836] 0 2024-03-04T09:24:06.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/82: stat f2 0 2024-03-04T09:24:06.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/52: rename d0/d4/db/l13 to d0/d4/l14 0 2024-03-04T09:24:06.669 INFO:tasks.workunit.client.0.smithi046.stdout:9/79: getdents d1/d11/d6 0 2024-03-04T09:24:06.669 INFO:tasks.workunit.client.0.smithi046.stdout:9/80: truncate d1/d11/d6/d8/f1a 677377 0 2024-03-04T09:24:06.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/81: write d1/d11/d6/d8/f1a [475352,70812] 0 2024-03-04T09:24:06.837 INFO:tasks.workunit.client.0.smithi046.stdout:4/92: mkdir d0/d3/d23 0 2024-03-04T09:24:07.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/92: dwrite d1/f4 [0,4194304] 0 2024-03-04T09:24:07.175 INFO:tasks.workunit.client.0.smithi046.stdout:0/106: symlink d10/l28 0 2024-03-04T09:24:07.192 INFO:tasks.workunit.client.0.smithi046.stdout:0/107: dread f7 [0,4194304] 0 2024-03-04T09:24:07.192 INFO:tasks.workunit.client.0.smithi046.stdout:0/108: chown d10/d12/f1b 320988 1 2024-03-04T09:24:07.739 INFO:tasks.workunit.client.0.smithi046.stdout:2/106: getdents d5/da 0 2024-03-04T09:24:07.830 INFO:tasks.workunit.client.0.smithi046.stdout:3/97: rmdir d1/d14/d15 0 2024-03-04T09:24:07.830 INFO:tasks.workunit.client.0.smithi046.stdout:3/98: readlink d1/d14/de/l19 0 2024-03-04T09:24:07.992 INFO:tasks.workunit.client.0.smithi046.stdout:8/83: rename d7/de/d12/l19 to d7/de/l1d 0 2024-03-04T09:24:07.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/53: rename d0/d4 to d0/d4/db/d12/d15 22 2024-03-04T09:24:07.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/54: truncate d0/f11 302257 0 2024-03-04T09:24:07.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/55: chown d0 0 1 2024-03-04T09:24:08.084 INFO:tasks.workunit.client.0.smithi046.stdout:8/84: dwrite d7/de/f11 [4194304,4194304] 0 2024-03-04T09:24:08.242 INFO:tasks.workunit.client.0.smithi046.stdout:6/82: mknod da/dd/c1c 0 2024-03-04T09:24:08.243 INFO:tasks.workunit.client.0.smithi046.stdout:5/93: rmdir d1/d3 39 2024-03-04T09:24:08.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/93: symlink d0/d3/dc/l24 0 2024-03-04T09:24:08.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/82: symlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:24:08.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/93: readlink d1/l10 0 2024-03-04T09:24:08.710 INFO:tasks.workunit.client.0.smithi046.stdout:2/107: mkdir d5/da/d28 0 2024-03-04T09:24:08.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/94: readlink d1/l10 0 2024-03-04T09:24:08.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/95: dread - d1/f1b zero size 2024-03-04T09:24:08.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/96: fdatasync d1/f18 0 2024-03-04T09:24:08.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/109: rename d10/c18 to d10/d12/c29 0 2024-03-04T09:24:08.724 INFO:tasks.workunit.client.0.smithi046.stdout:5/94: link d1/lf d1/d3/de/l1c 0 2024-03-04T09:24:08.738 INFO:tasks.workunit.client.0.smithi046.stdout:5/95: dread d1/d3/f19 [0,4194304] 0 2024-03-04T09:24:09.108 INFO:tasks.workunit.client.0.smithi046.stdout:4/94: getdents d0/d3/d20 0 2024-03-04T09:24:09.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/83: mkdir d1/d11/d6/d8/d12/d1c 0 2024-03-04T09:24:09.136 INFO:tasks.workunit.client.0.smithi046.stdout:2/108: chown d5/da/f20 54900 1 2024-03-04T09:24:09.153 INFO:tasks.workunit.client.0.smithi046.stdout:1/97: write d1/f7 [2910636,68249] 0 2024-03-04T09:24:09.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/56: rmdir d0/d4/db 39 2024-03-04T09:24:09.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/98: dread d1/fc [0,4194304] 0 2024-03-04T09:24:09.233 INFO:tasks.workunit.client.0.smithi046.stdout:5/96: mkdir d1/d3/de/d1d 0 2024-03-04T09:24:09.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/95: mkdir d0/d1f/d25 0 2024-03-04T09:24:09.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/84: mkdir d1/d11/d6/d8/d1d 0 2024-03-04T09:24:09.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/85: fsync d1/d11/f18 0 2024-03-04T09:24:09.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/86: creat d1/d11/d6/d8/d12/f1e x:0 0 0 2024-03-04T09:24:09.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/87: read - d1/d11/f18 zero size 2024-03-04T09:24:09.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/88: creat d1/d11/d6/d8/f1f x:0 0 0 2024-03-04T09:24:09.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/109: write d5/da/f17 [720019,117425] 0 2024-03-04T09:24:09.729 INFO:tasks.workunit.client.0.smithi046.stdout:0/110: truncate d10/f26 1807738 0 2024-03-04T09:24:09.730 INFO:tasks.workunit.client.0.smithi046.stdout:0/111: creat d10/d12/f2a x:0 0 0 2024-03-04T09:24:09.730 INFO:tasks.workunit.client.0.smithi046.stdout:0/112: fdatasync d10/d12/f21 0 2024-03-04T09:24:09.754 INFO:tasks.workunit.client.0.smithi046.stdout:0/113: write fa [4137756,104334] 0 2024-03-04T09:24:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:8/85: truncate f2 2345044 0 2024-03-04T09:24:09.911 INFO:tasks.workunit.client.0.smithi046.stdout:8/86: write d7/f1a [800022,95716] 0 2024-03-04T09:24:10.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/97: mknod d1/d3/c1e 0 2024-03-04T09:24:10.392 INFO:tasks.workunit.client.0.smithi046.stdout:4/96: creat d0/d1f/d25/f26 x:0 0 0 2024-03-04T09:24:10.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/89: mkdir d1/d11/d6/d8/d1d/d20 0 2024-03-04T09:24:10.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/110: creat d5/f29 x:0 0 0 2024-03-04T09:24:11.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/114: symlink d10/d12/l2b 0 2024-03-04T09:24:11.348 INFO:tasks.workunit.client.0.smithi046.stdout:1/99: symlink d1/l20 0 2024-03-04T09:24:11.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/87: mkdir d7/de/d1e 0 2024-03-04T09:24:11.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/88: chown d7/fa 47 1 2024-03-04T09:24:11.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/89: write d7/de/f1b [807486,99511] 0 2024-03-04T09:24:11.616 INFO:tasks.workunit.client.0.smithi046.stdout:8/90: dwrite d7/f9 [0,4194304] 0 2024-03-04T09:24:11.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/98: getdents d1 0 2024-03-04T09:24:11.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/90: mkdir d1/d11/d6/d8/d13/d21 0 2024-03-04T09:24:11.912 INFO:tasks.workunit.client.0.smithi046.stdout:9/91: dread d1/ff [0,4194304] 0 2024-03-04T09:24:11.920 INFO:tasks.workunit.client.0.smithi046.stdout:2/111: truncate d5/f1f 3766155 0 2024-03-04T09:24:11.920 INFO:tasks.workunit.client.0.smithi046.stdout:2/112: getdents d5/da/d28 0 2024-03-04T09:24:12.380 INFO:tasks.workunit.client.0.smithi046.stdout:0/115: mkdir d10/d2c 0 2024-03-04T09:24:12.403 INFO:tasks.workunit.client.0.smithi046.stdout:0/116: dread f9 [0,4194304] 0 2024-03-04T09:24:12.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/100: creat d1/f21 x:0 0 0 2024-03-04T09:24:12.457 INFO:tasks.workunit.client.0.smithi046.stdout:1/101: dread d1/f19 [0,4194304] 0 2024-03-04T09:24:13.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/99: unlink d1/d3/de/c1a 0 2024-03-04T09:24:13.370 INFO:tasks.workunit.client.0.smithi046.stdout:9/92: unlink d1/d11/d6/d8/f15 0 2024-03-04T09:24:13.370 INFO:tasks.workunit.client.0.smithi046.stdout:9/93: write d1/d11/d6/d8/d12/f1e [29509,61993] 0 2024-03-04T09:24:13.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/94: write d1/ff [1479528,24187] 0 2024-03-04T09:24:13.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/95: stat d1 0 2024-03-04T09:24:13.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/96: write d1/d11/f18 [902717,107107] 0 2024-03-04T09:24:13.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/113: chown d5/da/f21 30 1 2024-03-04T09:24:13.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/117: rmdir d10/d2c 0 2024-03-04T09:24:13.719 INFO:tasks.workunit.client.0.smithi046.stdout:1/102: creat d1/f22 x:0 0 0 2024-03-04T09:24:13.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/118: chown d10/d12/d1f/f27 46 1 2024-03-04T09:24:13.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/119: stat d10/l1e 0 2024-03-04T09:24:13.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/120: dread f7 [0,4194304] 0 2024-03-04T09:24:13.896 INFO:tasks.workunit.client.0.smithi046.stdout:5/100: mkdir d1/d3/d1f 0 2024-03-04T09:24:14.146 INFO:tasks.workunit.client.0.smithi046.stdout:9/97: link d1/d11/d6/d8/f1a d1/d11/d6/d8/d1d/f22 0 2024-03-04T09:24:14.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/57: creat d0/f16 x:0 0 0 2024-03-04T09:24:14.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/58: chown d0/d4/f5 142 1 2024-03-04T09:24:14.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/59: stat d0/d4/fd 0 2024-03-04T09:24:14.146 INFO:tasks.workunit.client.0.smithi046.stdout:9/98: write d1/d11/d6/d8/d12/f1e [689840,89456] 0 2024-03-04T09:24:14.559 INFO:tasks.workunit.client.0.smithi046.stdout:5/101: mkdir d1/d3/de/d20 0 2024-03-04T09:24:14.559 INFO:tasks.workunit.client.0.smithi046.stdout:5/102: write d1/f1b [129217,18778] 0 2024-03-04T09:24:14.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/60: unlink d0/f9 0 2024-03-04T09:24:15.079 INFO:tasks.workunit.client.0.smithi046.stdout:3/99: rename d1/f12 to d1/d14/de/f1b 0 2024-03-04T09:24:15.130 INFO:tasks.workunit.client.0.smithi046.stdout:3/100: dwrite d1/d14/f13 [0,4194304] 0 2024-03-04T09:24:15.192 INFO:tasks.workunit.client.0.smithi046.stdout:3/101: dwrite d1/f9 [0,4194304] 0 2024-03-04T09:24:15.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/99: mknod d1/d11/d6/d8/d1d/c23 0 2024-03-04T09:24:15.333 INFO:tasks.workunit.client.0.smithi046.stdout:5/103: creat d1/d3/f21 x:0 0 0 2024-03-04T09:24:15.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/61: link d0/da/lf d0/d4/db/d12/l17 0 2024-03-04T09:24:15.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/91: truncate f2 189995 0 2024-03-04T09:24:15.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/92: write d7/fc [841566,14344] 0 2024-03-04T09:24:15.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/93: fdatasync d7/f9 0 2024-03-04T09:24:15.823 INFO:tasks.workunit.client.0.smithi046.stdout:3/102: creat d1/f1c x:0 0 0 2024-03-04T09:24:15.851 INFO:tasks.workunit.client.0.smithi046.stdout:3/103: write d1/d14/fd [2050417,94758] 0 2024-03-04T09:24:15.851 INFO:tasks.workunit.client.0.smithi046.stdout:3/104: truncate d1/d14/f13 4838592 0 2024-03-04T09:24:15.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/105: dwrite d1/f1c [0,4194304] 0 2024-03-04T09:24:16.163 INFO:tasks.workunit.client.0.smithi046.stdout:5/104: mknod d1/d3/de/c22 0 2024-03-04T09:24:16.163 INFO:tasks.workunit.client.0.smithi046.stdout:5/105: read - d1/d3/f21 zero size 2024-03-04T09:24:16.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/114: rmdir d5 39 2024-03-04T09:24:16.246 INFO:tasks.workunit.client.0.smithi046.stdout:5/106: dwrite d1/d3/f4 [0,4194304] 0 2024-03-04T09:24:16.246 INFO:tasks.workunit.client.0.smithi046.stdout:5/107: creat d1/d3/f23 x:0 0 0 2024-03-04T09:24:16.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/62: mknod d0/c18 0 2024-03-04T09:24:16.829 INFO:tasks.workunit.client.0.smithi046.stdout:6/83: rename da/f15 to da/dd/f1d 0 2024-03-04T09:24:16.830 INFO:tasks.workunit.client.0.smithi046.stdout:7/63: dread d0/d4/f5 [0,4194304] 0 2024-03-04T09:24:16.830 INFO:tasks.workunit.client.0.smithi046.stdout:7/64: truncate d0/f16 190259 0 2024-03-04T09:24:16.909 INFO:tasks.workunit.client.0.smithi046.stdout:7/65: dwrite d0/d4/f5 [0,4194304] 0 2024-03-04T09:24:16.928 INFO:tasks.workunit.client.0.smithi046.stdout:7/66: dread d0/f11 [0,4194304] 0 2024-03-04T09:24:16.977 INFO:tasks.workunit.client.0.smithi046.stdout:7/67: dwrite d0/d4/fd [0,4194304] 0 2024-03-04T09:24:16.998 INFO:tasks.workunit.client.0.smithi046.stdout:7/68: dread d0/d4/fd [0,4194304] 0 2024-03-04T09:24:17.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/69: dwrite d0/d4/f5 [0,4194304] 0 2024-03-04T09:24:17.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/106: mkdir d1/d1d 0 2024-03-04T09:24:17.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/107: truncate d1/d14/de/f18 819525 0 2024-03-04T09:24:17.298 INFO:tasks.workunit.client.0.smithi046.stdout:1/103: dwrite d1/fc [0,4194304] 0 2024-03-04T09:24:17.371 INFO:tasks.workunit.client.0.smithi046.stdout:0/121: write d10/f26 [1658947,43181] 0 2024-03-04T09:24:17.461 INFO:tasks.workunit.client.0.smithi046.stdout:0/122: dwrite fc [4194304,4194304] 0 2024-03-04T09:24:17.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/108: mkdir d1/d3/de/d1d/d24 0 2024-03-04T09:24:18.002 INFO:tasks.workunit.client.0.smithi046.stdout:9/100: rmdir d1/d11 39 2024-03-04T09:24:18.513 INFO:tasks.workunit.client.0.smithi046.stdout:4/97: rename d0/d3/c8 to d0/c27 0 2024-03-04T09:24:18.522 INFO:tasks.workunit.client.0.smithi046.stdout:4/98: write d0/d3/d16/d17/f1b [159816,119086] 0 2024-03-04T09:24:18.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:24:18.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:24:18.585 INFO:tasks.workunit.client.0.smithi046.stdout:6/84: mkdir da/d14/d1e 0 2024-03-04T09:24:18.585 INFO:tasks.workunit.client.0.smithi046.stdout:6/85: fdatasync da/dd/f1d 0 2024-03-04T09:24:18.630 INFO:tasks.workunit.client.0.smithi046.stdout:6/86: dwrite da/d14/d17/f1b [0,4194304] 0 2024-03-04T09:24:18.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/70: creat d0/d4/f19 x:0 0 0 2024-03-04T09:24:18.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/71: truncate d0/d4/f19 218290 0 2024-03-04T09:24:18.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/72: write d0/d4/f5 [470649,102956] 0 2024-03-04T09:24:18.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/73: write d0/d4/f5 [4449088,9661] 0 2024-03-04T09:24:18.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/74: dread d0/f16 [0,4194304] 0 2024-03-04T09:24:19.134 INFO:tasks.workunit.client.0.smithi046.stdout:1/104: creat d1/f23 x:0 0 0 2024-03-04T09:24:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/108: dwrite d1/f1c [4194304,4194304] 0 2024-03-04T09:24:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/109: creat d1/f1e x:0 0 0 2024-03-04T09:24:20.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/101: rmdir d1/d11/d6/d8/d1d/d20 0 2024-03-04T09:24:20.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/102: dread - d1/d11/d6/d8/f1f zero size 2024-03-04T09:24:20.576 INFO:tasks.workunit.client.0.smithi046.stdout:9/103: dwrite d1/d11/d6/d8/d1d/f22 [0,4194304] 0 2024-03-04T09:24:20.608 INFO:tasks.workunit.client.0.smithi046.stdout:9/104: dread d1/d11/d6/d8/d1d/f22 [0,4194304] 0 2024-03-04T09:24:20.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/105: write d1/d11/d6/d8/f1a [923017,43285] 0 2024-03-04T09:24:20.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/99: symlink d0/l28 0 2024-03-04T09:24:20.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/100: dwrite d0/d1f/d25/f26 [0,4194304] 0 2024-03-04T09:24:20.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/87: mknod da/d14/d1e/c1f 0 2024-03-04T09:24:21.155 INFO:tasks.workunit.client.0.smithi046.stdout:7/75: symlink d0/d4/db/l1a 0 2024-03-04T09:24:21.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/105: creat d1/f24 x:0 0 0 2024-03-04T09:24:21.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/106: truncate d1/f1d 332473 0 2024-03-04T09:24:21.626 INFO:tasks.workunit.client.0.smithi046.stdout:3/110: creat d1/d14/f1f x:0 0 0 2024-03-04T09:24:21.626 INFO:tasks.workunit.client.0.smithi046.stdout:3/111: fdatasync d1/d14/de/f1b 0 2024-03-04T09:24:21.852 INFO:tasks.workunit.client.0.smithi046.stdout:2/115: rename d5/da/l18 to d5/da/d1b/l2a 0 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:8/94: unlink d7/l8 0 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:2/116: fdatasync d5/f10 0 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:8/95: fsync d7/fc 0 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:4/101: rename d0/d3/dc to d0/d3/dc/d29 22 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:4/102: chown d0/d3/dc/c1d 287 1 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:8/96: write d7/f1a [791496,105778] 0 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:4/103: write d0/f15 [971863,128996] 0 2024-03-04T09:24:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:4/104: stat d0/d3/d16/d1e/f1c 0 2024-03-04T09:24:21.882 INFO:tasks.workunit.client.0.smithi046.stdout:2/117: dread f3 [0,4194304] 0 2024-03-04T09:24:22.045 INFO:tasks.workunit.client.0.smithi046.stdout:9/106: link d1/d11/d6/d8/d12/f1e d1/d11/d6/d8/d13/f24 0 2024-03-04T09:24:22.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/107: creat d1/f25 x:0 0 0 2024-03-04T09:24:22.717 INFO:tasks.workunit.client.0.smithi046.stdout:6/88: rename da/cb to da/d14/c20 0 2024-03-04T09:24:22.868 INFO:tasks.workunit.client.0.smithi046.stdout:8/97: dwrite d7/de/f18 [0,4194304] 0 2024-03-04T09:24:24.000 INFO:tasks.workunit.client.0.smithi046.stdout:5/109: sync 2024-03-04T09:24:24.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/123: sync 2024-03-04T09:24:24.111 INFO:tasks.workunit.client.0.smithi046.stdout:2/118: unlink d5/da/d1b/c22 0 2024-03-04T09:24:24.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/107: creat d1/d11/d6/d8/d13/f25 x:0 0 0 2024-03-04T09:24:24.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/108: getdents d1/d11/d6 0 2024-03-04T09:24:24.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/109: readlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:24:24.505 INFO:tasks.workunit.client.0.smithi046.stdout:9/110: dread d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:24:24.521 INFO:tasks.workunit.client.0.smithi046.stdout:9/111: dread d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:24:24.521 INFO:tasks.workunit.client.0.smithi046.stdout:9/112: chown d1/d11/d6/d8/d13/f24 19690096 1 2024-03-04T09:24:24.656 INFO:tasks.workunit.client.0.smithi046.stdout:7/76: unlink d0/d4/f19 0 2024-03-04T09:24:24.656 INFO:tasks.workunit.client.0.smithi046.stdout:7/77: chown d0/f16 153609684 1 2024-03-04T09:24:25.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/89: unlink da/d14/f16 0 2024-03-04T09:24:25.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/98: rmdir d7/de/d1e 0 2024-03-04T09:24:25.998 INFO:tasks.workunit.client.0.smithi046.stdout:4/105: sync 2024-03-04T09:24:26.055 INFO:tasks.workunit.client.0.smithi046.stdout:5/110: stat d1/d3/c17 0 2024-03-04T09:24:26.089 INFO:tasks.workunit.client.0.smithi046.stdout:4/106: dwrite d0/d1f/d25/f26 [4194304,4194304] 0 2024-03-04T09:24:26.106 INFO:tasks.workunit.client.0.smithi046.stdout:4/107: dread d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:24:26.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/124: mkdir d10/d12/d1f/d2d 0 2024-03-04T09:24:26.247 INFO:tasks.workunit.client.0.smithi046.stdout:2/119: dread - d5/da/f24 zero size 2024-03-04T09:24:26.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/113: mkdir d1/d11/d6/d8/d12/d1c/d26 0 2024-03-04T09:24:26.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/114: write d1/d11/d6/d8/d13/f25 [99450,82406] 0 2024-03-04T09:24:26.974 INFO:tasks.workunit.client.0.smithi046.stdout:7/78: stat d0/da/lf 0 2024-03-04T09:24:26.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/108: symlink d1/l26 0 2024-03-04T09:24:27.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/79: dwrite d0/d4/fd [0,4194304] 0 2024-03-04T09:24:27.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/80: dwrite d0/d4/fd [0,4194304] 0 2024-03-04T09:24:27.225 INFO:tasks.workunit.client.0.smithi046.stdout:6/90: symlink da/d14/d17/l21 0 2024-03-04T09:24:27.284 INFO:tasks.workunit.client.0.smithi046.stdout:6/91: dwrite da/dd/f12 [0,4194304] 0 2024-03-04T09:24:27.284 INFO:tasks.workunit.client.0.smithi046.stdout:6/92: chown da/d14/d1e 0 1 2024-03-04T09:24:27.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/99: creat d7/de/f1f x:0 0 0 2024-03-04T09:24:27.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/108: getdents d0 0 2024-03-04T09:24:27.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/125: link d10/d12/f1b d10/f2e 0 2024-03-04T09:24:27.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/115: creat d1/d11/f27 x:0 0 0 2024-03-04T09:24:27.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/116: getdents d1/d11/d6/d8/d13/d21 0 2024-03-04T09:24:27.832 INFO:tasks.workunit.client.0.smithi046.stdout:9/117: dwrite d1/d11/d6/d8/d1d/f22 [0,4194304] 0 2024-03-04T09:24:27.832 INFO:tasks.workunit.client.0.smithi046.stdout:9/118: truncate d1/d11/d6/d8/d13/f25 220638 0 2024-03-04T09:24:28.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/81: mknod d0/c1b 0 2024-03-04T09:24:28.609 INFO:tasks.workunit.client.0.smithi046.stdout:0/126: creat d10/f2f x:0 0 0 2024-03-04T09:24:28.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/119: unlink d1/d11/f18 0 2024-03-04T09:24:28.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/120: chown d1/d11/d6/d8/d12 965669767 1 2024-03-04T09:24:28.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/121: dwrite d1/d11/f27 [0,4194304] 0 2024-03-04T09:24:28.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/122: readlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:24:28.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/123: truncate d1/d11/f7 6785952 0 2024-03-04T09:24:28.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/124: fsync d1/d11/d6/d8/d1d/f22 0 2024-03-04T09:24:28.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/125: write d1/d11/d6/d8/d12/f19 [1032069,62467] 0 2024-03-04T09:24:28.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/112: rename d1/d14/fd to d1/f20 0 2024-03-04T09:24:28.721 INFO:tasks.workunit.client.0.smithi046.stdout:0/127: dwrite d10/d12/f1c [0,4194304] 0 2024-03-04T09:24:28.771 INFO:tasks.workunit.client.0.smithi046.stdout:9/126: dwrite d1/d11/d6/d8/d13/f25 [0,4194304] 0 2024-03-04T09:24:28.776 INFO:tasks.workunit.client.0.smithi046.stdout:9/127: fdatasync d1/d11/d6/d8/d12/f19 0 2024-03-04T09:24:28.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/128: chown d1/d11/d6/d8/d13/f25 214686 1 2024-03-04T09:24:29.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/82: link d0/c18 d0/d4/db/d12/c1c 0 2024-03-04T09:24:29.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/100: rename d7/de/d13/c1c to d7/de/d13/c20 0 2024-03-04T09:24:29.586 INFO:tasks.workunit.client.0.smithi046.stdout:3/113: stat d1/l10 0 2024-03-04T09:24:29.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/114: dread d1/f20 [0,4194304] 0 2024-03-04T09:24:29.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/111: rename d1/c6 to d1/d3/de/d20/c25 0 2024-03-04T09:24:29.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/112: write d1/d3/fc [4801696,50817] 0 2024-03-04T09:24:29.626 INFO:tasks.workunit.client.0.smithi046.stdout:4/109: dwrite d0/d3/f6 [0,4194304] 0 2024-03-04T09:24:29.626 INFO:tasks.workunit.client.0.smithi046.stdout:4/110: readlink d0/l28 0 2024-03-04T09:24:29.626 INFO:tasks.workunit.client.0.smithi046.stdout:4/111: truncate d0/d3/f4 4301402 0 2024-03-04T09:24:29.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/112: read d0/d3/d16/f10 [74786,72256] 0 2024-03-04T09:24:29.638 INFO:tasks.workunit.client.0.smithi046.stdout:4/113: read d0/f15 [802522,66891] 0 2024-03-04T09:24:29.982 INFO:tasks.workunit.client.0.smithi046.stdout:0/128: creat d10/d12/d1f/d2d/f30 x:0 0 0 2024-03-04T09:24:29.982 INFO:tasks.workunit.client.0.smithi046.stdout:1/109: link d1/fe d1/f27 0 2024-03-04T09:24:29.988 INFO:tasks.workunit.client.0.smithi046.stdout:1/110: write d1/fd [720476,90147] 0 2024-03-04T09:24:29.988 INFO:tasks.workunit.client.0.smithi046.stdout:3/115: mkdir d1/d21 0 2024-03-04T09:24:29.992 INFO:tasks.workunit.client.0.smithi046.stdout:5/113: mkdir d1/d3/de/d26 0 2024-03-04T09:24:30.578 INFO:tasks.workunit.client.0.smithi046.stdout:6/93: truncate da/dd/f12 2120520 0 2024-03-04T09:24:30.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/129: mknod d10/d12/d1f/c31 0 2024-03-04T09:24:31.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/83: rmdir d0/d4 39 2024-03-04T09:24:31.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/84: truncate d0/f16 257848 0 2024-03-04T09:24:31.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/85: dread d0/f11 [0,4194304] 0 2024-03-04T09:24:31.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/86: write d0/d4/f5 [5319263,106984] 0 2024-03-04T09:24:31.086 INFO:tasks.workunit.client.0.smithi046.stdout:7/87: dread d0/d4/f5 [0,4194304] 0 2024-03-04T09:24:31.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/120: rename d5/f29 to d5/da/f2b 0 2024-03-04T09:24:31.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/114: link d1/d3/c12 d1/d3/de/d26/c27 0 2024-03-04T09:24:31.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/115: fdatasync d1/f1b 0 2024-03-04T09:24:31.486 INFO:tasks.workunit.client.0.smithi046.stdout:5/116: fdatasync d1/f5 0 2024-03-04T09:24:31.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/117: read d1/d3/f4 [3688354,3098] 0 2024-03-04T09:24:31.542 INFO:tasks.workunit.client.0.smithi046.stdout:5/118: dread d1/f5 [4194304,4194304] 0 2024-03-04T09:24:32.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/88: rmdir d0/d4/db/d12 39 2024-03-04T09:24:32.742 INFO:tasks.workunit.client.0.smithi046.stdout:9/129: rename d1/d11/d6/d8/c14 to d1/d11/d6/d8/d12/d1c/d26/c28 0 2024-03-04T09:24:32.760 INFO:tasks.workunit.client.0.smithi046.stdout:7/89: write d0/d4/f5 [3013238,130879] 0 2024-03-04T09:24:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:9/130: dwrite d1/d11/f27 [0,4194304] 0 2024-03-04T09:24:32.953 INFO:tasks.workunit.client.0.smithi046.stdout:1/111: dwrite d1/fa [0,4194304] 0 2024-03-04T09:24:32.953 INFO:tasks.workunit.client.0.smithi046.stdout:1/112: fsync d1/f23 0 2024-03-04T09:24:32.953 INFO:tasks.workunit.client.0.smithi046.stdout:1/113: write d1/f24 [996319,48908] 0 2024-03-04T09:24:32.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/94: mkdir da/dd/d22 0 2024-03-04T09:24:32.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/95: chown da/dd/c1c 0 1 2024-03-04T09:24:33.079 INFO:tasks.workunit.client.0.smithi046.stdout:8/101: rmdir d7/de 39 2024-03-04T09:24:33.079 INFO:tasks.workunit.client.0.smithi046.stdout:8/102: dread - d7/de/f1f zero size 2024-03-04T09:24:33.164 INFO:tasks.workunit.client.0.smithi046.stdout:7/90: creat d0/d4/db/d12/f1d x:0 0 0 2024-03-04T09:24:33.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/116: dwrite d1/d14/de/f18 [0,4194304] 0 2024-03-04T09:24:33.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/117: fsync d1/f1e 0 2024-03-04T09:24:33.307 INFO:tasks.workunit.client.0.smithi046.stdout:9/131: creat d1/d11/d6/d8/d12/f29 x:0 0 0 2024-03-04T09:24:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/118: write d1/d14/de/f18 [2477706,99982] 0 2024-03-04T09:24:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/119: chown d1/d14/f1f 309 1 2024-03-04T09:24:33.386 INFO:tasks.workunit.client.0.smithi046.stdout:9/132: dwrite d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:24:33.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/119: getdents d1/d3/de 0 2024-03-04T09:24:33.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/121: mkdir d5/d2c 0 2024-03-04T09:24:33.600 INFO:tasks.workunit.client.0.smithi046.stdout:2/122: write f4 [3677075,86391] 0 2024-03-04T09:24:33.903 INFO:tasks.workunit.client.0.smithi046.stdout:4/114: truncate d0/d3/f6 3385512 0 2024-03-04T09:24:33.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/96: write da/dd/f10 [1095375,83164] 0 2024-03-04T09:24:33.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/97: write da/dd/f1d [317327,50091] 0 2024-03-04T09:24:33.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/98: chown da/d14/d1e 48333398 1 2024-03-04T09:24:33.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/99: chown da/d14/c18 0 1 2024-03-04T09:24:33.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/100: fdatasync da/dd/f13 0 2024-03-04T09:24:34.150 INFO:tasks.workunit.client.0.smithi046.stdout:8/103: rename d7/de/f11 to d7/de/f21 0 2024-03-04T09:24:34.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/104: write d7/f9 [3076780,113022] 0 2024-03-04T09:24:34.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/91: symlink d0/d4/db/d12/l1e 0 2024-03-04T09:24:34.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/92: read d0/d4/fd [165348,9408] 0 2024-03-04T09:24:34.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/120: rename d1/d14/lb to d1/d21/l22 0 2024-03-04T09:24:34.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/121: chown d1/c6 83517 1 2024-03-04T09:24:34.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/122: read - d1/f1e zero size 2024-03-04T09:24:34.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/123: dwrite d1/d14/de/f1b [0,4194304] 0 2024-03-04T09:24:34.630 INFO:tasks.workunit.client.0.smithi046.stdout:3/124: dread d1/d14/de/f1b [0,4194304] 0 2024-03-04T09:24:34.630 INFO:tasks.workunit.client.0.smithi046.stdout:3/125: rename d1/d1d to d1/d1d/d23 22 2024-03-04T09:24:34.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/126: read d1/f9 [2389179,67726] 0 2024-03-04T09:24:35.063 INFO:tasks.workunit.client.0.smithi046.stdout:9/133: mknod d1/d11/d6/d8/c2a 0 2024-03-04T09:24:35.063 INFO:tasks.workunit.client.0.smithi046.stdout:9/134: write d1/d11/d6/d8/d12/f29 [787619,40042] 0 2024-03-04T09:24:35.063 INFO:tasks.workunit.client.0.smithi046.stdout:9/135: readlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:24:35.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/120: stat d1/d3/de/l1c 0 2024-03-04T09:24:35.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/121: write d1/f1b [372175,55364] 0 2024-03-04T09:24:35.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/122: truncate d1/f1b 1408748 0 2024-03-04T09:24:35.257 INFO:tasks.workunit.client.0.smithi046.stdout:2/123: mknod d5/da/d1b/c2d 0 2024-03-04T09:24:35.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/114: mkdir d1/d28 0 2024-03-04T09:24:35.479 INFO:tasks.workunit.client.0.smithi046.stdout:4/115: rmdir d0/d3/d23 0 2024-03-04T09:24:35.783 INFO:tasks.workunit.client.0.smithi046.stdout:6/101: link c6 da/d14/c23 0 2024-03-04T09:24:36.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/130: sync 2024-03-04T09:24:36.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/102: dwrite da/dd/f13 [0,4194304] 0 2024-03-04T09:24:36.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/103: write da/dd/f1d [599504,125309] 0 2024-03-04T09:24:36.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/104: write da/dd/f1d [1522455,10127] 0 2024-03-04T09:24:37.072 INFO:tasks.workunit.client.0.smithi046.stdout:9/136: mknod d1/d11/d6/c2b 0 2024-03-04T09:24:37.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/137: dwrite d1/d11/d6/d8/d13/f24 [4194304,4194304] 0 2024-03-04T09:24:37.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/138: fdatasync d1/d11/d6/d8/f1a 0 2024-03-04T09:24:37.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/139: write d1/d11/fa [181297,102263] 0 2024-03-04T09:24:37.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/105: symlink d7/de/l22 0 2024-03-04T09:24:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:7/93: rmdir d0 39 2024-03-04T09:24:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/124: creat d5/d2c/f2e x:0 0 0 2024-03-04T09:24:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:7/94: fsync d0/d4/fd 0 2024-03-04T09:24:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/125: fdatasync d5/da/f21 0 2024-03-04T09:24:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:7/95: chown d0/f11 618968835 1 2024-03-04T09:24:38.535 INFO:tasks.workunit.client.0.smithi046.stdout:1/115: mknod d1/d28/c29 0 2024-03-04T09:24:38.536 INFO:tasks.workunit.client.0.smithi046.stdout:1/116: chown d1 107 1 2024-03-04T09:24:38.540 INFO:tasks.workunit.client.0.smithi046.stdout:1/117: write d1/f24 [730500,38277] 0 2024-03-04T09:24:38.693 INFO:tasks.workunit.client.0.smithi046.stdout:4/116: symlink d0/d1f/l2a 0 2024-03-04T09:24:38.713 INFO:tasks.workunit.client.0.smithi046.stdout:4/117: dread d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:24:38.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/118: dread d0/d3/d16/d1e/f1c [0,4194304] 0 2024-03-04T09:24:38.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/131: dread fe [0,4194304] 0 2024-03-04T09:24:38.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/132: creat d10/d12/d1f/d2d/f32 x:0 0 0 2024-03-04T09:24:38.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/133: creat d10/d12/d1f/d2d/f33 x:0 0 0 2024-03-04T09:24:38.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/134: chown fc 198091 1 2024-03-04T09:24:39.190 INFO:tasks.workunit.client.0.smithi046.stdout:6/105: chown da/dd/c11 840624952 1 2024-03-04T09:24:39.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/140: rename d1/d11/fa to d1/d11/d6/d8/d13/f2c 0 2024-03-04T09:24:39.377 INFO:tasks.workunit.client.0.smithi046.stdout:8/106: unlink d7/f9 0 2024-03-04T09:24:39.504 INFO:tasks.workunit.client.0.smithi046.stdout:2/126: write d5/da/f23 [259793,26379] 0 2024-03-04T09:24:39.587 INFO:tasks.workunit.client.0.smithi046.stdout:2/127: dwrite f4 [0,4194304] 0 2024-03-04T09:24:39.588 INFO:tasks.workunit.client.0.smithi046.stdout:2/128: stat f4 0 2024-03-04T09:24:39.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/118: mkdir d1/d28/d2a 0 2024-03-04T09:24:39.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/119: write d1/f25 [1011998,130494] 0 2024-03-04T09:24:39.888 INFO:tasks.workunit.client.0.smithi046.stdout:4/119: creat d0/d3/d16/d1e/f2b x:0 0 0 2024-03-04T09:24:39.924 INFO:tasks.workunit.client.0.smithi046.stdout:4/120: write d0/d1f/d25/f26 [2059598,61383] 0 2024-03-04T09:24:39.924 INFO:tasks.workunit.client.0.smithi046.stdout:4/121: truncate d0/d3/d16/f10 1450786 0 2024-03-04T09:24:39.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/122: dread d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:24:39.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/123: read - d0/d3/d16/d1e/f2b zero size 2024-03-04T09:24:39.962 INFO:tasks.workunit.client.0.smithi046.stdout:4/124: read d0/d3/f6 [1384294,10852] 0 2024-03-04T09:24:40.158 INFO:tasks.workunit.client.0.smithi046.stdout:3/127: rename d1/d14/de to d1/d14/d24 0 2024-03-04T09:24:40.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/135: symlink d10/d12/d1f/l34 0 2024-03-04T09:24:40.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/136: fdatasync d10/f14 0 2024-03-04T09:24:40.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/137: readlink d10/d12/l13 0 2024-03-04T09:24:40.735 INFO:tasks.workunit.client.0.smithi046.stdout:6/106: rmdir da/d14/d17 39 2024-03-04T09:24:40.952 INFO:tasks.workunit.client.0.smithi046.stdout:9/141: rmdir d1/d11/d6/d8/d12/d1c/d26 39 2024-03-04T09:24:40.986 INFO:tasks.workunit.client.0.smithi046.stdout:9/142: write d1/d11/f27 [3633292,21063] 0 2024-03-04T09:24:40.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/107: dread d7/de/f21 [0,4194304] 0 2024-03-04T09:24:40.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/108: write d7/fa [1526546,93087] 0 2024-03-04T09:24:41.025 INFO:tasks.workunit.client.0.smithi046.stdout:9/143: dread d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:24:41.045 INFO:tasks.workunit.client.0.smithi046.stdout:9/144: write d1/d11/d6/d8/d1d/f22 [2732984,67282] 0 2024-03-04T09:24:41.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/129: creat d5/da/d28/f2f x:0 0 0 2024-03-04T09:24:41.231 INFO:tasks.workunit.client.0.smithi046.stdout:2/130: dwrite d5/fb [0,4194304] 0 2024-03-04T09:24:41.462 INFO:tasks.workunit.client.0.smithi046.stdout:1/120: unlink d1/f22 0 2024-03-04T09:24:41.462 INFO:tasks.workunit.client.0.smithi046.stdout:7/96: link d0/d4/db/d12/f1d d0/d4/f1f 0 2024-03-04T09:24:41.462 INFO:tasks.workunit.client.0.smithi046.stdout:1/121: read - d1/f21 zero size 2024-03-04T09:24:41.462 INFO:tasks.workunit.client.0.smithi046.stdout:7/97: creat d0/d4/db/d12/f20 x:0 0 0 2024-03-04T09:24:41.491 INFO:tasks.workunit.client.0.smithi046.stdout:1/122: write d1/fa [1962715,98668] 0 2024-03-04T09:24:41.491 INFO:tasks.workunit.client.0.smithi046.stdout:1/123: fdatasync d1/f18 0 2024-03-04T09:24:41.491 INFO:tasks.workunit.client.0.smithi046.stdout:1/124: stat d1/fc 0 2024-03-04T09:24:41.569 INFO:tasks.workunit.client.0.smithi046.stdout:1/125: dwrite d1/fa [0,4194304] 0 2024-03-04T09:24:41.569 INFO:tasks.workunit.client.0.smithi046.stdout:1/126: getdents d1/d28/d2a 0 2024-03-04T09:24:41.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/127: dwrite d1/fa [0,4194304] 0 2024-03-04T09:24:41.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/128: dread d1/f25 [0,4194304] 0 2024-03-04T09:24:41.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/129: read - d1/f1e zero size 2024-03-04T09:24:41.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/130: fdatasync d1/f24 0 2024-03-04T09:24:42.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/123: sync 2024-03-04T09:24:42.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/124: readlink d1/lf 0 2024-03-04T09:24:42.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/128: link d1/d14/d24/l19 d1/d14/d24/l25 0 2024-03-04T09:24:42.154 INFO:tasks.workunit.client.0.smithi046.stdout:0/138: mknod d10/d12/d1f/c35 0 2024-03-04T09:24:42.218 INFO:tasks.workunit.client.0.smithi046.stdout:0/139: dwrite fd [0,4194304] 0 2024-03-04T09:24:42.218 INFO:tasks.workunit.client.0.smithi046.stdout:0/140: fdatasync d10/f2f 0 2024-03-04T09:24:42.245 INFO:tasks.workunit.client.0.smithi046.stdout:6/107: dread f5 [0,4194304] 0 2024-03-04T09:24:42.245 INFO:tasks.workunit.client.0.smithi046.stdout:6/108: fsync da/dd/f10 0 2024-03-04T09:24:42.249 INFO:tasks.workunit.client.0.smithi046.stdout:6/109: write da/dd/f10 [917025,22001] 0 2024-03-04T09:24:42.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/145: unlink d1/d11/d6/d8/d1d/f22 0 2024-03-04T09:24:42.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/146: readlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:24:42.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/147: read d1/d11/f27 [581331,35408] 0 2024-03-04T09:24:42.638 INFO:tasks.workunit.client.0.smithi046.stdout:2/131: creat d5/da/d1b/f30 x:0 0 0 2024-03-04T09:24:42.639 INFO:tasks.workunit.client.0.smithi046.stdout:2/132: chown d5/da/f17 34696 1 2024-03-04T09:24:43.220 INFO:tasks.workunit.client.0.smithi046.stdout:7/98: truncate d0/f16 262671 0 2024-03-04T09:24:43.314 INFO:tasks.workunit.client.0.smithi046.stdout:7/99: dwrite d0/d4/db/d12/f20 [0,4194304] 0 2024-03-04T09:24:43.355 INFO:tasks.workunit.client.0.smithi046.stdout:4/125: rename d0/d3/d16/d1e/f2b to d0/d1f/f2c 0 2024-03-04T09:24:43.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/126: read d0/d3/d16/d1e/f1c [445725,103388] 0 2024-03-04T09:24:43.430 INFO:tasks.workunit.client.0.smithi046.stdout:1/131: getdents d1/d28 0 2024-03-04T09:24:43.430 INFO:tasks.workunit.client.0.smithi046.stdout:1/132: chown d1/f1d 75 1 2024-03-04T09:24:43.585 INFO:tasks.workunit.client.0.smithi046.stdout:3/129: mkdir d1/d21/d26 0 2024-03-04T09:24:43.585 INFO:tasks.workunit.client.0.smithi046.stdout:8/109: creat d7/f23 x:0 0 0 2024-03-04T09:24:43.779 INFO:tasks.workunit.client.0.smithi046.stdout:0/141: mkdir d10/d36 0 2024-03-04T09:24:43.920 INFO:tasks.workunit.client.0.smithi046.stdout:6/110: mknod da/d14/c24 0 2024-03-04T09:24:43.920 INFO:tasks.workunit.client.0.smithi046.stdout:6/111: chown da/dd/f13 4 1 2024-03-04T09:24:44.081 INFO:tasks.workunit.client.0.smithi046.stdout:9/148: mknod d1/d11/d6/d8/d12/d1c/d26/c2d 0 2024-03-04T09:24:44.081 INFO:tasks.workunit.client.0.smithi046.stdout:9/149: write d1/d11/d6/d8/d12/f29 [1445411,106499] 0 2024-03-04T09:24:44.210 INFO:tasks.workunit.client.0.smithi046.stdout:2/133: readlink l0 0 2024-03-04T09:24:44.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/100: unlink d0/d4/l14 0 2024-03-04T09:24:44.652 INFO:tasks.workunit.client.0.smithi046.stdout:5/125: rename d1/d3/f21 to d1/d3/de/d26/f28 0 2024-03-04T09:24:44.652 INFO:tasks.workunit.client.0.smithi046.stdout:9/150: rename d1 to d1/d11/d6/d8/d13/d2e 22 2024-03-04T09:24:44.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/151: write d1/d11/d6/d8/d12/f19 [602253,50349] 0 2024-03-04T09:24:44.726 INFO:tasks.workunit.client.0.smithi046.stdout:5/126: dwrite d1/f2 [0,4194304] 0 2024-03-04T09:24:44.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/127: creat d0/f2d x:0 0 0 2024-03-04T09:24:44.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/128: write d0/d3/d20/f21 [1891499,34999] 0 2024-03-04T09:24:44.767 INFO:tasks.workunit.client.0.smithi046.stdout:4/129: dread d0/d3/d20/f21 [0,4194304] 0 2024-03-04T09:24:44.767 INFO:tasks.workunit.client.0.smithi046.stdout:4/130: chown d0/d3/d16/le 970 1 2024-03-04T09:24:44.767 INFO:tasks.workunit.client.0.smithi046.stdout:4/131: read d0/d3/d16/d17/f1b [560506,120265] 0 2024-03-04T09:24:44.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/133: creat d1/f2b x:0 0 0 2024-03-04T09:24:44.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/134: chown d1/f4 1825840 1 2024-03-04T09:24:44.885 INFO:tasks.workunit.client.0.smithi046.stdout:3/130: mkdir d1/d1d/d27 0 2024-03-04T09:24:45.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/110: truncate d7/de/d13/f17 150635 0 2024-03-04T09:24:45.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/111: write d7/fa [1559089,79949] 0 2024-03-04T09:24:45.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/112: fdatasync d7/de/d12/f15 0 2024-03-04T09:24:45.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/142: symlink d10/d12/d1f/l37 0 2024-03-04T09:24:45.344 INFO:tasks.workunit.client.0.smithi046.stdout:2/134: stat d5/da/f14 0 2024-03-04T09:24:45.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/101: mknod d0/da/c21 0 2024-03-04T09:24:46.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/127: creat d1/d3/f29 x:0 0 0 2024-03-04T09:24:46.488 INFO:tasks.workunit.client.0.smithi046.stdout:3/131: getdents d1/d14/d24 0 2024-03-04T09:24:46.488 INFO:tasks.workunit.client.0.smithi046.stdout:3/132: fsync d1/f1c 0 2024-03-04T09:24:46.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/133: dread d1/d14/d24/f1b [0,4194304] 0 2024-03-04T09:24:46.617 INFO:tasks.workunit.client.0.smithi046.stdout:8/113: mkdir d7/d24 0 2024-03-04T09:24:46.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/143: symlink d10/d12/l38 0 2024-03-04T09:24:46.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/144: chown f1 606 1 2024-03-04T09:24:46.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/135: mknod d5/da/d28/c31 0 2024-03-04T09:24:46.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/152: rename d1/d11/d6/d8/f1f to d1/d11/f2f 0 2024-03-04T09:24:47.110 INFO:tasks.workunit.client.0.smithi046.stdout:7/102: mknod d0/d4/db/d12/c22 0 2024-03-04T09:24:47.110 INFO:tasks.workunit.client.0.smithi046.stdout:7/103: fdatasync d0/d4/f5 0 2024-03-04T09:24:47.561 INFO:tasks.workunit.client.0.smithi046.stdout:6/112: symlink da/l25 0 2024-03-04T09:24:47.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/113: dwrite da/d14/f19 [0,4194304] 0 2024-03-04T09:24:47.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/114: getdents da/dd/d22 0 2024-03-04T09:24:47.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/145: mknod d10/d12/d1f/d2d/c39 0 2024-03-04T09:24:47.810 INFO:tasks.workunit.client.0.smithi046.stdout:3/134: creat d1/d14/d24/f28 x:0 0 0 2024-03-04T09:24:47.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/135: dread d1/d14/f13 [0,4194304] 0 2024-03-04T09:24:48.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/132: rename d0/cb to d0/d3/d16/d1e/c2e 0 2024-03-04T09:24:48.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/133: stat d0/f2d 0 2024-03-04T09:24:48.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/134: dread - d0/f2d zero size 2024-03-04T09:24:48.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/136: symlink d5/da/d1b/l32 0 2024-03-04T09:24:48.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/135: dwrite d0/d3/d20/f21 [0,4194304] 0 2024-03-04T09:24:48.163 INFO:tasks.workunit.client.0.smithi046.stdout:9/153: dread d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:24:48.266 INFO:tasks.workunit.client.0.smithi046.stdout:7/104: mknod d0/c23 0 2024-03-04T09:24:48.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:24:48.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:24:49.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/135: rmdir d1/d28/d2a 0 2024-03-04T09:24:49.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/136: dread - d1/f23 zero size 2024-03-04T09:24:49.371 INFO:tasks.workunit.client.0.smithi046.stdout:0/146: creat d10/d36/f3a x:0 0 0 2024-03-04T09:24:49.371 INFO:tasks.workunit.client.0.smithi046.stdout:3/136: mkdir d1/d14/d24/d29 0 2024-03-04T09:24:49.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/137: dwrite d1/d14/f1f [0,4194304] 0 2024-03-04T09:24:49.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/138: fsync d1/f9 0 2024-03-04T09:24:49.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/139: chown d1/d14/d24/f1b 330 1 2024-03-04T09:24:49.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/140: truncate d1/d14/d24/f28 349039 0 2024-03-04T09:24:49.432 INFO:tasks.workunit.client.0.smithi046.stdout:1/137: dwrite d1/f2b [0,4194304] 0 2024-03-04T09:24:49.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/141: dwrite d1/d14/d24/f18 [0,4194304] 0 2024-03-04T09:24:49.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/142: chown d1/c16 1 1 2024-03-04T09:24:49.494 INFO:tasks.workunit.client.0.smithi046.stdout:5/128: rename d1/lf to d1/d3/de/d1d/l2a 0 2024-03-04T09:24:49.724 INFO:tasks.workunit.client.0.smithi046.stdout:4/136: truncate d0/d3/f4 1225516 0 2024-03-04T09:24:49.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/154: creat d1/d11/d6/d8/d12/f30 x:0 0 0 2024-03-04T09:24:49.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/105: mknod d0/c24 0 2024-03-04T09:24:49.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/147: mkdir d10/d12/d1f/d3b 0 2024-03-04T09:24:49.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/148: fsync fc 0 2024-03-04T09:24:49.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/149: write f7 [1539160,119990] 0 2024-03-04T09:24:49.790 INFO:tasks.workunit.client.0.smithi046.stdout:0/150: dwrite d10/f22 [0,4194304] 0 2024-03-04T09:24:50.283 INFO:tasks.workunit.client.0.smithi046.stdout:1/138: truncate d1/f1d 1241172 0 2024-03-04T09:24:50.297 INFO:tasks.workunit.client.0.smithi046.stdout:1/139: dread d1/f12 [0,4194304] 0 2024-03-04T09:24:50.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/114: rename d7/de/d13/c20 to d7/de/c25 0 2024-03-04T09:24:50.529 INFO:tasks.workunit.client.0.smithi046.stdout:8/115: dwrite d7/f23 [0,4194304] 0 2024-03-04T09:24:50.626 INFO:tasks.workunit.client.0.smithi046.stdout:4/137: mknod d0/d1f/d25/c2f 0 2024-03-04T09:24:50.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/155: creat d1/d11/d6/d8/d12/d1c/f31 x:0 0 0 2024-03-04T09:24:50.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/156: readlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:24:51.338 INFO:tasks.workunit.client.0.smithi046.stdout:6/115: truncate da/dd/f10 292136 0 2024-03-04T09:24:51.407 INFO:tasks.workunit.client.0.smithi046.stdout:6/116: dwrite f9 [0,4194304] 0 2024-03-04T09:24:51.407 INFO:tasks.workunit.client.0.smithi046.stdout:6/117: chown da 276 1 2024-03-04T09:24:51.458 INFO:tasks.workunit.client.0.smithi046.stdout:1/140: symlink d1/d28/l2c 0 2024-03-04T09:24:51.767 INFO:tasks.workunit.client.0.smithi046.stdout:0/151: fsync d10/d36/f3a 0 2024-03-04T09:24:53.068 INFO:tasks.workunit.client.0.smithi046.stdout:9/157: link d1/d11/d6/d8/d12/l1b d1/l32 0 2024-03-04T09:24:53.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/118: creat da/d14/d1e/f26 x:0 0 0 2024-03-04T09:24:54.017 INFO:tasks.workunit.client.0.smithi046.stdout:6/119: mkdir da/d14/d1e/d27 0 2024-03-04T09:24:54.017 INFO:tasks.workunit.client.0.smithi046.stdout:1/141: truncate d1/f17 58559 0 2024-03-04T09:24:54.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/142: dwrite d1/f18 [0,4194304] 0 2024-03-04T09:24:54.385 INFO:tasks.workunit.client.0.smithi046.stdout:6/120: mknod da/dd/d22/c28 0 2024-03-04T09:24:54.794 INFO:tasks.workunit.client.0.smithi046.stdout:1/143: creat d1/f2d x:0 0 0 2024-03-04T09:24:55.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/137: rename d5/fb to d5/d2c/f33 0 2024-03-04T09:24:55.560 INFO:tasks.workunit.client.0.smithi046.stdout:5/129: rename d1/d3/de/d1d/d24 to d1/d3/de/d1d/d24/d2b 22 2024-03-04T09:24:55.560 INFO:tasks.workunit.client.0.smithi046.stdout:5/130: fdatasync d1/f5 0 2024-03-04T09:24:55.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/116: dwrite d7/de/f21 [0,4194304] 0 2024-03-04T09:24:55.653 INFO:tasks.workunit.client.0.smithi046.stdout:8/117: dwrite d7/de/d12/f15 [0,4194304] 0 2024-03-04T09:24:55.653 INFO:tasks.workunit.client.0.smithi046.stdout:8/118: fsync d7/de/f18 0 2024-03-04T09:24:55.724 INFO:tasks.workunit.client.0.smithi046.stdout:2/138: symlink d5/da/d1b/l34 0 2024-03-04T09:24:55.770 INFO:tasks.workunit.client.0.smithi046.stdout:5/131: creat d1/d3/de/d1d/d24/f2c x:0 0 0 2024-03-04T09:24:55.771 INFO:tasks.workunit.client.0.smithi046.stdout:5/132: write d1/d3/de/f10 [894027,76577] 0 2024-03-04T09:24:55.928 INFO:tasks.workunit.client.0.smithi046.stdout:7/106: rename d0/d4/db/d12/f20 to d0/d4/db/f25 0 2024-03-04T09:24:56.093 INFO:tasks.workunit.client.0.smithi046.stdout:8/119: dread d7/de/d13/f17 [0,4194304] 0 2024-03-04T09:24:56.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/120: dread d7/de/f18 [0,4194304] 0 2024-03-04T09:24:56.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/121: fsync d7/fc 0 2024-03-04T09:24:56.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/122: fsync d7/fc 0 2024-03-04T09:24:56.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/123: readlink d7/de/d12/l16 0 2024-03-04T09:24:56.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/124: fsync d7/de/f1f 0 2024-03-04T09:24:56.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/125: fdatasync d7/de/d13/f17 0 2024-03-04T09:24:56.164 INFO:tasks.workunit.client.0.smithi046.stdout:2/139: unlink c2 0 2024-03-04T09:24:56.164 INFO:tasks.workunit.client.0.smithi046.stdout:2/140: creat d5/da/d28/f35 x:0 0 0 2024-03-04T09:24:56.435 INFO:tasks.workunit.client.0.smithi046.stdout:3/143: unlink d1/f9 0 2024-03-04T09:24:56.435 INFO:tasks.workunit.client.0.smithi046.stdout:5/133: truncate d1/f7 2884419 0 2024-03-04T09:24:56.436 INFO:tasks.workunit.client.0.smithi046.stdout:5/134: write d1/d3/de/f10 [1742475,44201] 0 2024-03-04T09:24:56.471 INFO:tasks.workunit.client.0.smithi046.stdout:3/144: dread d1/d14/f13 [0,4194304] 0 2024-03-04T09:24:56.550 INFO:tasks.workunit.client.0.smithi046.stdout:3/145: dwrite d1/d14/d24/f1b [0,4194304] 0 2024-03-04T09:24:56.550 INFO:tasks.workunit.client.0.smithi046.stdout:3/146: write d1/d14/f13 [5630628,45206] 0 2024-03-04T09:24:56.550 INFO:tasks.workunit.client.0.smithi046.stdout:3/147: readlink d1/d21/l22 0 2024-03-04T09:24:56.575 INFO:tasks.workunit.client.0.smithi046.stdout:3/148: dread d1/d14/d24/f1b [0,4194304] 0 2024-03-04T09:24:56.616 INFO:tasks.workunit.client.0.smithi046.stdout:3/149: dwrite d1/d14/f1f [0,4194304] 0 2024-03-04T09:24:56.849 INFO:tasks.workunit.client.0.smithi046.stdout:7/107: getdents d0/d4 0 2024-03-04T09:24:56.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/152: rename d10/d12/f23 to d10/d12/d1f/d2d/f3c 0 2024-03-04T09:24:56.878 INFO:tasks.workunit.client.0.smithi046.stdout:8/126: mknod d7/d24/c26 0 2024-03-04T09:24:56.879 INFO:tasks.workunit.client.0.smithi046.stdout:2/141: truncate d5/fd 545472 0 2024-03-04T09:24:56.879 INFO:tasks.workunit.client.0.smithi046.stdout:2/142: chown d5/da/f23 3311 1 2024-03-04T09:24:56.903 INFO:tasks.workunit.client.0.smithi046.stdout:2/143: dread d5/f13 [0,4194304] 0 2024-03-04T09:24:56.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/135: mknod d1/d3/de/d1d/d24/c2d 0 2024-03-04T09:24:56.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/136: dwrite d1/d3/de/f10 [0,4194304] 0 2024-03-04T09:24:56.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/137: readlink d1/d3/l18 0 2024-03-04T09:24:57.010 INFO:tasks.workunit.client.0.smithi046.stdout:5/138: dread d1/d3/de/f10 [0,4194304] 0 2024-03-04T09:24:57.010 INFO:tasks.workunit.client.0.smithi046.stdout:5/139: chown d1/d3/c1e 1354 1 2024-03-04T09:24:57.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/108: rmdir d0/d4/db 39 2024-03-04T09:24:57.356 INFO:tasks.workunit.client.0.smithi046.stdout:3/150: creat d1/d14/f2a x:0 0 0 2024-03-04T09:24:57.371 INFO:tasks.workunit.client.0.smithi046.stdout:2/144: link d5/d2c/f33 d5/da/d1b/f36 0 2024-03-04T09:24:57.388 INFO:tasks.workunit.client.0.smithi046.stdout:5/140: creat d1/d3/de/d1d/f2e x:0 0 0 2024-03-04T09:24:57.417 INFO:tasks.workunit.client.0.smithi046.stdout:5/141: dread d1/f1b [0,4194304] 0 2024-03-04T09:24:57.425 INFO:tasks.workunit.client.0.smithi046.stdout:3/151: dwrite d1/d14/d24/f1b [4194304,4194304] 0 2024-03-04T09:24:57.425 INFO:tasks.workunit.client.0.smithi046.stdout:3/152: chown d1/d14/f1f 4408871 1 2024-03-04T09:24:57.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/158: sync 2024-03-04T09:24:57.632 INFO:tasks.workunit.client.0.smithi046.stdout:4/138: sync 2024-03-04T09:24:57.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/159: dwrite d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:24:57.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/160: write d1/d11/f2f [644210,524] 0 2024-03-04T09:24:57.998 INFO:tasks.workunit.client.0.smithi046.stdout:6/121: rename f2 to da/dd/f29 0 2024-03-04T09:24:57.998 INFO:tasks.workunit.client.0.smithi046.stdout:6/122: chown da/l25 11 1 2024-03-04T09:24:57.998 INFO:tasks.workunit.client.0.smithi046.stdout:7/109: readlink d0/d4/l8 0 2024-03-04T09:24:58.008 INFO:tasks.workunit.client.0.smithi046.stdout:2/145: symlink d5/da/d1b/l37 0 2024-03-04T09:24:58.010 INFO:tasks.workunit.client.0.smithi046.stdout:5/142: rename d1/d3/l18 to d1/d3/l2f 0 2024-03-04T09:24:58.010 INFO:tasks.workunit.client.0.smithi046.stdout:4/139: symlink d0/d3/dc/l30 0 2024-03-04T09:24:58.010 INFO:tasks.workunit.client.0.smithi046.stdout:4/140: chown d0/d3/d20 7008339 1 2024-03-04T09:24:58.083 INFO:tasks.workunit.client.0.smithi046.stdout:4/141: dwrite d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:24:58.498 INFO:tasks.workunit.client.0.smithi046.stdout:0/153: rmdir d10 39 2024-03-04T09:24:58.647 INFO:tasks.workunit.client.0.smithi046.stdout:9/161: write d1/d11/d6/d8/d13/f2c [601663,3839] 0 2024-03-04T09:24:58.647 INFO:tasks.workunit.client.0.smithi046.stdout:1/144: rename d1/fa to d1/d28/f2e 0 2024-03-04T09:24:58.677 INFO:tasks.workunit.client.0.smithi046.stdout:5/143: mknod d1/d3/de/d26/c30 0 2024-03-04T09:24:58.678 INFO:tasks.workunit.client.0.smithi046.stdout:7/110: dread - d0/d4/db/d12/f1d zero size 2024-03-04T09:24:58.678 INFO:tasks.workunit.client.0.smithi046.stdout:7/111: chown d0/d4/db/l1a 54 1 2024-03-04T09:24:59.218 INFO:tasks.workunit.client.0.smithi046.stdout:4/142: dread d0/d3/d16/f1a [4194304,4194304] 0 2024-03-04T09:24:59.448 INFO:tasks.workunit.client.0.smithi046.stdout:9/162: unlink d1/d11/d6/d8/d12/f19 0 2024-03-04T09:24:59.551 INFO:tasks.workunit.client.0.smithi046.stdout:6/123: rmdir da/d14 39 2024-03-04T09:24:59.551 INFO:tasks.workunit.client.0.smithi046.stdout:6/124: chown c1 1062 1 2024-03-04T09:24:59.779 INFO:tasks.workunit.client.0.smithi046.stdout:5/144: creat d1/d3/d1f/f31 x:0 0 0 2024-03-04T09:24:59.779 INFO:tasks.workunit.client.0.smithi046.stdout:5/145: read - d1/d3/f29 zero size 2024-03-04T09:24:59.779 INFO:tasks.workunit.client.0.smithi046.stdout:5/146: write d1/d3/de/f10 [4348925,45758] 0 2024-03-04T09:24:59.811 INFO:tasks.workunit.client.0.smithi046.stdout:4/143: mknod d0/d3/c31 0 2024-03-04T09:24:59.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/112: write d0/d4/f5 [6278317,39130] 0 2024-03-04T09:24:59.962 INFO:tasks.workunit.client.0.smithi046.stdout:8/127: rename d7/de/d13/l14 to d7/l27 0 2024-03-04T09:25:00.110 INFO:tasks.workunit.client.0.smithi046.stdout:1/145: rmdir d1 39 2024-03-04T09:25:00.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/146: sync 2024-03-04T09:25:00.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/163: unlink d1/d11/f2f 0 2024-03-04T09:25:00.201 INFO:tasks.workunit.client.0.smithi046.stdout:9/164: fsync d1/d11/d6/d8/d12/f29 0 2024-03-04T09:25:00.201 INFO:tasks.workunit.client.0.smithi046.stdout:9/165: write d1/d11/d6/d8/d12/d1c/f31 [3764,58904] 0 2024-03-04T09:25:00.239 INFO:tasks.workunit.client.0.smithi046.stdout:6/125: getdents da/d14/d1e 0 2024-03-04T09:25:00.239 INFO:tasks.workunit.client.0.smithi046.stdout:6/126: readlink da/l25 0 2024-03-04T09:25:00.250 INFO:tasks.workunit.client.0.smithi046.stdout:9/166: dwrite d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:25:00.305 INFO:tasks.workunit.client.0.smithi046.stdout:4/144: symlink d0/d3/d20/l32 0 2024-03-04T09:25:00.305 INFO:tasks.workunit.client.0.smithi046.stdout:4/145: truncate d0/d1f/f2c 671901 0 2024-03-04T09:25:00.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/113: truncate d0/d4/db/f25 3928765 0 2024-03-04T09:25:00.651 INFO:tasks.workunit.client.0.smithi046.stdout:3/153: rename d1/d14/d24/d29 to d1/d14/d2b 0 2024-03-04T09:25:00.655 INFO:tasks.workunit.client.0.smithi046.stdout:8/128: mkdir d7/de/d28 0 2024-03-04T09:25:00.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/127: stat c6 0 2024-03-04T09:25:00.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/167: creat d1/d11/d6/d8/f33 x:0 0 0 2024-03-04T09:25:00.839 INFO:tasks.workunit.client.0.smithi046.stdout:4/146: rmdir d0/d3/d16 39 2024-03-04T09:25:01.172 INFO:tasks.workunit.client.0.smithi046.stdout:7/114: getdents d0/da 0 2024-03-04T09:25:01.172 INFO:tasks.workunit.client.0.smithi046.stdout:0/154: rename d10/f16 to d10/d12/f3d 0 2024-03-04T09:25:01.173 INFO:tasks.workunit.client.0.smithi046.stdout:3/154: mknod d1/d1d/d27/c2c 0 2024-03-04T09:25:01.188 INFO:tasks.workunit.client.0.smithi046.stdout:1/146: link d1/d28/c29 d1/c2f 0 2024-03-04T09:25:01.208 INFO:tasks.workunit.client.0.smithi046.stdout:2/147: rmdir d5/da/d1b 39 2024-03-04T09:25:01.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/168: truncate d1/d11/d6/d8/d13/f24 4391696 0 2024-03-04T09:25:01.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/169: fdatasync d1/ff 0 2024-03-04T09:25:01.226 INFO:tasks.workunit.client.0.smithi046.stdout:6/128: dread da/dd/f1d [0,4194304] 0 2024-03-04T09:25:01.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/115: mknod d0/d4/db/d12/c26 0 2024-03-04T09:25:01.677 INFO:tasks.workunit.client.0.smithi046.stdout:7/116: readlink d0/da/lf 0 2024-03-04T09:25:01.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/147: rename d1/d3/de/d1d/d24/f2c to d1/d3/de/d20/f32 0 2024-03-04T09:25:01.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/148: read - d1/d3/d1f/f31 zero size 2024-03-04T09:25:01.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/149: chown d1/d3/de/l1c 645401 1 2024-03-04T09:25:01.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/150: chown d1/d3/de/c13 0 1 2024-03-04T09:25:01.966 INFO:tasks.workunit.client.0.smithi046.stdout:3/155: creat d1/d1d/d27/f2d x:0 0 0 2024-03-04T09:25:01.966 INFO:tasks.workunit.client.0.smithi046.stdout:3/156: read d1/f20 [1714475,84972] 0 2024-03-04T09:25:02.405 INFO:tasks.workunit.client.0.smithi046.stdout:8/129: write d7/de/f1b [1524289,141] 0 2024-03-04T09:25:02.725 INFO:tasks.workunit.client.0.smithi046.stdout:9/170: mkdir d1/d11/d6/d8/d1d/d34 0 2024-03-04T09:25:02.726 INFO:tasks.workunit.client.0.smithi046.stdout:6/129: creat da/dd/f2a x:0 0 0 2024-03-04T09:25:02.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/117: rmdir d0/d4/db 39 2024-03-04T09:25:03.168 INFO:tasks.workunit.client.0.smithi046.stdout:4/147: rename d0/d3/d16/f10 to d0/d3/d16/d1e/f33 0 2024-03-04T09:25:03.168 INFO:tasks.workunit.client.0.smithi046.stdout:0/155: rename d10 to d10/d12/d3e 22 2024-03-04T09:25:03.201 INFO:tasks.workunit.client.0.smithi046.stdout:0/156: dread d10/f22 [0,4194304] 0 2024-03-04T09:25:03.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/157: write fd [2351478,108200] 0 2024-03-04T09:25:03.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/158: write d10/f26 [57473,15350] 0 2024-03-04T09:25:03.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/159: fdatasync d10/d12/f3d 0 2024-03-04T09:25:03.638 INFO:tasks.workunit.client.0.smithi046.stdout:3/157: rmdir d1/d21 39 2024-03-04T09:25:03.638 INFO:tasks.workunit.client.0.smithi046.stdout:3/158: stat d1/d14/f13 0 2024-03-04T09:25:03.863 INFO:tasks.workunit.client.0.smithi046.stdout:2/148: mkdir d5/d38 0 2024-03-04T09:25:03.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/171: rmdir d1/d11/d6 39 2024-03-04T09:25:04.109 INFO:tasks.workunit.client.0.smithi046.stdout:7/118: link d0/d4/l8 d0/d4/db/l27 0 2024-03-04T09:25:04.192 INFO:tasks.workunit.client.0.smithi046.stdout:1/147: dwrite d1/f1d [0,4194304] 0 2024-03-04T09:25:04.385 INFO:tasks.workunit.client.0.smithi046.stdout:0/160: mkdir d10/d12/d1f/d3f 0 2024-03-04T09:25:04.385 INFO:tasks.workunit.client.0.smithi046.stdout:0/161: dread - d10/f2f zero size 2024-03-04T09:25:04.791 INFO:tasks.workunit.client.0.smithi046.stdout:8/130: unlink d7/c10 0 2024-03-04T09:25:04.967 INFO:tasks.workunit.client.0.smithi046.stdout:6/130: mkdir da/dd/d2b 0 2024-03-04T09:25:05.038 INFO:tasks.workunit.client.0.smithi046.stdout:7/119: dread d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:25:05.444 INFO:tasks.workunit.client.0.smithi046.stdout:1/148: dread d1/d28/f2e [0,4194304] 0 2024-03-04T09:25:05.686 INFO:tasks.workunit.client.0.smithi046.stdout:0/162: link d10/f2f d10/d36/f40 0 2024-03-04T09:25:05.689 INFO:tasks.workunit.client.0.smithi046.stdout:5/151: sync 2024-03-04T09:25:05.689 INFO:tasks.workunit.client.0.smithi046.stdout:5/152: creat d1/d3/de/d1d/f33 x:0 0 0 2024-03-04T09:25:05.714 INFO:tasks.workunit.client.0.smithi046.stdout:5/153: write d1/f5 [634859,36343] 0 2024-03-04T09:25:05.717 INFO:tasks.workunit.client.0.smithi046.stdout:2/149: symlink d5/da/l39 0 2024-03-04T09:25:05.735 INFO:tasks.workunit.client.0.smithi046.stdout:2/150: write f3 [3253140,31089] 0 2024-03-04T09:25:05.735 INFO:tasks.workunit.client.0.smithi046.stdout:2/151: readlink l0 0 2024-03-04T09:25:05.735 INFO:tasks.workunit.client.0.smithi046.stdout:2/152: fsync d5/da/f14 0 2024-03-04T09:25:05.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/153: dwrite d5/da/f17 [0,4194304] 0 2024-03-04T09:25:06.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/131: getdents da/dd/d22 0 2024-03-04T09:25:06.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/132: write da/d14/d17/f1b [4904921,129542] 0 2024-03-04T09:25:06.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/120: mkdir d0/d4/db/d12/d28 0 2024-03-04T09:25:06.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/148: getdents d0/d3/d16/d1e 0 2024-03-04T09:25:06.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/149: creat d1/d28/f30 x:0 0 0 2024-03-04T09:25:06.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/163: unlink f9 0 2024-03-04T09:25:06.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/172: dwrite d1/d11/f27 [0,4194304] 0 2024-03-04T09:25:06.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/173: readlink d1/d11/d6/d8/d12/l1b 0 2024-03-04T09:25:06.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/174: chown d1/ff 16 1 2024-03-04T09:25:06.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/175: dread d1/d11/d6/d8/d12/d1c/f31 [0,4194304] 0 2024-03-04T09:25:06.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/176: chown d1/d11 7916546 1 2024-03-04T09:25:07.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/159: dwrite d1/f20 [0,4194304] 0 2024-03-04T09:25:07.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/160: write d1/f1e [582410,6679] 0 2024-03-04T09:25:07.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/161: creat d1/d1d/d27/f2e x:0 0 0 2024-03-04T09:25:07.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/162: chown d1/d14/d24/f28 191 1 2024-03-04T09:25:07.901 INFO:tasks.workunit.client.0.smithi046.stdout:6/133: mkdir da/d14/d1e/d2c 0 2024-03-04T09:25:07.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/131: symlink d7/de/l29 0 2024-03-04T09:25:07.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/132: write d7/fc [363723,97606] 0 2024-03-04T09:25:08.406 INFO:tasks.workunit.client.0.smithi046.stdout:9/177: mkdir d1/d11/d6/d8/d1d/d34/d35 0 2024-03-04T09:25:08.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/178: dread d1/d11/f27 [0,4194304] 0 2024-03-04T09:25:09.337 INFO:tasks.workunit.client.0.smithi046.stdout:3/163: symlink d1/d21/l2f 0 2024-03-04T09:25:09.337 INFO:tasks.workunit.client.0.smithi046.stdout:6/134: symlink da/d14/l2d 0 2024-03-04T09:25:09.487 INFO:tasks.workunit.client.0.smithi046.stdout:8/133: truncate d7/f1a 78460 0 2024-03-04T09:25:09.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/164: link d10/f26 d10/d12/f41 0 2024-03-04T09:25:09.661 INFO:tasks.workunit.client.0.smithi046.stdout:0/165: dwrite d10/d12/f3d [0,4194304] 0 2024-03-04T09:25:09.661 INFO:tasks.workunit.client.0.smithi046.stdout:0/166: write d10/d36/f3a [376526,37503] 0 2024-03-04T09:25:09.728 INFO:tasks.workunit.client.0.smithi046.stdout:3/164: creat d1/d21/d26/f30 x:0 0 0 2024-03-04T09:25:09.728 INFO:tasks.workunit.client.0.smithi046.stdout:3/165: dread - d1/d21/d26/f30 zero size 2024-03-04T09:25:09.873 INFO:tasks.workunit.client.0.smithi046.stdout:6/135: symlink da/d14/d1e/d27/l2e 0 2024-03-04T09:25:09.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/136: dwrite da/d14/f19 [4194304,4194304] 0 2024-03-04T09:25:09.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/137: readlink da/d14/l2d 0 2024-03-04T09:25:09.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/138: write da/dd/f2a [909805,72147] 0 2024-03-04T09:25:09.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/139: chown da/cc 241642 1 2024-03-04T09:25:10.010 INFO:tasks.workunit.client.0.smithi046.stdout:6/140: dwrite da/d14/d17/f1b [0,4194304] 0 2024-03-04T09:25:10.314 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:36:21.122 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.328 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:36:21.199 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.331 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:36:21.202 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.334 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:36:21.142 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.340 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:36:21.211 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.342 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:36:21.213 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.368 INFO:tasks.workunit.client.0.smithi046.stdout:7/121: write d0/d4/db/f25 [1589788,35827] 0 2024-03-04T09:25:10.407 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:36:21.278 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.456 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:36:21.327 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.493 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:36:21.300 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:25:10.507 INFO:tasks.workunit.client.0.smithi046.stdout:3/166: mkdir d1/d1d/d31 0 2024-03-04T09:25:10.507 INFO:tasks.workunit.client.0.smithi046.stdout:3/167: dread - d1/d14/f2a zero size 2024-03-04T09:25:10.668 INFO:tasks.workunit.client.0.smithi046.stdout:5/154: rename d1/d3/de/l1c to d1/d3/d1f/l34 0 2024-03-04T09:25:10.767 INFO:tasks.workunit.client.0.smithi046.stdout:6/141: creat da/dd/d2b/f2f x:0 0 0 2024-03-04T09:25:10.892 INFO:tasks.workunit.client.0.smithi046.stdout:7/122: creat d0/da/f29 x:0 0 0 2024-03-04T09:25:10.892 INFO:tasks.workunit.client.0.smithi046.stdout:7/123: creat d0/da/f2a x:0 0 0 2024-03-04T09:25:11.126 INFO:tasks.workunit.client.0.smithi046.stdout:5/155: truncate d1/f2 530287 0 2024-03-04T09:25:11.126 INFO:tasks.workunit.client.0.smithi046.stdout:5/156: truncate d1/d3/f29 1024297 0 2024-03-04T09:25:11.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/124: creat d0/d4/db/f2b x:0 0 0 2024-03-04T09:25:11.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/125: dread - d0/d4/db/d12/f1d zero size 2024-03-04T09:25:11.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/126: creat d0/d4/db/d12/f2c x:0 0 0 2024-03-04T09:25:11.932 INFO:tasks.workunit.client.0.smithi046.stdout:7/127: mkdir d0/d2d 0 2024-03-04T09:25:11.932 INFO:tasks.workunit.client.0.smithi046.stdout:7/128: chown d0/c18 49974 1 2024-03-04T09:25:11.932 INFO:tasks.workunit.client.0.smithi046.stdout:6/142: unlink da/cc 0 2024-03-04T09:25:11.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/150: symlink d1/l31 0 2024-03-04T09:25:11.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/151: read - d1/fe zero size 2024-03-04T09:25:11.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/152: write d1/f21 [522171,81389] 0 2024-03-04T09:25:12.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/149: dwrite d0/d3/d16/f1a [0,4194304] 0 2024-03-04T09:25:12.304 INFO:tasks.workunit.client.0.smithi046.stdout:9/179: mkdir d1/d11/d6/d8/d36 0 2024-03-04T09:25:12.568 INFO:tasks.workunit.client.0.smithi046.stdout:6/143: creat da/d14/d1e/f30 x:0 0 0 2024-03-04T09:25:12.848 INFO:tasks.workunit.client.0.smithi046.stdout:4/150: mknod d0/d1f/d25/c34 0 2024-03-04T09:25:12.992 INFO:tasks.workunit.client.0.smithi046.stdout:3/168: truncate d1/f20 2633795 0 2024-03-04T09:25:13.314 INFO:tasks.workunit.client.0.smithi046.stdout:2/154: rmdir d5/da/d28 39 2024-03-04T09:25:13.315 INFO:tasks.workunit.client.0.smithi046.stdout:7/129: truncate d0/d4/fd 2236059 0 2024-03-04T09:25:13.424 INFO:tasks.workunit.client.0.smithi046.stdout:1/153: link d1/f1b d1/f32 0 2024-03-04T09:25:13.514 INFO:tasks.workunit.client.0.smithi046.stdout:4/151: mkdir d0/d1f/d35 0 2024-03-04T09:25:13.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/144: fsync da/dd/d2b/f2f 0 2024-03-04T09:25:13.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/152: dwrite d0/d3/f6 [0,4194304] 0 2024-03-04T09:25:13.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/153: stat d0/f2d 0 2024-03-04T09:25:13.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/154: dread - d0/f2d zero size 2024-03-04T09:25:13.611 INFO:tasks.workunit.client.0.smithi046.stdout:3/169: mknod d1/d1d/d31/c32 0 2024-03-04T09:25:14.140 INFO:tasks.workunit.client.0.smithi046.stdout:6/145: mknod da/dd/d2b/c31 0 2024-03-04T09:25:14.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/155: creat d0/d3/d16/d1e/f36 x:0 0 0 2024-03-04T09:25:14.463 INFO:tasks.workunit.client.0.smithi046.stdout:4/156: dwrite d0/d3/d16/f1a [0,4194304] 0 2024-03-04T09:25:14.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/170: unlink d1/l2 0 2024-03-04T09:25:14.761 INFO:tasks.workunit.client.0.smithi046.stdout:2/155: link d5/da/l26 d5/da/d28/l3a 0 2024-03-04T09:25:14.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/156: write d5/da/d28/f2f [506585,130638] 0 2024-03-04T09:25:14.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/157: write d5/da/d1b/f30 [440611,63600] 0 2024-03-04T09:25:14.763 INFO:tasks.workunit.client.0.smithi046.stdout:2/158: truncate d5/da/f20 833192 0 2024-03-04T09:25:14.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/167: rename d10/c17 to d10/d36/c42 0 2024-03-04T09:25:14.983 INFO:tasks.workunit.client.0.smithi046.stdout:1/154: rename d1/f32 to d1/f33 0 2024-03-04T09:25:15.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/171: mknod d1/d1d/d27/c33 0 2024-03-04T09:25:15.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/157: creat d0/d3/d16/f37 x:0 0 0 2024-03-04T09:25:15.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/172: stat d1/d1d/d31 0 2024-03-04T09:25:15.570 INFO:tasks.workunit.client.0.smithi046.stdout:8/134: sync 2024-03-04T09:25:16.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/180: write d1/d11/d6/d8/d12/f1e [2862167,58598] 0 2024-03-04T09:25:16.520 INFO:tasks.workunit.client.0.smithi046.stdout:9/181: dwrite d1/ff [4194304,4194304] 0 2024-03-04T09:25:16.520 INFO:tasks.workunit.client.0.smithi046.stdout:9/182: write d1/d11/d6/d8/d12/f30 [164419,19321] 0 2024-03-04T09:25:16.520 INFO:tasks.workunit.client.0.smithi046.stdout:9/183: fdatasync d1/d11/d6/d8/d13/f25 0 2024-03-04T09:25:16.938 INFO:tasks.workunit.client.0.smithi046.stdout:1/155: creat d1/f34 x:0 0 0 2024-03-04T09:25:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:3/173: mknod d1/d1d/d31/c34 0 2024-03-04T09:25:16.979 INFO:tasks.workunit.client.0.smithi046.stdout:4/158: creat d0/d3/d20/f38 x:0 0 0 2024-03-04T09:25:16.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/135: symlink d7/de/l2a 0 2024-03-04T09:25:17.009 INFO:tasks.workunit.client.0.smithi046.stdout:7/130: dread d0/d4/fd [0,4194304] 0 2024-03-04T09:25:17.009 INFO:tasks.workunit.client.0.smithi046.stdout:7/131: fdatasync d0/da/f2a 0 2024-03-04T09:25:17.036 INFO:tasks.workunit.client.0.smithi046.stdout:1/156: dwrite d1/fd [0,4194304] 0 2024-03-04T09:25:17.037 INFO:tasks.workunit.client.0.smithi046.stdout:1/157: write d1/f34 [756712,90157] 0 2024-03-04T09:25:17.045 INFO:tasks.workunit.client.0.smithi046.stdout:8/136: dwrite d7/f23 [4194304,4194304] 0 2024-03-04T09:25:17.480 INFO:tasks.workunit.client.0.smithi046.stdout:9/184: unlink d1/d11/d6/d8/d1d/c23 0 2024-03-04T09:25:17.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/185: dread d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:25:17.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/186: write d1/d11/d6/d8/d13/f2c [244426,110695] 0 2024-03-04T09:25:17.815 INFO:tasks.workunit.client.0.smithi046.stdout:4/159: creat d0/f39 x:0 0 0 2024-03-04T09:25:18.190 INFO:tasks.workunit.client.0.smithi046.stdout:8/137: creat d7/de/d28/f2b x:0 0 0 2024-03-04T09:25:18.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/138: dread d7/de/f21 [0,4194304] 0 2024-03-04T09:25:18.382 INFO:tasks.workunit.client.0.smithi046.stdout:0/168: getdents d10 0 2024-03-04T09:25:18.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/146: write da/dd/f10 [722637,21083] 0 2024-03-04T09:25:18.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/147: fdatasync da/dd/f2a 0 2024-03-04T09:25:18.673 INFO:tasks.workunit.client.0.smithi046.stdout:9/187: symlink d1/d11/d6/d8/d36/l37 0 2024-03-04T09:25:18.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/188: dwrite d1/d11/f27 [0,4194304] 0 2024-03-04T09:25:18.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/189: chown d1/d11/d6/d8/d36 500202 1 2024-03-04T09:25:18.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/190: creat d1/d11/d6/d8/d12/d1c/f38 x:0 0 0 2024-03-04T09:25:18.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/191: chown d1/d11/d6/c2b 11094 1 2024-03-04T09:25:18.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:25:18.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:25:18.931 INFO:tasks.workunit.client.0.smithi046.stdout:0/169: unlink d10/c15 0 2024-03-04T09:25:19.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/160: rename d0/d3/d16/d17/c18 to d0/d3/d16/d17/c3a 0 2024-03-04T09:25:19.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/161: dread - d0/d3/d16/d1e/f36 zero size 2024-03-04T09:25:19.640 INFO:tasks.workunit.client.0.smithi046.stdout:8/139: mkdir d7/de/d13/d2c 0 2024-03-04T09:25:19.654 INFO:tasks.workunit.client.0.smithi046.stdout:8/140: write d7/de/f21 [3720585,64298] 0 2024-03-04T09:25:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/162: rename d0/d3/dc to d0/d3/d3b 0 2024-03-04T09:25:20.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/141: creat d7/de/d13/d2c/f2d x:0 0 0 2024-03-04T09:25:20.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/142: chown d7/de/d12/f15 1105880685 1 2024-03-04T09:25:20.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/143: creat d7/de/d28/f2e x:0 0 0 2024-03-04T09:25:20.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/163: dread d0/d3/d16/d1e/f33 [0,4194304] 0 2024-03-04T09:25:20.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/170: creat d10/d12/d1f/d3b/f43 x:0 0 0 2024-03-04T09:25:20.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/144: link d7/de/l1d d7/de/d28/l2f 0 2024-03-04T09:25:20.947 INFO:tasks.workunit.client.0.smithi046.stdout:4/164: dread d0/d3/f4 [0,4194304] 0 2024-03-04T09:25:21.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/171: creat d10/d12/d1f/d3f/f44 x:0 0 0 2024-03-04T09:25:21.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/145: link d7/l27 d7/de/l30 0 2024-03-04T09:25:21.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/146: creat d7/de/d13/d2c/f31 x:0 0 0 2024-03-04T09:25:21.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/165: symlink d0/d3/d16/d1e/l3c 0 2024-03-04T09:25:22.723 INFO:tasks.workunit.client.0.smithi046.stdout:5/157: rename d1/d3/f4 to d1/d3/de/d1d/d24/f35 0 2024-03-04T09:25:22.723 INFO:tasks.workunit.client.0.smithi046.stdout:6/148: creat da/f32 x:0 0 0 2024-03-04T09:25:22.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/149: dwrite da/dd/f13 [0,4194304] 0 2024-03-04T09:25:22.809 INFO:tasks.workunit.client.0.smithi046.stdout:6/150: creat da/d14/d1e/f33 x:0 0 0 2024-03-04T09:25:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/151: mkdir da/d14/d1e/d2c/d34 0 2024-03-04T09:25:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/152: chown da/d14/d1e/f30 14575 1 2024-03-04T09:25:23.578 INFO:tasks.workunit.client.0.smithi046.stdout:5/158: getdents d1/d3 0 2024-03-04T09:25:23.593 INFO:tasks.workunit.client.0.smithi046.stdout:2/159: sync 2024-03-04T09:25:23.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/132: sync 2024-03-04T09:25:23.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/133: fdatasync d0/d4/db/f25 0 2024-03-04T09:25:23.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/192: sync 2024-03-04T09:25:23.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/193: dwrite d1/d11/d6/d8/d13/f24 [0,4194304] 0 2024-03-04T09:25:23.798 INFO:tasks.workunit.client.0.smithi046.stdout:5/159: creat d1/f36 x:0 0 0 2024-03-04T09:25:24.023 INFO:tasks.workunit.client.0.smithi046.stdout:2/160: getdents d5/da 0 2024-03-04T09:25:24.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/134: mknod d0/c2e 0 2024-03-04T09:25:24.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/135: read d0/d4/db/f25 [971183,49028] 0 2024-03-04T09:25:24.335 INFO:tasks.workunit.client.0.smithi046.stdout:9/194: creat d1/d11/d6/f39 x:0 0 0 2024-03-04T09:25:24.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/195: dwrite d1/d11/d6/f39 [0,4194304] 0 2024-03-04T09:25:24.546 INFO:tasks.workunit.client.0.smithi046.stdout:2/161: creat d5/f3b x:0 0 0 2024-03-04T09:25:24.546 INFO:tasks.workunit.client.0.smithi046.stdout:2/162: write d5/da/d28/f35 [977141,76310] 0 2024-03-04T09:25:24.571 INFO:tasks.workunit.client.0.smithi046.stdout:3/174: rename d1/d14 to d1/d21/d35 0 2024-03-04T09:25:24.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/196: symlink d1/d11/d6/d8/d1d/d34/d35/l3a 0 2024-03-04T09:25:25.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/172: creat d10/f45 x:0 0 0 2024-03-04T09:25:25.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/163: dread d5/da/d1b/f36 [0,4194304] 0 2024-03-04T09:25:25.229 INFO:tasks.workunit.client.0.smithi046.stdout:2/164: dwrite d5/f13 [0,4194304] 0 2024-03-04T09:25:25.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/158: rename d1/f12 to d1/d28/f35 0 2024-03-04T09:25:25.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/159: fsync d1/f23 0 2024-03-04T09:25:25.323 INFO:tasks.workunit.client.0.smithi046.stdout:6/153: write f5 [2908810,91546] 0 2024-03-04T09:25:25.351 INFO:tasks.workunit.client.0.smithi046.stdout:3/175: stat d1/d21/d26 0 2024-03-04T09:25:25.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/197: mknod d1/d11/d6/d8/d13/d21/c3b 0 2024-03-04T09:25:25.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/198: dread d1/d11/d6/d8/d13/f24 [0,4194304] 0 2024-03-04T09:25:25.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/173: truncate d10/d36/f40 136734 0 2024-03-04T09:25:25.913 INFO:tasks.workunit.client.0.smithi046.stdout:2/165: rename l0 to d5/da/d1b/l3c 0 2024-03-04T09:25:26.043 INFO:tasks.workunit.client.0.smithi046.stdout:4/166: rename d0/l28 to d0/l3d 0 2024-03-04T09:25:26.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/154: creat da/d14/d1e/d2c/f35 x:0 0 0 2024-03-04T09:25:26.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/155: truncate da/dd/fe 5326642 0 2024-03-04T09:25:26.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/176: creat d1/d21/d35/f36 x:0 0 0 2024-03-04T09:25:26.379 INFO:tasks.workunit.client.0.smithi046.stdout:9/199: getdents d1/d11/d6/d8/d12/d1c/d26 0 2024-03-04T09:25:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/166: link d5/f10 d5/d2c/f3d 0 2024-03-04T09:25:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/167: chown d5/da/d1b/l32 25466 1 2024-03-04T09:25:26.986 INFO:tasks.workunit.client.0.smithi046.stdout:4/167: dread d0/d1f/d25/f26 [4194304,4194304] 0 2024-03-04T09:25:27.023 INFO:tasks.workunit.client.0.smithi046.stdout:4/168: dread d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:25:27.023 INFO:tasks.workunit.client.0.smithi046.stdout:4/169: creat d0/d3/d16/d1e/f3e x:0 0 0 2024-03-04T09:25:27.057 INFO:tasks.workunit.client.0.smithi046.stdout:1/160: link d1/c13 d1/d28/c36 0 2024-03-04T09:25:27.057 INFO:tasks.workunit.client.0.smithi046.stdout:1/161: creat d1/d28/f37 x:0 0 0 2024-03-04T09:25:27.166 INFO:tasks.workunit.client.0.smithi046.stdout:6/156: creat da/dd/f36 x:0 0 0 2024-03-04T09:25:27.475 INFO:tasks.workunit.client.0.smithi046.stdout:5/160: write d1/d3/de/d1d/d24/f35 [4601177,22209] 0 2024-03-04T09:25:27.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/200: link d1/d11/d6/d8/d13/f24 d1/d11/d6/d8/d1d/d34/f3c 0 2024-03-04T09:25:27.512 INFO:tasks.workunit.client.0.smithi046.stdout:9/201: dread d1/ff [4194304,4194304] 0 2024-03-04T09:25:27.795 INFO:tasks.workunit.client.0.smithi046.stdout:0/174: mkdir d10/d46 0 2024-03-04T09:25:28.072 INFO:tasks.workunit.client.0.smithi046.stdout:2/168: creat d5/da/d28/f3e x:0 0 0 2024-03-04T09:25:28.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/169: dread d5/da/d1b/f30 [0,4194304] 0 2024-03-04T09:25:28.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/170: fsync d5/fd 0 2024-03-04T09:25:28.240 INFO:tasks.workunit.client.0.smithi046.stdout:4/170: symlink d0/d3/d20/l3f 0 2024-03-04T09:25:28.241 INFO:tasks.workunit.client.0.smithi046.stdout:4/171: chown d0/d1f/f2c 837535691 1 2024-03-04T09:25:28.323 INFO:tasks.workunit.client.0.smithi046.stdout:8/147: sync 2024-03-04T09:25:28.323 INFO:tasks.workunit.client.0.smithi046.stdout:7/136: sync 2024-03-04T09:25:28.427 INFO:tasks.workunit.client.0.smithi046.stdout:1/162: link d1/f7 d1/d28/f38 0 2024-03-04T09:25:28.610 INFO:tasks.workunit.client.0.smithi046.stdout:6/157: unlink da/dd/d2b/c31 0 2024-03-04T09:25:28.895 INFO:tasks.workunit.client.0.smithi046.stdout:3/177: creat d1/d1d/f37 x:0 0 0 2024-03-04T09:25:28.895 INFO:tasks.workunit.client.0.smithi046.stdout:5/161: getdents d1 0 2024-03-04T09:25:28.895 INFO:tasks.workunit.client.0.smithi046.stdout:5/162: chown d1/d3/de/d1d 1 1 2024-03-04T09:25:28.955 INFO:tasks.workunit.client.0.smithi046.stdout:3/178: dwrite d1/d21/d35/f1f [0,4194304] 0 2024-03-04T09:25:28.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/163: dwrite d1/d3/de/d1d/d24/f35 [0,4194304] 0 2024-03-04T09:25:28.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/164: chown d1/d3/de/d1d/f2e 6955450 1 2024-03-04T09:25:29.057 INFO:tasks.workunit.client.0.smithi046.stdout:5/165: dwrite d1/d3/f23 [0,4194304] 0 2024-03-04T09:25:29.057 INFO:tasks.workunit.client.0.smithi046.stdout:5/166: write d1/f5 [2941035,16275] 0 2024-03-04T09:25:29.082 INFO:tasks.workunit.client.0.smithi046.stdout:9/202: symlink d1/d11/d6/d8/l3d 0 2024-03-04T09:25:29.096 INFO:tasks.workunit.client.0.smithi046.stdout:9/203: write d1/ff [5717363,110220] 0 2024-03-04T09:25:29.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/204: write d1/d11/d6/d8/fd [3596779,28249] 0 2024-03-04T09:25:29.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/205: read - d1/d11/d6/d8/d12/d1c/f38 zero size 2024-03-04T09:25:29.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/206: truncate d1/d11/d6/d8/d12/f30 640654 0 2024-03-04T09:25:29.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/207: write d1/d11/d6/d8/f33 [285764,29695] 0 2024-03-04T09:25:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/175: truncate d10/d12/d1f/f27 1916210 0 2024-03-04T09:25:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/176: fsync f7 0 2024-03-04T09:25:29.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/171: mkdir d5/da/d28/d3f 0 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/172: mknod d0/d3/c40 0 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/173: chown d0/d3/d20/f21 528577569 1 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/174: chown d0/d3/d3b/l24 66145676 1 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/175: chown d0/d3/d3b/c1d 204557 1 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/176: chown d0/l19 3662039 1 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/177: read - d0/d3/d16/d1e/f3e zero size 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/178: chown d0/d3 15 1 2024-03-04T09:25:29.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/179: fdatasync d0/d3/d16/d17/f1b 0 2024-03-04T09:25:29.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/180: write d0/f11 [4963225,126013] 0 2024-03-04T09:25:29.808 INFO:tasks.workunit.client.0.smithi046.stdout:8/148: link c0 d7/de/d13/d2c/c32 0 2024-03-04T09:25:29.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/149: creat d7/de/d13/d2c/f33 x:0 0 0 2024-03-04T09:25:29.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/150: dwrite d7/de/f1f [0,4194304] 0 2024-03-04T09:25:29.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/151: dread d7/de/d12/f15 [0,4194304] 0 2024-03-04T09:25:29.956 INFO:tasks.workunit.client.0.smithi046.stdout:7/137: rename d0/d4/db/d12/c26 to d0/d4/db/d12/d28/c2f 0 2024-03-04T09:25:29.956 INFO:tasks.workunit.client.0.smithi046.stdout:7/138: fsync d0/f11 0 2024-03-04T09:25:30.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/139: dwrite d0/da/f2a [0,4194304] 0 2024-03-04T09:25:30.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/158: link da/d14/c18 da/c37 0 2024-03-04T09:25:30.431 INFO:tasks.workunit.client.0.smithi046.stdout:3/179: truncate d1/d21/d35/d24/f1b 6319389 0 2024-03-04T09:25:31.021 INFO:tasks.workunit.client.0.smithi046.stdout:5/167: truncate d1/d3/f29 38308 0 2024-03-04T09:25:31.021 INFO:tasks.workunit.client.0.smithi046.stdout:5/168: dread - d1/d3/de/d1d/f33 zero size 2024-03-04T09:25:31.054 INFO:tasks.workunit.client.0.smithi046.stdout:5/169: dread d1/d3/de/f10 [0,4194304] 0 2024-03-04T09:25:31.054 INFO:tasks.workunit.client.0.smithi046.stdout:5/170: fdatasync d1/f2 0 2024-03-04T09:25:31.287 INFO:tasks.workunit.client.0.smithi046.stdout:9/208: mkdir d1/d11/d3e 0 2024-03-04T09:25:31.287 INFO:tasks.workunit.client.0.smithi046.stdout:9/209: fdatasync d1/d11/d6/d8/d13/f24 0 2024-03-04T09:25:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/181: creat d0/f41 x:0 0 0 2024-03-04T09:25:32.147 INFO:tasks.workunit.client.0.smithi046.stdout:4/182: dwrite d0/f41 [0,4194304] 0 2024-03-04T09:25:32.147 INFO:tasks.workunit.client.0.smithi046.stdout:4/183: chown d0/d3/d3b/l24 10 1 2024-03-04T09:25:32.147 INFO:tasks.workunit.client.0.smithi046.stdout:4/184: readlink d0/d3/d20/l3f 0 2024-03-04T09:25:32.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/152: mknod d7/de/d12/c34 0 2024-03-04T09:25:32.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/153: write d7/de/d28/f2b [131032,14504] 0 2024-03-04T09:25:32.988 INFO:tasks.workunit.client.0.smithi046.stdout:7/140: dwrite d0/d4/f1f [0,4194304] 0 2024-03-04T09:25:33.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/141: dread d0/d4/f1f [0,4194304] 0 2024-03-04T09:25:33.557 INFO:tasks.workunit.client.0.smithi046.stdout:3/180: creat d1/d21/d35/d2b/f38 x:0 0 0 2024-03-04T09:25:33.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/210: mknod d1/d11/d6/d8/d12/d1c/d26/c3f 0 2024-03-04T09:25:34.449 INFO:tasks.workunit.client.0.smithi046.stdout:0/177: truncate d10/f26 1663192 0 2024-03-04T09:25:35.454 INFO:tasks.workunit.client.0.smithi046.stdout:3/181: rmdir d1/d1d/d31 39 2024-03-04T09:25:35.624 INFO:tasks.workunit.client.0.smithi046.stdout:9/211: mknod d1/d11/d6/d8/d12/c40 0 2024-03-04T09:25:35.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/178: mknod d10/d12/d1f/d2d/c47 0 2024-03-04T09:25:35.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/179: chown d10/f45 13580 1 2024-03-04T09:25:35.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/180: dread - d10/d12/d1f/d3b/f43 zero size 2024-03-04T09:25:36.234 INFO:tasks.workunit.client.0.smithi046.stdout:7/142: rmdir d0/d4/db/d12 39 2024-03-04T09:25:36.900 INFO:tasks.workunit.client.0.smithi046.stdout:2/172: dwrite d5/d2c/f33 [0,4194304] 0 2024-03-04T09:25:36.901 INFO:tasks.workunit.client.0.smithi046.stdout:2/173: chown d5/da/d1b/l34 895486346 1 2024-03-04T09:25:37.214 INFO:tasks.workunit.client.0.smithi046.stdout:3/182: rmdir d1/d21/d26 39 2024-03-04T09:25:37.287 INFO:tasks.workunit.client.0.smithi046.stdout:3/183: dwrite d1/d21/d35/d24/f18 [0,4194304] 0 2024-03-04T09:25:37.553 INFO:tasks.workunit.client.0.smithi046.stdout:3/184: creat d1/f39 x:0 0 0 2024-03-04T09:25:37.589 INFO:tasks.workunit.client.0.smithi046.stdout:3/185: dread d1/d21/d35/d24/f18 [0,4194304] 0 2024-03-04T09:25:37.589 INFO:tasks.workunit.client.0.smithi046.stdout:3/186: dread - d1/d21/d35/d2b/f38 zero size 2024-03-04T09:25:37.816 INFO:tasks.workunit.client.0.smithi046.stdout:1/163: rename d1/f4 to d1/d28/f39 0 2024-03-04T09:25:37.819 INFO:tasks.workunit.client.0.smithi046.stdout:9/212: write d1/d11/d6/d8/d12/f30 [495247,55100] 0 2024-03-04T09:25:37.902 INFO:tasks.workunit.client.0.smithi046.stdout:9/213: dwrite d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:25:37.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/214: write d1/d11/d6/d8/d13/f25 [217083,66435] 0 2024-03-04T09:25:37.934 INFO:tasks.workunit.client.0.smithi046.stdout:9/215: creat d1/d11/d6/d8/d12/d1c/f41 x:0 0 0 2024-03-04T09:25:38.055 INFO:tasks.workunit.client.0.smithi046.stdout:2/174: mkdir d5/d40 0 2024-03-04T09:25:38.055 INFO:tasks.workunit.client.0.smithi046.stdout:2/175: fsync d5/da/d28/f2f 0 2024-03-04T09:25:38.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/176: dread d5/da/f17 [0,4194304] 0 2024-03-04T09:25:38.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/177: fdatasync d5/ff 0 2024-03-04T09:25:38.382 INFO:tasks.workunit.client.0.smithi046.stdout:5/171: rename d1/d3/de/d20/f32 to d1/d3/d1f/f37 0 2024-03-04T09:25:38.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/187: rmdir d1/d21/d35/d24 39 2024-03-04T09:25:38.382 INFO:tasks.workunit.client.0.smithi046.stdout:5/172: readlink d1/d3/de/d1d/l2a 0 2024-03-04T09:25:38.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/188: truncate d1/d1d/d27/f2d 219519 0 2024-03-04T09:25:38.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/189: creat d1/d1d/f3a x:0 0 0 2024-03-04T09:25:38.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/190: dwrite d1/d21/d35/f1f [0,4194304] 0 2024-03-04T09:25:38.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/191: chown d1/d21/d35/c17 160987 1 2024-03-04T09:25:38.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/216: symlink d1/d11/d6/d8/d1d/l42 0 2024-03-04T09:25:38.724 INFO:tasks.workunit.client.0.smithi046.stdout:7/143: creat d0/d4/db/d12/f30 x:0 0 0 2024-03-04T09:25:38.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/217: dwrite d1/d11/d6/d8/d12/d1c/f31 [0,4194304] 0 2024-03-04T09:25:38.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/218: fdatasync d1/d11/d6/d8/d12/d1c/f38 0 2024-03-04T09:25:38.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/219: dread d1/d11/d6/d8/d1d/d34/f3c [0,4194304] 0 2024-03-04T09:25:38.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/220: dwrite d1/d11/d6/d8/d13/f25 [4194304,4194304] 0 2024-03-04T09:25:38.935 INFO:tasks.workunit.client.0.smithi046.stdout:4/185: sync 2024-03-04T09:25:38.935 INFO:tasks.workunit.client.0.smithi046.stdout:4/186: chown d0/l3d 489 1 2024-03-04T09:25:38.935 INFO:tasks.workunit.client.0.smithi046.stdout:0/181: sync 2024-03-04T09:25:38.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/154: sync 2024-03-04T09:25:38.935 INFO:tasks.workunit.client.0.smithi046.stdout:6/159: sync 2024-03-04T09:25:39.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/178: rename d5/da/f17 to d5/da/d28/d3f/f41 0 2024-03-04T09:25:39.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/173: truncate d1/d3/de/d1d/d24/f35 3202203 0 2024-03-04T09:25:39.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/174: readlink d1/d3/l2f 0 2024-03-04T09:25:39.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/175: chown d1/d3/de/d1d/f33 0 1 2024-03-04T09:25:39.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/176: dread - d1/d3/de/d1d/f33 zero size 2024-03-04T09:25:39.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/177: fdatasync d1/d3/de/d1d/d24/f35 0 2024-03-04T09:25:39.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/192: mknod d1/d21/d35/c3b 0 2024-03-04T09:25:39.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/164: dwrite d1/f19 [0,4194304] 0 2024-03-04T09:25:39.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/144: creat d0/f31 x:0 0 0 2024-03-04T09:25:40.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/221: truncate d1/d11/d6/d8/d1d/d34/f3c 3849644 0 2024-03-04T09:25:40.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/187: symlink d0/d3/l42 0 2024-03-04T09:25:40.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/222: truncate d1/d11/d6/d8/d12/f30 1648412 0 2024-03-04T09:25:40.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/182: fdatasync d10/f2e 0 2024-03-04T09:25:40.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/223: chown d1/d11/f27 93 1 2024-03-04T09:25:40.429 INFO:tasks.workunit.client.0.smithi046.stdout:8/155: getdents d7/de/d12 0 2024-03-04T09:25:40.453 INFO:tasks.workunit.client.0.smithi046.stdout:6/160: dread f9 [0,4194304] 0 2024-03-04T09:25:40.453 INFO:tasks.workunit.client.0.smithi046.stdout:6/161: truncate da/dd/f10 1129508 0 2024-03-04T09:25:40.453 INFO:tasks.workunit.client.0.smithi046.stdout:6/162: dread - da/d14/d1e/d2c/f35 zero size 2024-03-04T09:25:40.732 INFO:tasks.workunit.client.0.smithi046.stdout:2/179: rmdir d5 39 2024-03-04T09:25:41.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/178: mkdir d1/d3/de/d20/d38 0 2024-03-04T09:25:41.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/193: mknod d1/d21/d35/c3c 0 2024-03-04T09:25:41.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/145: rename d0/da/ce to d0/d4/db/d12/c32 0 2024-03-04T09:25:41.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/146: dread d0/d4/f5 [0,4194304] 0 2024-03-04T09:25:41.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/147: write d0/d4/f5 [2954147,83133] 0 2024-03-04T09:25:41.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/148: write d0/d4/db/d12/f30 [314055,96672] 0 2024-03-04T09:25:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/149: write d0/da/f2a [1913367,98455] 0 2024-03-04T09:25:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/150: chown d0/da/c21 248086 1 2024-03-04T09:25:41.778 INFO:tasks.workunit.client.0.smithi046.stdout:4/188: mknod d0/d3/d20/c43 0 2024-03-04T09:25:41.778 INFO:tasks.workunit.client.0.smithi046.stdout:0/183: symlink d10/d12/d1f/d3b/l48 0 2024-03-04T09:25:41.781 INFO:tasks.workunit.client.0.smithi046.stdout:9/224: creat d1/d11/d6/d8/f43 x:0 0 0 2024-03-04T09:25:41.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/156: creat d7/de/d13/f35 x:0 0 0 2024-03-04T09:25:41.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/157: write d7/de/d13/f35 [795055,21409] 0 2024-03-04T09:25:41.868 INFO:tasks.workunit.client.0.smithi046.stdout:4/189: dwrite d0/d3/d16/d17/f1b [4194304,4194304] 0 2024-03-04T09:25:41.868 INFO:tasks.workunit.client.0.smithi046.stdout:4/190: chown d0/d1f/d35 10465550 1 2024-03-04T09:25:41.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/163: unlink da/d14/c24 0 2024-03-04T09:25:43.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/179: mknod d1/d3/d1f/c39 0 2024-03-04T09:25:43.542 INFO:tasks.workunit.client.0.smithi046.stdout:5/180: dwrite d1/d3/f23 [0,4194304] 0 2024-03-04T09:25:43.542 INFO:tasks.workunit.client.0.smithi046.stdout:5/181: write d1/d3/de/d1d/f33 [528234,58711] 0 2024-03-04T09:25:43.585 INFO:tasks.workunit.client.0.smithi046.stdout:3/194: mkdir d1/d1d/d31/d3d 0 2024-03-04T09:25:43.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/165: mknod d1/c3a 0 2024-03-04T09:25:43.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/166: chown d1/l10 0 1 2024-03-04T09:25:44.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/151: link d0/d4/db/d12/l17 d0/d2d/l33 0 2024-03-04T09:25:44.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/152: readlink d0/d4/db/d12/l1e 0 2024-03-04T09:25:44.048 INFO:tasks.workunit.client.0.smithi046.stdout:7/153: dread d0/d4/fd [0,4194304] 0 2024-03-04T09:25:44.082 INFO:tasks.workunit.client.0.smithi046.stdout:9/225: truncate d1/d11/d6/d8/d12/f1e 3777595 0 2024-03-04T09:25:44.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/184: dwrite d10/f22 [4194304,4194304] 0 2024-03-04T09:25:44.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/185: truncate d10/d12/d1f/d2d/f30 559544 0 2024-03-04T09:25:44.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/186: creat d10/d12/d1f/d2d/f49 x:0 0 0 2024-03-04T09:25:44.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/158: mkdir d7/de/d28/d36 0 2024-03-04T09:25:44.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/159: write d7/fd [1204658,39759] 0 2024-03-04T09:25:44.757 INFO:tasks.workunit.client.0.smithi046.stdout:4/191: creat d0/d1f/f44 x:0 0 0 2024-03-04T09:25:44.757 INFO:tasks.workunit.client.0.smithi046.stdout:4/192: write d0/d3/d16/d1e/f3e [1041951,48501] 0 2024-03-04T09:25:44.757 INFO:tasks.workunit.client.0.smithi046.stdout:4/193: read - d0/d3/d20/f38 zero size 2024-03-04T09:25:44.757 INFO:tasks.workunit.client.0.smithi046.stdout:4/194: truncate d0/f2d 97302 0 2024-03-04T09:25:44.968 INFO:tasks.workunit.client.0.smithi046.stdout:6/164: mknod da/d14/d1e/c38 0 2024-03-04T09:25:44.968 INFO:tasks.workunit.client.0.smithi046.stdout:6/165: write da/dd/f29 [5053099,109014] 0 2024-03-04T09:25:45.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/182: truncate d1/d3/de/d1d/d24/f35 390062 0 2024-03-04T09:25:45.290 INFO:tasks.workunit.client.0.smithi046.stdout:3/195: creat d1/d1d/d31/f3e x:0 0 0 2024-03-04T09:25:45.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/180: sync 2024-03-04T09:25:45.425 INFO:tasks.workunit.client.0.smithi046.stdout:2/181: dread d5/da/d28/d3f/f41 [0,4194304] 0 2024-03-04T09:25:45.487 INFO:tasks.workunit.client.0.smithi046.stdout:2/182: dwrite d5/d2c/f33 [4194304,4194304] 0 2024-03-04T09:25:45.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/154: read d0/f16 [90027,39781] 0 2024-03-04T09:25:45.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/187: mkdir d10/d12/d1f/d3f/d4a 0 2024-03-04T09:25:45.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/160: stat d7/de/l30 0 2024-03-04T09:25:46.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/195: rename d0/f15 to d0/d1f/f45 0 2024-03-04T09:25:46.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/196: dread - d0/d3/d20/f38 zero size 2024-03-04T09:25:46.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/197: creat d0/d3/d20/f46 x:0 0 0 2024-03-04T09:25:46.132 INFO:tasks.workunit.client.0.smithi046.stdout:9/226: dread d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:25:46.133 INFO:tasks.workunit.client.0.smithi046.stdout:9/227: chown d1/d11/d6/d8/fd 12 1 2024-03-04T09:25:46.133 INFO:tasks.workunit.client.0.smithi046.stdout:9/228: fdatasync d1/d11/d6/d8/d13/f2c 0 2024-03-04T09:25:46.482 INFO:tasks.workunit.client.0.smithi046.stdout:5/183: symlink d1/d3/d1f/l3a 0 2024-03-04T09:25:46.482 INFO:tasks.workunit.client.0.smithi046.stdout:5/184: fdatasync d1/d3/f29 0 2024-03-04T09:25:46.483 INFO:tasks.workunit.client.0.smithi046.stdout:5/185: readlink d1/d3/d1f/l3a 0 2024-03-04T09:25:46.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/196: creat d1/f3f x:0 0 0 2024-03-04T09:25:46.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/186: read d1/d3/de/f10 [2037055,92858] 0 2024-03-04T09:25:46.564 INFO:tasks.workunit.client.0.smithi046.stdout:3/197: dwrite d1/d21/d35/d24/f18 [0,4194304] 0 2024-03-04T09:25:46.565 INFO:tasks.workunit.client.0.smithi046.stdout:3/198: readlink d1/d21/l2f 0 2024-03-04T09:25:46.637 INFO:tasks.workunit.client.0.smithi046.stdout:1/167: mknod d1/c3b 0 2024-03-04T09:25:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/168: dwrite d1/f1d [4194304,4194304] 0 2024-03-04T09:25:46.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/169: dread d1/d28/f35 [0,4194304] 0 2024-03-04T09:25:47.167 INFO:tasks.workunit.client.0.smithi046.stdout:2/183: mknod d5/da/d1b/c42 0 2024-03-04T09:25:47.171 INFO:tasks.workunit.client.0.smithi046.stdout:2/184: write d5/da/d28/f35 [898138,99226] 0 2024-03-04T09:25:47.207 INFO:tasks.workunit.client.0.smithi046.stdout:7/155: link d0/f31 d0/d4/db/d12/f34 0 2024-03-04T09:25:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/185: dwrite d5/da/f14 [0,4194304] 0 2024-03-04T09:25:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/186: chown d5/fd 15892 1 2024-03-04T09:25:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/187: readlink d5/da/d1b/l1c 0 2024-03-04T09:25:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/188: write f3 [3982223,17982] 0 2024-03-04T09:25:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/189: dread - d5/da/d28/f3e zero size 2024-03-04T09:25:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/190: creat d5/da/d28/f43 x:0 0 0 2024-03-04T09:25:47.692 INFO:tasks.workunit.client.0.smithi046.stdout:8/161: truncate d7/de/f1f 1080498 0 2024-03-04T09:25:47.733 INFO:tasks.workunit.client.0.smithi046.stdout:4/198: symlink d0/d1f/l47 0 2024-03-04T09:25:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/229: rename d1/d11/d6/d8/d13/d21/c3b to d1/d11/d6/d8/d13/d21/c44 0 2024-03-04T09:25:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/230: truncate d1/d11/d6/d8/f33 1259491 0 2024-03-04T09:25:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/231: write d1/d11/d6/d8/d12/d1c/f31 [4335272,115484] 0 2024-03-04T09:25:47.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/199: dwrite d0/d1f/f45 [0,4194304] 0 2024-03-04T09:25:47.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/200: dread - d0/d3/d16/f37 zero size 2024-03-04T09:25:47.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/201: read d0/d3/d16/d1e/f3e [212680,88960] 0 2024-03-04T09:25:48.288 INFO:tasks.workunit.client.0.smithi046.stdout:6/166: mkdir da/dd/d39 0 2024-03-04T09:25:48.288 INFO:tasks.workunit.client.0.smithi046.stdout:5/187: creat d1/d3/de/d20/f3b x:0 0 0 2024-03-04T09:25:48.311 INFO:tasks.workunit.client.0.smithi046.stdout:3/199: rename d1/d1d/d31/d3d to d1/d1d/d27/d40 0 2024-03-04T09:25:48.580 INFO:tasks.workunit.client.0.smithi046.stdout:7/156: link d0/d4/db/l1a d0/d4/db/d12/d28/l35 0 2024-03-04T09:25:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:2/191: link d5/da/f21 d5/da/d28/f44 0 2024-03-04T09:25:48.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/192: dread - d5/d2c/f2e zero size 2024-03-04T09:25:48.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:25:48.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:25:50.124 INFO:tasks.workunit.client.0.smithi046.stdout:0/188: dwrite d10/f26 [0,4194304] 0 2024-03-04T09:25:50.193 INFO:tasks.workunit.client.0.smithi046.stdout:0/189: dwrite d10/f2e [0,4194304] 0 2024-03-04T09:25:50.456 INFO:tasks.workunit.client.0.smithi046.stdout:9/232: unlink d1/d11/d6/d8/d13/f25 0 2024-03-04T09:25:50.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/188: creat d1/d3/de/d26/f3c x:0 0 0 2024-03-04T09:25:51.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/202: rename d0/d3/d16/d1e/f33 to d0/d1f/f48 0 2024-03-04T09:25:51.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/200: mknod d1/d1d/d27/c41 0 2024-03-04T09:25:51.947 INFO:tasks.workunit.client.0.smithi046.stdout:7/157: creat d0/d4/f36 x:0 0 0 2024-03-04T09:25:52.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/158: dwrite d0/da/f29 [0,4194304] 0 2024-03-04T09:25:52.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/159: stat d0/d4/db/d12 0 2024-03-04T09:25:52.407 INFO:tasks.workunit.client.0.smithi046.stdout:0/190: mkdir d10/d12/d1f/d3f/d4b 0 2024-03-04T09:25:52.423 INFO:tasks.workunit.client.0.smithi046.stdout:9/233: mknod d1/d11/d6/d8/d13/d21/c45 0 2024-03-04T09:25:52.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/234: write d1/d11/d6/d8/d12/d1c/f31 [769065,21124] 0 2024-03-04T09:25:52.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/235: chown d1/d11/d6/d8/d36 67704 1 2024-03-04T09:25:52.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/189: unlink d1/d3/de/d26/c27 0 2024-03-04T09:25:52.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/190: write d1/d3/de/d1d/f33 [1241326,8062] 0 2024-03-04T09:25:52.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/191: chown d1/d3/de/d26/f28 296103656 1 2024-03-04T09:25:52.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/192: creat d1/d3/de/d26/f3d x:0 0 0 2024-03-04T09:25:52.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/193: readlink d1/d3/d1f/l3a 0 2024-03-04T09:25:52.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/203: dread d0/d1f/f2c [0,4194304] 0 2024-03-04T09:25:52.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/204: creat d0/d1f/d25/f49 x:0 0 0 2024-03-04T09:25:52.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/201: dread d1/d21/d35/d24/f1b [0,4194304] 0 2024-03-04T09:25:52.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/202: chown d1/d1d/f37 991344 1 2024-03-04T09:25:52.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/203: dread - d1/f39 zero size 2024-03-04T09:25:52.919 INFO:tasks.workunit.client.0.smithi046.stdout:3/204: dwrite d1/d1d/d31/f3e [0,4194304] 0 2024-03-04T09:25:52.920 INFO:tasks.workunit.client.0.smithi046.stdout:3/205: getdents d1/d1d/d27/d40 0 2024-03-04T09:25:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:2/193: rmdir d5/d2c 39 2024-03-04T09:25:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:2/194: chown d5/da/d1b/l1c 78 1 2024-03-04T09:25:53.401 INFO:tasks.workunit.client.0.smithi046.stdout:9/236: mkdir d1/d11/d6/d8/d1d/d34/d46 0 2024-03-04T09:25:53.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/205: rename d0/d3/d20/f46 to d0/d1f/d35/f4a 0 2024-03-04T09:25:53.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/206: truncate d0/d3/d16/f37 159021 0 2024-03-04T09:25:53.887 INFO:tasks.workunit.client.0.smithi046.stdout:3/206: mkdir d1/d1d/d31/d42 0 2024-03-04T09:25:54.203 INFO:tasks.workunit.client.0.smithi046.stdout:7/160: link d0/d4/db/d12/c22 d0/d4/c37 0 2024-03-04T09:25:54.381 INFO:tasks.workunit.client.0.smithi046.stdout:9/237: mknod d1/d11/d6/d8/d1d/d34/d35/c47 0 2024-03-04T09:25:54.381 INFO:tasks.workunit.client.0.smithi046.stdout:9/238: creat d1/d11/d6/d8/d12/d1c/f48 x:0 0 0 2024-03-04T09:25:54.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/239: dread d1/d11/d6/d8/d12/f30 [0,4194304] 0 2024-03-04T09:25:54.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/240: chown d1/d11/d6/d8/d12/f30 199809 1 2024-03-04T09:25:54.427 INFO:tasks.workunit.client.0.smithi046.stdout:2/195: dread f4 [0,4194304] 0 2024-03-04T09:25:54.427 INFO:tasks.workunit.client.0.smithi046.stdout:2/196: dread - d5/da/f2b zero size 2024-03-04T09:25:54.472 INFO:tasks.workunit.client.0.smithi046.stdout:6/167: write f9 [3318177,110966] 0 2024-03-04T09:25:54.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/168: dread da/dd/f13 [0,4194304] 0 2024-03-04T09:25:54.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/207: creat d0/d3/d16/f4b x:0 0 0 2024-03-04T09:25:54.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/208: rename d0 to d0/d3/d20/d4c 22 2024-03-04T09:25:54.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/169: dwrite da/dd/d2b/f2f [0,4194304] 0 2024-03-04T09:25:54.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/209: write d0/d3/d20/f21 [3346129,122937] 0 2024-03-04T09:25:54.725 INFO:tasks.workunit.client.0.smithi046.stdout:5/194: mkdir d1/d3/d3e 0 2024-03-04T09:25:54.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/161: read d0/da/f2a [2919455,35482] 0 2024-03-04T09:25:55.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/241: creat d1/d11/d6/d8/d1d/d34/f49 x:0 0 0 2024-03-04T09:25:55.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/242: write d1/d11/d6/d8/d12/d1c/f38 [506599,63999] 0 2024-03-04T09:25:55.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/243: chown d1/d11/d6/d8/d13/d21/c45 28399 1 2024-03-04T09:25:55.120 INFO:tasks.workunit.client.0.smithi046.stdout:2/197: creat d5/da/d28/d3f/f45 x:0 0 0 2024-03-04T09:25:55.774 INFO:tasks.workunit.client.0.smithi046.stdout:0/191: dwrite d10/d12/f41 [4194304,4194304] 0 2024-03-04T09:25:55.819 INFO:tasks.workunit.client.0.smithi046.stdout:5/195: creat d1/d3/d3e/f3f x:0 0 0 2024-03-04T09:25:55.876 INFO:tasks.workunit.client.0.smithi046.stdout:5/196: dwrite d1/d3/f23 [4194304,4194304] 0 2024-03-04T09:25:55.939 INFO:tasks.workunit.client.0.smithi046.stdout:5/197: dwrite d1/d3/d1f/f31 [0,4194304] 0 2024-03-04T09:25:55.960 INFO:tasks.workunit.client.0.smithi046.stdout:7/162: mkdir d0/d4/db/d38 0 2024-03-04T09:25:56.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/170: rmdir d1/d28 39 2024-03-04T09:25:56.210 INFO:tasks.workunit.client.0.smithi046.stdout:8/162: sync 2024-03-04T09:25:56.366 INFO:tasks.workunit.client.0.smithi046.stdout:0/192: readlink l5 0 2024-03-04T09:25:56.579 INFO:tasks.workunit.client.0.smithi046.stdout:5/198: link d1/d3/c1e d1/d3/de/c40 0 2024-03-04T09:25:56.579 INFO:tasks.workunit.client.0.smithi046.stdout:5/199: readlink d1/d3/de/d1d/l2a 0 2024-03-04T09:25:56.724 INFO:tasks.workunit.client.0.smithi046.stdout:7/163: link d0/f11 d0/da/f39 0 2024-03-04T09:25:57.045 INFO:tasks.workunit.client.0.smithi046.stdout:8/163: rename d7/fa to d7/de/d28/f37 0 2024-03-04T09:25:57.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/193: getdents d10 0 2024-03-04T09:25:57.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/200: dread d1/d3/f19 [0,4194304] 0 2024-03-04T09:25:57.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/201: dwrite d1/d3/de/d26/f3d [0,4194304] 0 2024-03-04T09:25:57.973 INFO:tasks.workunit.client.0.smithi046.stdout:1/171: unlink d1/l11 0 2024-03-04T09:25:57.973 INFO:tasks.workunit.client.0.smithi046.stdout:1/172: fdatasync d1/f19 0 2024-03-04T09:25:58.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/164: creat d7/de/d13/f38 x:0 0 0 2024-03-04T09:25:58.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/165: fdatasync d7/de/d13/f17 0 2024-03-04T09:25:58.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/166: fdatasync d7/de/d28/f37 0 2024-03-04T09:25:58.525 INFO:tasks.workunit.client.0.smithi046.stdout:3/207: dwrite d1/d1d/d27/f2d [0,4194304] 0 2024-03-04T09:25:58.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/208: dwrite d1/d21/d35/d24/f28 [0,4194304] 0 2024-03-04T09:25:58.757 INFO:tasks.workunit.client.0.smithi046.stdout:0/194: truncate d10/d12/d1f/d2d/f30 655988 0 2024-03-04T09:25:58.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/244: getdents d1/d11/d6/d8/d12/d1c 0 2024-03-04T09:25:59.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/198: getdents d5/da/d28/d3f 0 2024-03-04T09:25:59.246 INFO:tasks.workunit.client.0.smithi046.stdout:2/199: dwrite d5/f13 [0,4194304] 0 2024-03-04T09:25:59.246 INFO:tasks.workunit.client.0.smithi046.stdout:2/200: write d5/f10 [3134678,100287] 0 2024-03-04T09:25:59.383 INFO:tasks.workunit.client.0.smithi046.stdout:1/173: creat d1/d28/f3c x:0 0 0 2024-03-04T09:25:59.511 INFO:tasks.workunit.client.0.smithi046.stdout:8/167: creat d7/d24/f39 x:0 0 0 2024-03-04T09:25:59.603 INFO:tasks.workunit.client.0.smithi046.stdout:6/170: creat da/f3a x:0 0 0 2024-03-04T09:25:59.979 INFO:tasks.workunit.client.0.smithi046.stdout:4/210: dwrite d0/d1f/d25/f26 [8388608,4194304] 0 2024-03-04T09:25:59.979 INFO:tasks.workunit.client.0.smithi046.stdout:4/211: creat d0/d1f/f4d x:0 0 0 2024-03-04T09:25:59.979 INFO:tasks.workunit.client.0.smithi046.stdout:4/212: readlink d0/d1f/l47 0 2024-03-04T09:26:00.240 INFO:tasks.workunit.client.0.smithi046.stdout:0/195: symlink d10/d12/d1f/d2d/l4c 0 2024-03-04T09:26:00.240 INFO:tasks.workunit.client.0.smithi046.stdout:0/196: chown d10/d12/d1f/l25 1638 1 2024-03-04T09:26:00.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/245: truncate d1/d11/d6/d8/d12/f29 3790490 0 2024-03-04T09:26:00.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/246: dread d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:26:00.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/201: mknod d5/da/c46 0 2024-03-04T09:26:00.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/202: chown d5/da/d28/f44 103 1 2024-03-04T09:26:00.645 INFO:tasks.workunit.client.0.smithi046.stdout:1/174: mknod d1/d28/c3d 0 2024-03-04T09:26:00.645 INFO:tasks.workunit.client.0.smithi046.stdout:1/175: dread - d1/f27 zero size 2024-03-04T09:26:00.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/168: mkdir d7/de/d28/d3a 0 2024-03-04T09:26:00.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/171: symlink da/d14/l3b 0 2024-03-04T09:26:00.681 INFO:tasks.workunit.client.0.smithi046.stdout:0/197: symlink d10/d12/d1f/d3b/l4d 0 2024-03-04T09:26:00.681 INFO:tasks.workunit.client.0.smithi046.stdout:0/198: truncate d10/d12/d1f/d3f/f44 33173 0 2024-03-04T09:26:01.379 INFO:tasks.workunit.client.0.smithi046.stdout:2/203: mkdir d5/da/d28/d47 0 2024-03-04T09:26:01.495 INFO:tasks.workunit.client.0.smithi046.stdout:1/176: rename d1/f18 to d1/d28/f3e 0 2024-03-04T09:26:01.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/169: symlink d7/l3b 0 2024-03-04T09:26:01.895 INFO:tasks.workunit.client.0.smithi046.stdout:6/172: rename da/dd/d2b/f2f to da/dd/d2b/f3c 0 2024-03-04T09:26:01.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/199: mkdir d10/d12/d1f/d4e 0 2024-03-04T09:26:01.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/200: chown d10/d12/d1f/d2d/c47 52 1 2024-03-04T09:26:01.895 INFO:tasks.workunit.client.0.smithi046.stdout:6/173: creat da/dd/d2b/f3d x:0 0 0 2024-03-04T09:26:02.335 INFO:tasks.workunit.client.0.smithi046.stdout:4/213: symlink d0/l4e 0 2024-03-04T09:26:02.622 INFO:tasks.workunit.client.0.smithi046.stdout:6/174: mknod da/dd/d2b/c3e 0 2024-03-04T09:26:02.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/177: symlink d1/l3f 0 2024-03-04T09:26:02.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/178: fsync d1/d28/f38 0 2024-03-04T09:26:02.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/179: chown d1/l10 13799344 1 2024-03-04T09:26:02.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/180: dread - d1/d28/f30 zero size 2024-03-04T09:26:03.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/214: mknod d0/d3/c4f 0 2024-03-04T09:26:03.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/175: mkdir da/dd/d22/d3f 0 2024-03-04T09:26:03.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/176: getdents da/dd/d39 0 2024-03-04T09:26:03.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/177: chown da/f3a 29739891 1 2024-03-04T09:26:03.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/201: getdents d10/d12/d1f/d2d 0 2024-03-04T09:26:04.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/215: mkdir d0/d1f/d25/d50 0 2024-03-04T09:26:04.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/202: link fc d10/d12/f4f 0 2024-03-04T09:26:04.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/203: readlink d10/l28 0 2024-03-04T09:26:04.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/216: unlink d0/f2d 0 2024-03-04T09:26:05.099 INFO:tasks.workunit.client.0.smithi046.stdout:4/217: creat d0/d1f/d25/d50/f51 x:0 0 0 2024-03-04T09:26:05.099 INFO:tasks.workunit.client.0.smithi046.stdout:4/218: fdatasync d0/d3/f6 0 2024-03-04T09:26:05.099 INFO:tasks.workunit.client.0.smithi046.stdout:4/219: dread - d0/f39 zero size 2024-03-04T09:26:05.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/204: rmdir d10/d12/d1f/d3b 39 2024-03-04T09:26:05.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/205: rmdir d10/d12/d1f/d3f/d4a 0 2024-03-04T09:26:05.779 INFO:tasks.workunit.client.0.smithi046.stdout:0/206: dwrite d10/d12/d1f/d2d/f49 [0,4194304] 0 2024-03-04T09:26:06.136 INFO:tasks.workunit.client.0.smithi046.stdout:1/181: getdents d1/d28 0 2024-03-04T09:26:06.141 INFO:tasks.workunit.client.0.smithi046.stdout:9/247: write d1/d11/d6/d8/f33 [1001847,29354] 0 2024-03-04T09:26:06.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/170: dwrite d7/de/f1b [0,4194304] 0 2024-03-04T09:26:06.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/171: chown d7/cf 108044 1 2024-03-04T09:26:06.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/172: dwrite d7/de/d13/d2c/f31 [0,4194304] 0 2024-03-04T09:26:06.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/204: mknod d5/c48 0 2024-03-04T09:26:06.405 INFO:tasks.workunit.client.0.smithi046.stdout:3/209: unlink d1/l10 0 2024-03-04T09:26:06.405 INFO:tasks.workunit.client.0.smithi046.stdout:3/210: chown d1/d21/d35/f1f 134811 1 2024-03-04T09:26:06.408 INFO:tasks.workunit.client.0.smithi046.stdout:2/205: write d5/ff [609277,93234] 0 2024-03-04T09:26:06.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/211: write d1/d21/d35/d24/f18 [752239,54515] 0 2024-03-04T09:26:06.424 INFO:tasks.workunit.client.0.smithi046.stdout:6/178: getdents da/dd/d22 0 2024-03-04T09:26:06.424 INFO:tasks.workunit.client.0.smithi046.stdout:6/179: fsync da/dd/f36 0 2024-03-04T09:26:07.166 INFO:tasks.workunit.client.0.smithi046.stdout:0/207: link fd d10/d12/d1f/d2d/f50 0 2024-03-04T09:26:07.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/202: mkdir d1/d3/de/d41 0 2024-03-04T09:26:07.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/203: fsync d1/d3/fc 0 2024-03-04T09:26:07.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/182: creat d1/d28/f40 x:0 0 0 2024-03-04T09:26:07.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/183: dread - d1/f1e zero size 2024-03-04T09:26:07.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/184: chown d1/fd 2 1 2024-03-04T09:26:07.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/248: creat d1/d11/d6/d8/d12/f4a x:0 0 0 2024-03-04T09:26:07.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/220: getdents d0/d1f/d25/d50 0 2024-03-04T09:26:07.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/249: fsync d1/d11/d6/d8/d1d/d34/f49 0 2024-03-04T09:26:07.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/221: rename d0/d1f/d25/d50 to d0/d1f/d25/d50/d52 22 2024-03-04T09:26:07.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/222: chown d0/d3/d20/l32 1 1 2024-03-04T09:26:07.835 INFO:tasks.workunit.client.0.smithi046.stdout:7/164: mknod d0/c3a 0 2024-03-04T09:26:07.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/165: readlink d0/d4/db/l27 0 2024-03-04T09:26:07.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/166: chown d0/d4/f1f 1 1 2024-03-04T09:26:07.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/167: chown d0/da/f29 3 1 2024-03-04T09:26:08.573 INFO:tasks.workunit.client.0.smithi046.stdout:2/206: link d5/da/d28/c31 d5/da/d28/d3f/c49 0 2024-03-04T09:26:08.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/207: truncate d5/d2c/f2e 490782 0 2024-03-04T09:26:08.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/208: dwrite d5/d2c/f3d [0,4194304] 0 2024-03-04T09:26:08.751 INFO:tasks.workunit.client.0.smithi046.stdout:6/180: symlink da/dd/d39/l40 0 2024-03-04T09:26:08.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/208: symlink d10/l51 0 2024-03-04T09:26:08.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/209: chown d10/f26 5006 1 2024-03-04T09:26:09.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/204: unlink d1/d3/d1f/l3a 0 2024-03-04T09:26:09.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/185: creat d1/d28/f41 x:0 0 0 2024-03-04T09:26:09.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/250: link d1/d11/d6/d8/d12/l1b d1/d11/d6/d8/d1d/l4b 0 2024-03-04T09:26:09.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/251: write d1/d11/d6/d8/fd [2528216,70803] 0 2024-03-04T09:26:09.461 INFO:tasks.workunit.client.0.smithi046.stdout:9/252: write d1/d11/d6/d8/d12/f30 [43298,89412] 0 2024-03-04T09:26:10.149 INFO:tasks.workunit.client.0.smithi046.stdout:7/168: mkdir d0/d4/db/d3b 0 2024-03-04T09:26:10.149 INFO:tasks.workunit.client.0.smithi046.stdout:7/169: truncate d0/f11 1001959 0 2024-03-04T09:26:10.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/173: mkdir d7/de/d13/d3c 0 2024-03-04T09:26:10.342 INFO:tasks.workunit.client.0.smithi046.stdout:8/174: dwrite d7/de/d28/f2e [0,4194304] 0 2024-03-04T09:26:10.342 INFO:tasks.workunit.client.0.smithi046.stdout:8/175: chown d7/de/d13/d2c/f2d 23484 1 2024-03-04T09:26:10.342 INFO:tasks.workunit.client.0.smithi046.stdout:8/176: fdatasync d7/de/d28/f2b 0 2024-03-04T09:26:10.385 INFO:tasks.workunit.client.0.smithi046.stdout:3/212: mkdir d1/d21/d35/d43 0 2024-03-04T09:26:10.479 INFO:tasks.workunit.client.0.smithi046.stdout:2/209: symlink d5/da/d1b/l4a 0 2024-03-04T09:26:10.479 INFO:tasks.workunit.client.0.smithi046.stdout:2/210: readlink d5/da/l26 0 2024-03-04T09:26:10.639 INFO:tasks.workunit.client.0.smithi046.stdout:6/181: symlink da/dd/d22/l41 0 2024-03-04T09:26:10.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/223: symlink d0/d3/d16/l53 0 2024-03-04T09:26:11.220 INFO:tasks.workunit.client.0.smithi046.stdout:9/253: mkdir d1/d11/d6/d8/d1d/d34/d46/d4c 0 2024-03-04T09:26:11.220 INFO:tasks.workunit.client.0.smithi046.stdout:9/254: chown d1/d11/d6/d8/l3d 3859 1 2024-03-04T09:26:11.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/177: mknod d7/de/d13/d3c/c3d 0 2024-03-04T09:26:11.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/178: truncate d7/de/d13/f35 982414 0 2024-03-04T09:26:11.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/213: mknod d1/d21/d35/d43/c44 0 2024-03-04T09:26:11.781 INFO:tasks.workunit.client.0.smithi046.stdout:2/211: rename d5/d2c/f3d to d5/da/d28/d3f/f4b 0 2024-03-04T09:26:11.781 INFO:tasks.workunit.client.0.smithi046.stdout:2/212: readlink d5/l16 0 2024-03-04T09:26:11.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/213: truncate d5/da/d28/f35 2098288 0 2024-03-04T09:26:12.463 INFO:tasks.workunit.client.0.smithi046.stdout:4/224: truncate d0/d1f/f45 4076662 0 2024-03-04T09:26:12.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/205: getdents d1/d3/d1f 0 2024-03-04T09:26:12.943 INFO:tasks.workunit.client.0.smithi046.stdout:9/255: dread d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:26:12.943 INFO:tasks.workunit.client.0.smithi046.stdout:9/256: write d1/d11/d6/d8/f33 [2007596,56953] 0 2024-03-04T09:26:13.245 INFO:tasks.workunit.client.0.smithi046.stdout:3/214: creat d1/d21/d35/d43/f45 x:0 0 0 2024-03-04T09:26:13.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/182: rename da/dd/c11 to da/d14/d1e/d2c/c42 0 2024-03-04T09:26:13.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/183: fsync da/f3a 0 2024-03-04T09:26:13.472 INFO:tasks.workunit.client.0.smithi046.stdout:2/214: creat d5/da/d1b/f4c x:0 0 0 2024-03-04T09:26:13.472 INFO:tasks.workunit.client.0.smithi046.stdout:2/215: chown d5/d2c/f2e 62025 1 2024-03-04T09:26:13.654 INFO:tasks.workunit.client.0.smithi046.stdout:4/225: dread d0/d1f/d25/f26 [0,4194304] 0 2024-03-04T09:26:13.771 INFO:tasks.workunit.client.0.smithi046.stdout:5/206: getdents d1/d3/de 0 2024-03-04T09:26:14.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/215: fsync d1/f1c 0 2024-03-04T09:26:14.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/216: write d1/d21/d35/f36 [627538,45988] 0 2024-03-04T09:26:14.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/217: creat d1/d21/d35/d43/f46 x:0 0 0 2024-03-04T09:26:14.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/218: dread - d1/d1d/f3a zero size 2024-03-04T09:26:14.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/219: fdatasync d1/d21/d35/d43/f45 0 2024-03-04T09:26:14.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/184: creat da/d14/d1e/d27/f43 x:0 0 0 2024-03-04T09:26:14.601 INFO:tasks.workunit.client.0.smithi046.stdout:4/226: rename d0/d3/d3b/l24 to d0/d3/d16/d1e/l54 0 2024-03-04T09:26:14.603 INFO:tasks.workunit.client.0.smithi046.stdout:5/207: unlink d1/d3/de/d26/c30 0 2024-03-04T09:26:15.028 INFO:tasks.workunit.client.0.smithi046.stdout:6/185: dread da/dd/fe [0,4194304] 0 2024-03-04T09:26:15.155 INFO:tasks.workunit.client.0.smithi046.stdout:4/227: symlink d0/d3/d16/d1e/l55 0 2024-03-04T09:26:15.433 INFO:tasks.workunit.client.0.smithi046.stdout:2/216: mknod d5/da/c4d 0 2024-03-04T09:26:15.434 INFO:tasks.workunit.client.0.smithi046.stdout:5/208: rename d1/d3/de/d26/f3c to d1/d3/de/d20/f42 0 2024-03-04T09:26:15.434 INFO:tasks.workunit.client.0.smithi046.stdout:5/209: creat d1/d3/de/d26/f43 x:0 0 0 2024-03-04T09:26:15.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/210: write d10/d36/f40 [1142476,91882] 0 2024-03-04T09:26:15.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/217: dwrite d5/f3b [0,4194304] 0 2024-03-04T09:26:15.577 INFO:tasks.workunit.client.0.smithi046.stdout:6/186: mkdir da/dd/d2b/d44 0 2024-03-04T09:26:15.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/170: write d0/f16 [496489,129196] 0 2024-03-04T09:26:16.058 INFO:tasks.workunit.client.0.smithi046.stdout:0/211: dread d10/d12/f41 [4194304,4194304] 0 2024-03-04T09:26:16.058 INFO:tasks.workunit.client.0.smithi046.stdout:0/212: chown f7 7293257 1 2024-03-04T09:26:16.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/187: creat da/dd/d39/f45 x:0 0 0 2024-03-04T09:26:16.481 INFO:tasks.workunit.client.0.smithi046.stdout:6/188: dwrite da/d14/d1e/f30 [0,4194304] 0 2024-03-04T09:26:17.178 INFO:tasks.workunit.client.0.smithi046.stdout:8/179: write d7/de/f1f [1685377,74298] 0 2024-03-04T09:26:17.178 INFO:tasks.workunit.client.0.smithi046.stdout:8/180: fsync d7/de/d13/f35 0 2024-03-04T09:26:17.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/228: creat d0/f56 x:0 0 0 2024-03-04T09:26:17.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/229: dread - d0/d1f/d25/f49 zero size 2024-03-04T09:26:17.428 INFO:tasks.workunit.client.0.smithi046.stdout:0/213: rename d10/d12/d1f/d4e to d10/d12/d52 0 2024-03-04T09:26:17.461 INFO:tasks.workunit.client.0.smithi046.stdout:0/214: dread d10/d12/d1f/d2d/f49 [0,4194304] 0 2024-03-04T09:26:17.484 INFO:tasks.workunit.client.0.smithi046.stdout:0/215: dread d10/f2f [0,4194304] 0 2024-03-04T09:26:17.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/186: creat d1/f42 x:0 0 0 2024-03-04T09:26:17.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/187: dread - d1/fe zero size 2024-03-04T09:26:18.095 INFO:tasks.workunit.client.0.smithi046.stdout:4/230: creat d0/d3/f57 x:0 0 0 2024-03-04T09:26:18.334 INFO:tasks.workunit.client.0.smithi046.stdout:0/216: symlink d10/d12/d1f/d2d/l53 0 2024-03-04T09:26:18.334 INFO:tasks.workunit.client.0.smithi046.stdout:0/217: chown d10/l1e 829343 1 2024-03-04T09:26:18.414 INFO:tasks.workunit.client.0.smithi046.stdout:0/218: dwrite ff [0,4194304] 0 2024-03-04T09:26:18.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/219: read d10/d12/f1b [1055028,14325] 0 2024-03-04T09:26:18.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/188: creat d1/d28/f43 x:0 0 0 2024-03-04T09:26:18.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/231: mknod d0/c58 0 2024-03-04T09:26:19.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/232: unlink d0/d3/d16/d17/c22 0 2024-03-04T09:26:19.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:26:19.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:26:19.123 INFO:tasks.workunit.client.0.smithi046.stdout:1/189: truncate d1/d28/f35 147064 0 2024-03-04T09:26:19.336 INFO:tasks.workunit.client.0.smithi046.stdout:3/220: dwrite d1/d21/d35/d24/f1b [0,4194304] 0 2024-03-04T09:26:19.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/233: mkdir d0/d3/d20/d59 0 2024-03-04T09:26:19.910 INFO:tasks.workunit.client.0.smithi046.stdout:5/210: mkdir d1/d44 0 2024-03-04T09:26:20.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/221: link d1/d1d/d27/f2e d1/d21/d35/d2b/f47 0 2024-03-04T09:26:20.437 INFO:tasks.workunit.client.0.smithi046.stdout:4/234: creat d0/d3/d16/f5a x:0 0 0 2024-03-04T09:26:20.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/211: mknod d1/d3/d3e/c45 0 2024-03-04T09:26:20.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/212: creat d1/d3/d3e/f46 x:0 0 0 2024-03-04T09:26:20.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/213: chown d1/f7 778248 1 2024-03-04T09:26:20.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/214: chown d1/d3/de/d26/f28 9679309 1 2024-03-04T09:26:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:3/222: symlink d1/d21/d35/d2b/l48 0 2024-03-04T09:26:20.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/215: write d1/d3/f19 [1514847,83941] 0 2024-03-04T09:26:20.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/216: creat d1/d3/de/d1d/d24/f47 x:0 0 0 2024-03-04T09:26:20.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/217: dwrite d1/d3/de/f10 [0,4194304] 0 2024-03-04T09:26:20.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/257: sync 2024-03-04T09:26:20.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/220: dwrite d10/d12/f3d [0,4194304] 0 2024-03-04T09:26:20.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/221: creat d10/d36/f54 x:0 0 0 2024-03-04T09:26:20.990 INFO:tasks.workunit.client.0.smithi046.stdout:1/190: dwrite d1/d28/f35 [0,4194304] 0 2024-03-04T09:26:20.990 INFO:tasks.workunit.client.0.smithi046.stdout:1/191: chown d1/l20 385751785 1 2024-03-04T09:26:21.299 INFO:tasks.workunit.client.0.smithi046.stdout:4/235: mkdir d0/d1f/d5b 0 2024-03-04T09:26:21.299 INFO:tasks.workunit.client.0.smithi046.stdout:4/236: read - d0/f56 zero size 2024-03-04T09:26:21.299 INFO:tasks.workunit.client.0.smithi046.stdout:7/171: mkdir d0/d3c 0 2024-03-04T09:26:21.733 INFO:tasks.workunit.client.0.smithi046.stdout:6/189: mkdir da/dd/d46 0 2024-03-04T09:26:21.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/190: write da/dd/f36 [39154,117801] 0 2024-03-04T09:26:21.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/191: read f5 [2277983,81486] 0 2024-03-04T09:26:21.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/218: rmdir d1/d3/de/d20/d38 0 2024-03-04T09:26:21.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/258: mkdir d1/d11/d6/d8/d1d/d34/d4d 0 2024-03-04T09:26:21.803 INFO:tasks.workunit.client.0.smithi046.stdout:6/192: dwrite da/f3a [0,4194304] 0 2024-03-04T09:26:21.829 INFO:tasks.workunit.client.0.smithi046.stdout:6/193: dread da/f3a [0,4194304] 0 2024-03-04T09:26:21.832 INFO:tasks.workunit.client.0.smithi046.stdout:2/218: creat d5/f4e x:0 0 0 2024-03-04T09:26:21.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/219: write d5/da/d28/d3f/f4b [2710363,52964] 0 2024-03-04T09:26:21.865 INFO:tasks.workunit.client.0.smithi046.stdout:2/220: dread - d5/da/d28/f44 zero size 2024-03-04T09:26:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/221: dwrite d5/da/d1b/f25 [0,4194304] 0 2024-03-04T09:26:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/222: creat d5/da/d1b/f4f x:0 0 0 2024-03-04T09:26:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/223: write d5/da/d28/f2f [1399223,10057] 0 2024-03-04T09:26:22.154 INFO:tasks.workunit.client.0.smithi046.stdout:0/222: unlink d10/f2f 0 2024-03-04T09:26:22.545 INFO:tasks.workunit.client.0.smithi046.stdout:1/192: stat d1/d28/f39 0 2024-03-04T09:26:22.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/237: mknod d0/d1f/c5c 0 2024-03-04T09:26:22.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/238: dread - d0/d3/d16/f5a zero size 2024-03-04T09:26:22.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/239: read d0/d3/d16/d1e/f3e [10133,61818] 0 2024-03-04T09:26:22.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/172: creat d0/d4/db/f3d x:0 0 0 2024-03-04T09:26:23.305 INFO:tasks.workunit.client.0.smithi046.stdout:5/219: rename d1/d3/de/d1d/d24/f47 to d1/d3/de/d41/f48 0 2024-03-04T09:26:23.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/259: creat d1/d11/d6/f4e x:0 0 0 2024-03-04T09:26:23.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/260: chown d1/d11/d6/d8/fd 350 1 2024-03-04T09:26:23.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/261: fdatasync d1/d11/d6/d8/d12/f1e 0 2024-03-04T09:26:23.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/262: fdatasync d1/d11/d6/d8/d12/d1c/f48 0 2024-03-04T09:26:23.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/263: write d1/d11/d6/d8/fd [4437434,74238] 0 2024-03-04T09:26:23.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/264: dwrite d1/d11/d6/d8/d12/f30 [0,4194304] 0 2024-03-04T09:26:23.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/265: chown d1/d11/d6/d8/d13/f24 763 1 2024-03-04T09:26:23.589 INFO:tasks.workunit.client.0.smithi046.stdout:8/181: unlink d7/l27 0 2024-03-04T09:26:23.593 INFO:tasks.workunit.client.0.smithi046.stdout:8/182: write d7/fd [944877,25633] 0 2024-03-04T09:26:23.593 INFO:tasks.workunit.client.0.smithi046.stdout:8/183: chown d7/f1a 0 1 2024-03-04T09:26:24.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/224: mknod d5/da/d28/c50 0 2024-03-04T09:26:24.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/225: chown d5/da/d1b/f25 123821442 1 2024-03-04T09:26:24.194 INFO:tasks.workunit.client.0.smithi046.stdout:3/223: write d1/f1e [1634607,46274] 0 2024-03-04T09:26:24.194 INFO:tasks.workunit.client.0.smithi046.stdout:3/224: creat d1/d21/d35/d43/f49 x:0 0 0 2024-03-04T09:26:24.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/223: symlink d10/d12/l55 0 2024-03-04T09:26:25.696 INFO:tasks.workunit.client.0.smithi046.stdout:6/194: rename da/d14/d1e/c38 to da/dd/d46/c47 0 2024-03-04T09:26:25.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/195: dwrite da/dd/d39/f45 [0,4194304] 0 2024-03-04T09:26:26.542 INFO:tasks.workunit.client.0.smithi046.stdout:3/225: truncate d1/d1d/d27/f2d 1962907 0 2024-03-04T09:26:27.290 INFO:tasks.workunit.client.0.smithi046.stdout:7/173: dwrite d0/d4/db/d12/f1d [4194304,4194304] 0 2024-03-04T09:26:27.290 INFO:tasks.workunit.client.0.smithi046.stdout:7/174: write d0/d4/f36 [599623,67137] 0 2024-03-04T09:26:28.836 INFO:tasks.workunit.client.0.smithi046.stdout:8/184: getdents d7/de/d28 0 2024-03-04T09:26:29.036 INFO:tasks.workunit.client.0.smithi046.stdout:7/175: unlink d0/d2d/l33 0 2024-03-04T09:26:29.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/176: truncate d0/d4/db/f3d 753900 0 2024-03-04T09:26:29.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/266: dwrite d1/d11/f7 [0,4194304] 0 2024-03-04T09:26:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/226: write d5/f1f [1173510,100429] 0 2024-03-04T09:26:29.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/226: write d1/d1d/d27/f2d [1382765,28245] 0 2024-03-04T09:26:29.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/177: symlink d0/d4/db/d12/l3e 0 2024-03-04T09:26:29.382 INFO:tasks.workunit.client.0.smithi046.stdout:7/178: dread - d0/d4/db/d12/f2c zero size 2024-03-04T09:26:29.570 INFO:tasks.workunit.client.0.smithi046.stdout:9/267: mknod d1/d11/d6/d8/d12/d1c/c4f 0 2024-03-04T09:26:29.574 INFO:tasks.workunit.client.0.smithi046.stdout:9/268: read d1/d11/d6/d8/d12/d1c/f38 [367311,39348] 0 2024-03-04T09:26:29.594 INFO:tasks.workunit.client.0.smithi046.stdout:9/269: dread d1/d11/d6/d8/d13/f24 [0,4194304] 0 2024-03-04T09:26:29.756 INFO:tasks.workunit.client.0.smithi046.stdout:2/227: mkdir d5/d2c/d51 0 2024-03-04T09:26:29.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/227: mkdir d1/d1d/d27/d4a 0 2024-03-04T09:26:29.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/270: symlink d1/d11/d6/d8/d1d/d34/d46/l50 0 2024-03-04T09:26:30.104 INFO:tasks.workunit.client.0.smithi046.stdout:2/228: getdents d5/da 0 2024-03-04T09:26:30.359 INFO:tasks.workunit.client.0.smithi046.stdout:3/228: rmdir d1/d1d/d31/d42 0 2024-03-04T09:26:30.359 INFO:tasks.workunit.client.0.smithi046.stdout:3/229: chown d1/d21/d35/d24/f1b 50861423 1 2024-03-04T09:26:30.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/220: creat d1/d3/de/f49 x:0 0 0 2024-03-04T09:26:30.419 INFO:tasks.workunit.client.0.smithi046.stdout:5/221: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:26:30.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/271: creat d1/d11/d6/d8/d36/f51 x:0 0 0 2024-03-04T09:26:30.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/272: dread d1/d11/d6/d8/d12/d1c/f31 [0,4194304] 0 2024-03-04T09:26:30.616 INFO:tasks.workunit.client.0.smithi046.stdout:9/273: dwrite d1/d11/d6/d8/d13/f2c [0,4194304] 0 2024-03-04T09:26:30.616 INFO:tasks.workunit.client.0.smithi046.stdout:9/274: chown d1/d11/d6/d8/d1d/l4b 3184 1 2024-03-04T09:26:30.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/229: creat d5/da/d28/d3f/f52 x:0 0 0 2024-03-04T09:26:30.743 INFO:tasks.workunit.client.0.smithi046.stdout:3/230: creat d1/d21/d35/d2b/f4b x:0 0 0 2024-03-04T09:26:30.743 INFO:tasks.workunit.client.0.smithi046.stdout:3/231: write d1/f1e [2253754,80617] 0 2024-03-04T09:26:30.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/222: write d1/d3/de/f10 [4829519,3722] 0 2024-03-04T09:26:30.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/240: mknod d0/d3/c5d 0 2024-03-04T09:26:30.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/241: dread - d0/d3/d16/f4b zero size 2024-03-04T09:26:31.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/232: creat d1/d1d/f4c x:0 0 0 2024-03-04T09:26:31.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/233: stat d1/d21/d35/d2b/l48 0 2024-03-04T09:26:31.970 INFO:tasks.workunit.client.0.smithi046.stdout:4/242: unlink d0/d3/d3b/c1d 0 2024-03-04T09:26:31.970 INFO:tasks.workunit.client.0.smithi046.stdout:4/243: stat d0/d3 0 2024-03-04T09:26:31.970 INFO:tasks.workunit.client.0.smithi046.stdout:4/244: chown d0/l9 0 1 2024-03-04T09:26:32.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/234: dwrite d1/d21/d35/d24/f1b [0,4194304] 0 2024-03-04T09:26:32.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/193: rmdir d1/d28 39 2024-03-04T09:26:32.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/194: creat d1/f44 x:0 0 0 2024-03-04T09:26:32.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/195: read - d1/f27 zero size 2024-03-04T09:26:32.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/196: dread - d1/d28/f41 zero size 2024-03-04T09:26:32.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/224: dwrite d10/d12/d1f/d2d/f30 [0,4194304] 0 2024-03-04T09:26:32.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/225: read ff [2460114,108419] 0 2024-03-04T09:26:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/245: symlink d0/d3/d16/l5e 0 2024-03-04T09:26:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/246: fsync d0/d3/d16/f4b 0 2024-03-04T09:26:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/247: fsync d0/f56 0 2024-03-04T09:26:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/248: fsync d0/d3/f4 0 2024-03-04T09:26:33.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/197: creat d1/d28/f45 x:0 0 0 2024-03-04T09:26:33.665 INFO:tasks.workunit.client.0.smithi046.stdout:0/226: dread - d10/d36/f54 zero size 2024-03-04T09:26:33.665 INFO:tasks.workunit.client.0.smithi046.stdout:0/227: fdatasync d10/d12/d1f/d2d/f32 0 2024-03-04T09:26:33.666 INFO:tasks.workunit.client.0.smithi046.stdout:0/228: read f7 [676557,50038] 0 2024-03-04T09:26:33.751 INFO:tasks.workunit.client.0.smithi046.stdout:8/185: write d7/f1a [721572,76430] 0 2024-03-04T09:26:34.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/229: creat d10/d12/f56 x:0 0 0 2024-03-04T09:26:34.329 INFO:tasks.workunit.client.0.smithi046.stdout:1/198: mknod d1/c46 0 2024-03-04T09:26:34.335 INFO:tasks.workunit.client.0.smithi046.stdout:7/179: dwrite d0/f11 [0,4194304] 0 2024-03-04T09:26:34.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/230: symlink d10/d12/d1f/d3b/l57 0 2024-03-04T09:26:34.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/231: readlink d10/d12/l55 0 2024-03-04T09:26:35.199 INFO:tasks.workunit.client.0.smithi046.stdout:6/196: sync 2024-03-04T09:26:35.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/223: write d1/d3/de/d1d/d24/f35 [841310,2428] 0 2024-03-04T09:26:35.261 INFO:tasks.workunit.client.0.smithi046.stdout:2/230: dwrite d5/d2c/f2e [0,4194304] 0 2024-03-04T09:26:35.261 INFO:tasks.workunit.client.0.smithi046.stdout:2/231: getdents d5/d2c/d51 0 2024-03-04T09:26:35.321 INFO:tasks.workunit.client.0.smithi046.stdout:2/232: dwrite d5/da/d1b/f4f [0,4194304] 0 2024-03-04T09:26:35.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/197: chown da/dd/lf 47 1 2024-03-04T09:26:35.777 INFO:tasks.workunit.client.0.smithi046.stdout:6/198: dwrite da/d14/d1e/d2c/f35 [0,4194304] 0 2024-03-04T09:26:35.777 INFO:tasks.workunit.client.0.smithi046.stdout:6/199: creat da/d14/d1e/d2c/f48 x:0 0 0 2024-03-04T09:26:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/224: rmdir d1 39 2024-03-04T09:26:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/225: dread - d1/d3/de/f49 zero size 2024-03-04T09:26:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/226: chown d1/d3/l2f 898580 1 2024-03-04T09:26:36.106 INFO:tasks.workunit.client.0.smithi046.stdout:9/275: rename d1/d11/f7 to d1/d11/d6/d8/d12/f52 0 2024-03-04T09:26:36.106 INFO:tasks.workunit.client.0.smithi046.stdout:9/276: fdatasync d1/d11/d6/d8/d1d/d34/f49 0 2024-03-04T09:26:36.106 INFO:tasks.workunit.client.0.smithi046.stdout:9/277: readlink d1/d11/d6/d8/d1d/l4b 0 2024-03-04T09:26:36.118 INFO:tasks.workunit.client.0.smithi046.stdout:9/278: dread d1/d11/d6/d8/d12/d1c/f38 [0,4194304] 0 2024-03-04T09:26:36.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/279: read d1/d11/d6/d8/d12/f52 [5237093,128526] 0 2024-03-04T09:26:36.120 INFO:tasks.workunit.client.0.smithi046.stdout:9/280: chown d1/d11/d6/d8/d12/d1c/d26 1445442330 1 2024-03-04T09:26:36.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/249: write d0/d3/d16/f37 [999399,110743] 0 2024-03-04T09:26:36.581 INFO:tasks.workunit.client.0.smithi046.stdout:6/200: creat da/d14/d1e/f49 x:0 0 0 2024-03-04T09:26:36.581 INFO:tasks.workunit.client.0.smithi046.stdout:6/201: fdatasync da/d14/d17/f1b 0 2024-03-04T09:26:36.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/227: mknod d1/d3/de/d1d/c4a 0 2024-03-04T09:26:36.834 INFO:tasks.workunit.client.0.smithi046.stdout:3/235: rename d1/d1d/d27/c41 to d1/d21/d35/d2b/c4d 0 2024-03-04T09:26:36.945 INFO:tasks.workunit.client.0.smithi046.stdout:9/281: mknod d1/d11/d3e/c53 0 2024-03-04T09:26:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/282: dread d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:26:36.987 INFO:tasks.workunit.client.0.smithi046.stdout:9/283: write d1/d11/d6/d8/f1a [1755865,126837] 0 2024-03-04T09:26:37.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/284: dwrite d1/d11/d6/d8/d12/d1c/f41 [0,4194304] 0 2024-03-04T09:26:37.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/285: chown d1/d11/d6/d8/d12/d1c/f41 762040938 1 2024-03-04T09:26:37.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/286: fdatasync d1/d11/d6/d8/d12/d1c/f38 0 2024-03-04T09:26:37.076 INFO:tasks.workunit.client.0.smithi046.stdout:4/250: mkdir d0/d5f 0 2024-03-04T09:26:37.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/180: write d0/da/f2a [2449254,43883] 0 2024-03-04T09:26:37.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/181: fdatasync d0/f16 0 2024-03-04T09:26:37.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/182: truncate d0/d4/db/f2b 544856 0 2024-03-04T09:26:37.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/183: stat d0/c23 0 2024-03-04T09:26:37.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/184: truncate d0/f31 1026025 0 2024-03-04T09:26:37.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/185: chown d0/d4/db/d12/c1c 0 1 2024-03-04T09:26:37.245 INFO:tasks.workunit.client.0.smithi046.stdout:8/186: mkdir d7/de/d3e 0 2024-03-04T09:26:37.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/202: mkdir da/d14/d1e/d27/d4a 0 2024-03-04T09:26:37.521 INFO:tasks.workunit.client.0.smithi046.stdout:6/203: dwrite da/d14/d1e/f26 [0,4194304] 0 2024-03-04T09:26:37.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/204: dread da/dd/f36 [0,4194304] 0 2024-03-04T09:26:37.557 INFO:tasks.workunit.client.0.smithi046.stdout:5/228: mknod d1/d3/de/c4b 0 2024-03-04T09:26:37.576 INFO:tasks.workunit.client.0.smithi046.stdout:6/205: dwrite da/f32 [0,4194304] 0 2024-03-04T09:26:37.720 INFO:tasks.workunit.client.0.smithi046.stdout:3/236: symlink d1/d1d/d27/d40/l4e 0 2024-03-04T09:26:37.721 INFO:tasks.workunit.client.0.smithi046.stdout:3/237: creat d1/d21/d35/d43/f4f x:0 0 0 2024-03-04T09:26:37.721 INFO:tasks.workunit.client.0.smithi046.stdout:3/238: creat d1/d1d/f50 x:0 0 0 2024-03-04T09:26:38.213 INFO:tasks.workunit.client.0.smithi046.stdout:9/287: symlink d1/d11/d6/d8/d36/l54 0 2024-03-04T09:26:38.214 INFO:tasks.workunit.client.0.smithi046.stdout:9/288: chown d1/d11/d6/d8/d36/l37 48375904 1 2024-03-04T09:26:38.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/186: dread d0/d4/f36 [0,4194304] 0 2024-03-04T09:26:38.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/187: fsync d0/da/f29 0 2024-03-04T09:26:38.951 INFO:tasks.workunit.client.0.smithi046.stdout:8/187: stat d7/de/d13/f35 0 2024-03-04T09:26:39.420 INFO:tasks.workunit.client.0.smithi046.stdout:6/206: unlink da/dd/d46/c47 0 2024-03-04T09:26:39.420 INFO:tasks.workunit.client.0.smithi046.stdout:6/207: dread - da/d14/d1e/f33 zero size 2024-03-04T09:26:39.420 INFO:tasks.workunit.client.0.smithi046.stdout:6/208: chown da/dd/d2b/d44 0 1 2024-03-04T09:26:39.420 INFO:tasks.workunit.client.0.smithi046.stdout:6/209: write da/dd/f13 [4629837,14415] 0 2024-03-04T09:26:39.421 INFO:tasks.workunit.client.0.smithi046.stdout:6/210: read f5 [3751785,47622] 0 2024-03-04T09:26:39.421 INFO:tasks.workunit.client.0.smithi046.stdout:6/211: chown c1 6607453 1 2024-03-04T09:26:39.421 INFO:tasks.workunit.client.0.smithi046.stdout:6/212: chown da/dd 46 1 2024-03-04T09:26:39.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/239: mkdir d1/d1d/d31/d51 0 2024-03-04T09:26:40.713 INFO:tasks.workunit.client.0.smithi046.stdout:6/213: write da/dd/fe [932223,73529] 0 2024-03-04T09:26:41.131 INFO:tasks.workunit.client.0.smithi046.stdout:2/233: link d5/f3b d5/da/f53 0 2024-03-04T09:26:41.131 INFO:tasks.workunit.client.0.smithi046.stdout:2/234: fdatasync d5/da/f2b 0 2024-03-04T09:26:41.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/235: write d5/da/d28/d3f/f45 [311161,124586] 0 2024-03-04T09:26:41.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/229: getdents d1/d3/de/d1d/d24 0 2024-03-04T09:26:41.508 INFO:tasks.workunit.client.0.smithi046.stdout:5/230: chown d1/d3/c17 30620 1 2024-03-04T09:26:41.669 INFO:tasks.workunit.client.0.smithi046.stdout:3/240: stat d1/c16 0 2024-03-04T09:26:41.669 INFO:tasks.workunit.client.0.smithi046.stdout:3/241: truncate d1/d21/d35/d2b/f47 236384 0 2024-03-04T09:26:41.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/242: dread d1/f1e [0,4194304] 0 2024-03-04T09:26:41.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/243: chown d1/d21/d26 1643538 1 2024-03-04T09:26:41.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/244: dread - d1/d1d/f50 zero size 2024-03-04T09:26:41.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/245: write d1/d21/d35/d2b/f38 [318792,99501] 0 2024-03-04T09:26:41.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/246: dwrite d1/d21/d35/d2b/f4b [0,4194304] 0 2024-03-04T09:26:41.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/247: chown d1/d21/d35/d43/f45 3 1 2024-03-04T09:26:41.818 INFO:tasks.workunit.client.0.smithi046.stdout:6/214: mkdir da/d14/d1e/d27/d4b 0 2024-03-04T09:26:41.818 INFO:tasks.workunit.client.0.smithi046.stdout:6/215: dread - da/d14/d1e/d27/f43 zero size 2024-03-04T09:26:41.818 INFO:tasks.workunit.client.0.smithi046.stdout:6/216: readlink da/d14/l3b 0 2024-03-04T09:26:41.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/236: mkdir d5/d38/d54 0 2024-03-04T09:26:42.124 INFO:tasks.workunit.client.0.smithi046.stdout:8/188: truncate d7/de/d28/f2b 69033 0 2024-03-04T09:26:42.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/217: symlink da/d14/d17/l4c 0 2024-03-04T09:26:42.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/218: getdents da/dd/d22/d3f 0 2024-03-04T09:26:42.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/219: write da/dd/fe [52131,98977] 0 2024-03-04T09:26:42.774 INFO:tasks.workunit.client.0.smithi046.stdout:8/189: write d7/de/f21 [1954517,111185] 0 2024-03-04T09:26:42.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/220: mkdir da/d4d 0 2024-03-04T09:26:43.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/237: getdents d5/da/d1b 0 2024-03-04T09:26:43.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/221: mkdir da/d4e 0 2024-03-04T09:26:43.036 INFO:tasks.workunit.client.0.smithi046.stdout:6/222: getdents da/d4e 0 2024-03-04T09:26:43.036 INFO:tasks.workunit.client.0.smithi046.stdout:6/223: write da/d14/d1e/d2c/f48 [1045970,31334] 0 2024-03-04T09:26:43.043 INFO:tasks.workunit.client.0.smithi046.stdout:2/238: write d5/da/f14 [955445,91928] 0 2024-03-04T09:26:43.043 INFO:tasks.workunit.client.0.smithi046.stdout:2/239: creat d5/da/d28/f55 x:0 0 0 2024-03-04T09:26:43.095 INFO:tasks.workunit.client.0.smithi046.stdout:6/224: dwrite da/d14/d1e/d2c/f35 [0,4194304] 0 2024-03-04T09:26:44.195 INFO:tasks.workunit.client.0.smithi046.stdout:6/225: mknod da/dd/d22/d3f/c4f 0 2024-03-04T09:26:44.474 INFO:tasks.workunit.client.0.smithi046.stdout:2/240: mkdir d5/d56 0 2024-03-04T09:26:44.474 INFO:tasks.workunit.client.0.smithi046.stdout:2/241: fdatasync d5/da/d28/f3e 0 2024-03-04T09:26:44.474 INFO:tasks.workunit.client.0.smithi046.stdout:2/242: write d5/f1f [4119649,10693] 0 2024-03-04T09:26:44.731 INFO:tasks.workunit.client.0.smithi046.stdout:6/226: mknod da/d4d/c50 0 2024-03-04T09:26:44.770 INFO:tasks.workunit.client.0.smithi046.stdout:6/227: dread da/d14/d1e/d2c/f35 [0,4194304] 0 2024-03-04T09:26:44.786 INFO:tasks.workunit.client.0.smithi046.stdout:6/228: dread da/d14/d1e/f26 [0,4194304] 0 2024-03-04T09:26:44.786 INFO:tasks.workunit.client.0.smithi046.stdout:6/229: readlink da/dd/d22/l41 0 2024-03-04T09:26:45.007 INFO:tasks.workunit.client.0.smithi046.stdout:2/243: creat d5/d2c/d51/f57 x:0 0 0 2024-03-04T09:26:45.040 INFO:tasks.workunit.client.0.smithi046.stdout:2/244: dread d5/d2c/f2e [0,4194304] 0 2024-03-04T09:26:45.379 INFO:tasks.workunit.client.0.smithi046.stdout:1/199: rename d1/fc to d1/d28/f47 0 2024-03-04T09:26:45.469 INFO:tasks.workunit.client.0.smithi046.stdout:1/200: dwrite d1/f44 [0,4194304] 0 2024-03-04T09:26:45.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/231: creat d1/d3/de/f4c x:0 0 0 2024-03-04T09:26:45.544 INFO:tasks.workunit.client.0.smithi046.stdout:5/232: creat d1/d3/de/d26/f4d x:0 0 0 2024-03-04T09:26:46.142 INFO:tasks.workunit.client.0.smithi046.stdout:6/230: mknod da/dd/d39/c51 0 2024-03-04T09:26:46.340 INFO:tasks.workunit.client.0.smithi046.stdout:0/232: rename d10/d12/d1f/d3b/l48 to d10/d12/d1f/l58 0 2024-03-04T09:26:46.621 INFO:tasks.workunit.client.0.smithi046.stdout:1/201: chown d1/d28/c36 1 1 2024-03-04T09:26:47.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/231: getdents da/d14/d17 0 2024-03-04T09:26:47.082 INFO:tasks.workunit.client.0.smithi046.stdout:6/232: dwrite da/d14/d17/f1b [0,4194304] 0 2024-03-04T09:26:47.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/233: write da/dd/d2b/f3c [731060,34752] 0 2024-03-04T09:26:47.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/234: dwrite da/dd/f29 [0,4194304] 0 2024-03-04T09:26:47.265 INFO:tasks.workunit.client.0.smithi046.stdout:4/251: rename d0/d3/d20/d59 to d0/d1f/d5b/d60 0 2024-03-04T09:26:47.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/235: dwrite da/d14/d1e/f33 [0,4194304] 0 2024-03-04T09:26:47.563 INFO:tasks.workunit.client.0.smithi046.stdout:1/202: creat d1/f48 x:0 0 0 2024-03-04T09:26:47.563 INFO:tasks.workunit.client.0.smithi046.stdout:1/203: fsync d1/f44 0 2024-03-04T09:26:47.565 INFO:tasks.workunit.client.0.smithi046.stdout:7/188: sync 2024-03-04T09:26:47.642 INFO:tasks.workunit.client.0.smithi046.stdout:7/189: dwrite d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:26:48.089 INFO:tasks.workunit.client.0.smithi046.stdout:9/289: rename d1/d11/d6/f39 to d1/d11/d6/d8/d1d/d34/d4d/f55 0 2024-03-04T09:26:48.089 INFO:tasks.workunit.client.0.smithi046.stdout:9/290: read d1/ff [1055320,102089] 0 2024-03-04T09:26:48.090 INFO:tasks.workunit.client.0.smithi046.stdout:9/291: chown d1/d11/d6/d8/d12/d1c/f38 204 1 2024-03-04T09:26:48.144 INFO:tasks.workunit.client.0.smithi046.stdout:9/292: dwrite d1/d11/d6/d8/d36/f51 [0,4194304] 0 2024-03-04T09:26:48.431 INFO:tasks.workunit.client.0.smithi046.stdout:0/233: sync 2024-03-04T09:26:48.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/252: dread d0/d1f/f48 [0,4194304] 0 2024-03-04T09:26:48.450 INFO:tasks.workunit.client.0.smithi046.stdout:4/253: chown d0/d3/d16 16712990 1 2024-03-04T09:26:48.450 INFO:tasks.workunit.client.0.smithi046.stdout:4/254: chown d0/d3/d16/l5e 3902 1 2024-03-04T09:26:48.473 INFO:tasks.workunit.client.0.smithi046.stdout:5/233: dwrite d1/d3/f19 [0,4194304] 0 2024-03-04T09:26:49.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:26:49.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:26:49.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/204: creat d1/f49 x:0 0 0 2024-03-04T09:26:49.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/205: truncate d1/f48 238336 0 2024-03-04T09:26:49.266 INFO:tasks.workunit.client.0.smithi046.stdout:7/190: creat d0/d4/db/d38/f3f x:0 0 0 2024-03-04T09:26:49.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/248: rename d1/d21/d35/f1f to d1/d1d/d31/f52 0 2024-03-04T09:26:49.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/249: write d1/f1c [3805883,124441] 0 2024-03-04T09:26:49.569 INFO:tasks.workunit.client.0.smithi046.stdout:3/250: dwrite d1/d1d/f50 [0,4194304] 0 2024-03-04T09:26:49.569 INFO:tasks.workunit.client.0.smithi046.stdout:3/251: write d1/d21/d26/f30 [292438,81818] 0 2024-03-04T09:26:49.570 INFO:tasks.workunit.client.0.smithi046.stdout:3/252: fdatasync d1/d21/d35/d2b/f38 0 2024-03-04T09:26:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:9/293: unlink d1/d11/d6/d8/d13/f2c 0 2024-03-04T09:26:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:9/294: dread - d1/d11/d6/d8/d12/f4a zero size 2024-03-04T09:26:49.967 INFO:tasks.workunit.client.0.smithi046.stdout:4/255: unlink d0/d3/d16/f37 0 2024-03-04T09:26:50.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/234: symlink d1/d3/d1f/l4e 0 2024-03-04T09:26:50.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/253: truncate d1/d21/d35/d2b/f4b 2418686 0 2024-03-04T09:26:50.944 INFO:tasks.workunit.client.0.smithi046.stdout:6/236: sync 2024-03-04T09:26:50.945 INFO:tasks.workunit.client.0.smithi046.stdout:6/237: chown da/d14/d1e/d2c/c42 35320614 1 2024-03-04T09:26:51.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/254: dwrite d1/d1d/d31/f52 [0,4194304] 0 2024-03-04T09:26:51.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/235: truncate d1/f5 2164076 0 2024-03-04T09:26:51.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/236: fdatasync d1/d3/de/d26/f3d 0 2024-03-04T09:26:51.538 INFO:tasks.workunit.client.0.smithi046.stdout:1/206: getdents d1/d28 0 2024-03-04T09:26:51.608 INFO:tasks.workunit.client.0.smithi046.stdout:5/237: dwrite d1/d3/de/d20/f42 [0,4194304] 0 2024-03-04T09:26:51.881 INFO:tasks.workunit.client.0.smithi046.stdout:7/191: mkdir d0/d4/d40 0 2024-03-04T09:26:51.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/190: rename d7/de/d13/d2c/f2d to d7/de/f3f 0 2024-03-04T09:26:52.070 INFO:tasks.workunit.client.0.smithi046.stdout:8/191: dwrite d7/fd [0,4194304] 0 2024-03-04T09:26:52.127 INFO:tasks.workunit.client.0.smithi046.stdout:6/238: truncate da/dd/f10 1249663 0 2024-03-04T09:26:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/255: creat d1/d1d/d27/f53 x:0 0 0 2024-03-04T09:26:52.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/234: sync 2024-03-04T09:26:52.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/235: chown d10/d12/d1f/d2d/l53 0 1 2024-03-04T09:26:52.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/236: chown d10/d12/f41 1526099 1 2024-03-04T09:26:52.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/192: mkdir d0/da/d41 0 2024-03-04T09:26:52.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/193: creat d0/da/f42 x:0 0 0 2024-03-04T09:26:52.929 INFO:tasks.workunit.client.0.smithi046.stdout:2/245: rename f4 to d5/d2c/d51/f58 0 2024-03-04T09:26:52.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/246: dread d5/da/d1b/f30 [0,4194304] 0 2024-03-04T09:26:52.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/247: dwrite d5/da/f14 [4194304,4194304] 0 2024-03-04T09:26:53.341 INFO:tasks.workunit.client.0.smithi046.stdout:8/192: mknod d7/de/d28/d36/c40 0 2024-03-04T09:26:53.369 INFO:tasks.workunit.client.0.smithi046.stdout:3/256: unlink d1/d21/d35/f2a 0 2024-03-04T09:26:53.373 INFO:tasks.workunit.client.0.smithi046.stdout:9/295: sync 2024-03-04T09:26:53.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/237: mkdir d10/d12/d59 0 2024-03-04T09:26:53.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/256: write d0/d1f/f45 [273938,110497] 0 2024-03-04T09:26:53.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/207: rename d1/l10 to d1/l4a 0 2024-03-04T09:26:53.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/208: stat d1/f7 0 2024-03-04T09:26:53.623 INFO:tasks.workunit.client.0.smithi046.stdout:5/238: rmdir d1/d3/d3e 39 2024-03-04T09:26:54.579 INFO:tasks.workunit.client.0.smithi046.stdout:2/248: symlink d5/da/d28/l59 0 2024-03-04T09:26:54.654 INFO:tasks.workunit.client.0.smithi046.stdout:2/249: dwrite d5/da/d28/d3f/f52 [0,4194304] 0 2024-03-04T09:26:54.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/193: symlink d7/de/d28/l41 0 2024-03-04T09:26:54.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/194: stat d7/l3b 0 2024-03-04T09:26:54.788 INFO:tasks.workunit.client.0.smithi046.stdout:3/257: mknod d1/d1d/d27/c54 0 2024-03-04T09:26:55.346 INFO:tasks.workunit.client.0.smithi046.stdout:5/239: truncate d1/d3/f23 9070282 0 2024-03-04T09:26:55.346 INFO:tasks.workunit.client.0.smithi046.stdout:5/240: stat d1/d3/de/d26 0 2024-03-04T09:26:55.411 INFO:tasks.workunit.client.0.smithi046.stdout:5/241: dwrite d1/d3/de/d20/f42 [4194304,4194304] 0 2024-03-04T09:26:55.412 INFO:tasks.workunit.client.0.smithi046.stdout:5/242: stat d1/d3/l2f 0 2024-03-04T09:26:55.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/239: rename da/dd/d22/l41 to da/d14/l52 0 2024-03-04T09:26:56.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/250: mkdir d5/d40/d5a 0 2024-03-04T09:26:56.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/251: readlink d5/da/l15 0 2024-03-04T09:26:56.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/252: read - d5/da/d28/f44 zero size 2024-03-04T09:26:56.175 INFO:tasks.workunit.client.0.smithi046.stdout:2/253: dread d5/da/d28/d3f/f4b [0,4194304] 0 2024-03-04T09:26:56.207 INFO:tasks.workunit.client.0.smithi046.stdout:2/254: dread d5/da/d28/d3f/f4b [0,4194304] 0 2024-03-04T09:26:56.208 INFO:tasks.workunit.client.0.smithi046.stdout:2/255: chown d5/f10 70 1 2024-03-04T09:26:56.208 INFO:tasks.workunit.client.0.smithi046.stdout:2/256: write d5/da/d1b/f4c [98269,75054] 0 2024-03-04T09:26:56.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/257: write d5/d2c/f33 [3240431,102305] 0 2024-03-04T09:26:56.263 INFO:tasks.workunit.client.0.smithi046.stdout:2/258: dread d5/da/d1b/f4f [0,4194304] 0 2024-03-04T09:26:56.294 INFO:tasks.workunit.client.0.smithi046.stdout:8/195: symlink d7/d24/l42 0 2024-03-04T09:26:56.299 INFO:tasks.workunit.client.0.smithi046.stdout:8/196: write d7/de/d28/f37 [2655876,64430] 0 2024-03-04T09:26:56.406 INFO:tasks.workunit.client.0.smithi046.stdout:3/258: link d1/d1d/f3a d1/d1d/d27/d4a/f55 0 2024-03-04T09:26:56.406 INFO:tasks.workunit.client.0.smithi046.stdout:3/259: stat d1/d1d/d31/c34 0 2024-03-04T09:26:56.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/260: dwrite d1/f1c [0,4194304] 0 2024-03-04T09:26:56.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/243: mkdir d1/d3/de/d4f 0 2024-03-04T09:26:56.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/244: fsync d1/d3/fc 0 2024-03-04T09:26:56.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/245: readlink d1/d3/d1f/l34 0 2024-03-04T09:26:56.889 INFO:tasks.workunit.client.0.smithi046.stdout:5/246: dread d1/d3/de/d1d/f33 [0,4194304] 0 2024-03-04T09:26:56.990 INFO:tasks.workunit.client.0.smithi046.stdout:9/296: rename d1/d11/d6/d8/ce to d1/d11/d6/d8/d12/d1c/c56 0 2024-03-04T09:26:57.148 INFO:tasks.workunit.client.0.smithi046.stdout:6/240: mkdir da/d14/d1e/d2c/d34/d53 0 2024-03-04T09:26:57.149 INFO:tasks.workunit.client.0.smithi046.stdout:6/241: stat da/dd/d2b/c3e 0 2024-03-04T09:26:57.149 INFO:tasks.workunit.client.0.smithi046.stdout:6/242: chown da/l25 5586 1 2024-03-04T09:26:57.611 INFO:tasks.workunit.client.0.smithi046.stdout:3/261: creat d1/d21/d35/d2b/f56 x:0 0 0 2024-03-04T09:26:57.615 INFO:tasks.workunit.client.0.smithi046.stdout:5/247: symlink d1/d3/d1f/l50 0 2024-03-04T09:26:57.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/262: dread d1/d1d/d31/f52 [0,4194304] 0 2024-03-04T09:26:57.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/248: dwrite d1/d3/de/f49 [0,4194304] 0 2024-03-04T09:26:57.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/249: read - d1/d3/de/d1d/f2e zero size 2024-03-04T09:26:57.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/250: stat d1/d3/d3e/f46 0 2024-03-04T09:26:57.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/251: dwrite d1/d3/de/f10 [0,4194304] 0 2024-03-04T09:26:57.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/238: rename d10/d12/d1f/l58 to d10/d12/d1f/d2d/l5a 0 2024-03-04T09:26:58.008 INFO:tasks.workunit.client.0.smithi046.stdout:6/243: mknod da/d14/d1e/d27/d4a/c54 0 2024-03-04T09:26:58.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/244: dread da/dd/f29 [0,4194304] 0 2024-03-04T09:26:58.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/245: creat da/d14/d1e/d27/f55 x:0 0 0 2024-03-04T09:26:58.123 INFO:tasks.workunit.client.0.smithi046.stdout:3/263: symlink d1/d1d/d27/l57 0 2024-03-04T09:26:58.124 INFO:tasks.workunit.client.0.smithi046.stdout:3/264: creat d1/d1d/d27/f58 x:0 0 0 2024-03-04T09:26:58.545 INFO:tasks.workunit.client.0.smithi046.stdout:5/252: getdents d1/d3/de/d41 0 2024-03-04T09:26:58.546 INFO:tasks.workunit.client.0.smithi046.stdout:1/209: symlink d1/l4b 0 2024-03-04T09:26:58.546 INFO:tasks.workunit.client.0.smithi046.stdout:1/210: fdatasync d1/f17 0 2024-03-04T09:26:58.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/297: rename d1/c5 to d1/d11/d6/d8/d12/d1c/d26/c57 0 2024-03-04T09:26:59.027 INFO:tasks.workunit.client.0.smithi046.stdout:0/239: mknod d10/d12/d1f/d3f/d4b/c5b 0 2024-03-04T09:26:59.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/246: mkdir da/d4d/d56 0 2024-03-04T09:26:59.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/247: stat da/f3a 0 2024-03-04T09:26:59.197 INFO:tasks.workunit.client.0.smithi046.stdout:6/248: dread da/dd/f2a [0,4194304] 0 2024-03-04T09:26:59.198 INFO:tasks.workunit.client.0.smithi046.stdout:6/249: fsync da/dd/d39/f45 0 2024-03-04T09:26:59.211 INFO:tasks.workunit.client.0.smithi046.stdout:6/250: dread da/dd/f36 [0,4194304] 0 2024-03-04T09:26:59.345 INFO:tasks.workunit.client.0.smithi046.stdout:7/194: sync 2024-03-04T09:26:59.346 INFO:tasks.workunit.client.0.smithi046.stdout:7/195: getdents d0/d4/db/d3b 0 2024-03-04T09:26:59.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/211: truncate d1/fd 2946812 0 2024-03-04T09:26:59.805 INFO:tasks.workunit.client.0.smithi046.stdout:5/253: mknod d1/d3/de/d41/c51 0 2024-03-04T09:26:59.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/298: link d1/d11/d6/d8/d36/l54 d1/d11/d6/d8/d1d/l58 0 2024-03-04T09:27:00.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/257: write d0/d1f/f48 [1346161,46640] 0 2024-03-04T09:27:00.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/258: dread - d0/d3/f57 zero size 2024-03-04T09:27:00.232 INFO:tasks.workunit.client.0.smithi046.stdout:4/259: fdatasync d0/d1f/f48 0 2024-03-04T09:27:00.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/251: rename da/dd/d39/l40 to da/d4e/l57 0 2024-03-04T09:27:00.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/196: mknod d0/d4/db/d38/c43 0 2024-03-04T09:27:00.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/265: truncate d1/f20 3231814 0 2024-03-04T09:27:00.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/266: dwrite d1/f39 [0,4194304] 0 2024-03-04T09:27:00.811 INFO:tasks.workunit.client.0.smithi046.stdout:1/212: unlink d1/d28/f2e 0 2024-03-04T09:27:01.103 INFO:tasks.workunit.client.0.smithi046.stdout:9/299: mkdir d1/d11/d6/d8/d13/d59 0 2024-03-04T09:27:01.103 INFO:tasks.workunit.client.0.smithi046.stdout:9/300: write d1/d11/d6/d8/d12/d1c/f41 [4605364,91760] 0 2024-03-04T09:27:01.104 INFO:tasks.workunit.client.0.smithi046.stdout:9/301: dread - d1/d11/d6/d8/d1d/d34/f49 zero size 2024-03-04T09:27:01.259 INFO:tasks.workunit.client.0.smithi046.stdout:4/260: creat d0/d1f/d35/f61 x:0 0 0 2024-03-04T09:27:01.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/252: unlink da/d14/d1e/d2c/f48 0 2024-03-04T09:27:02.131 INFO:tasks.workunit.client.0.smithi046.stdout:9/302: creat d1/f5a x:0 0 0 2024-03-04T09:27:02.131 INFO:tasks.workunit.client.0.smithi046.stdout:9/303: fdatasync d1/f5a 0 2024-03-04T09:27:02.131 INFO:tasks.workunit.client.0.smithi046.stdout:9/304: creat d1/f5b x:0 0 0 2024-03-04T09:27:02.131 INFO:tasks.workunit.client.0.smithi046.stdout:9/305: chown d1/d11/d6/d8/fd 1471812 1 2024-03-04T09:27:02.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/253: symlink da/d14/d1e/d27/d4a/l58 0 2024-03-04T09:27:02.486 INFO:tasks.workunit.client.0.smithi046.stdout:3/267: rename d1/d21/d35/d2b/f38 to d1/f59 0 2024-03-04T09:27:02.486 INFO:tasks.workunit.client.0.smithi046.stdout:3/268: fdatasync d1/d21/d26/f30 0 2024-03-04T09:27:02.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/306: symlink d1/d11/d6/d8/d1d/d34/d46/l5c 0 2024-03-04T09:27:02.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/307: fsync d1/d11/d6/d8/f33 0 2024-03-04T09:27:02.939 INFO:tasks.workunit.client.0.smithi046.stdout:9/308: dwrite d1/d11/d6/d8/d1d/d34/d4d/f55 [0,4194304] 0 2024-03-04T09:27:03.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/213: getdents d1 0 2024-03-04T09:27:03.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/197: sync 2024-03-04T09:27:03.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/259: sync 2024-03-04T09:27:03.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/260: chown d5/da/d1b/l32 160819 1 2024-03-04T09:27:03.042 INFO:tasks.workunit.client.0.smithi046.stdout:1/214: read d1/d28/f35 [3580958,57021] 0 2024-03-04T09:27:03.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/215: write d1/f44 [378047,101936] 0 2024-03-04T09:27:03.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/216: write d1/f44 [3243340,74120] 0 2024-03-04T09:27:03.086 INFO:tasks.workunit.client.0.smithi046.stdout:6/254: rename da/d14/c20 to da/d14/d1e/d27/d4b/c59 0 2024-03-04T09:27:03.087 INFO:tasks.workunit.client.0.smithi046.stdout:6/255: readlink da/d14/d17/l4c 0 2024-03-04T09:27:03.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/269: creat d1/d1d/d27/d40/f5a x:0 0 0 2024-03-04T09:27:03.407 INFO:tasks.workunit.client.0.smithi046.stdout:9/309: creat d1/d11/d6/d8/d1d/d34/d35/f5d x:0 0 0 2024-03-04T09:27:03.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/240: rmdir d10/d12/d1f 39 2024-03-04T09:27:03.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/198: truncate d7/de/d13/f35 599518 0 2024-03-04T09:27:03.873 INFO:tasks.workunit.client.0.smithi046.stdout:2/261: symlink d5/d38/d54/l5b 0 2024-03-04T09:27:04.331 INFO:tasks.workunit.client.0.smithi046.stdout:6/256: truncate da/dd/f13 5360037 0 2024-03-04T09:27:04.331 INFO:tasks.workunit.client.0.smithi046.stdout:6/257: read - da/d14/d1e/d27/f55 zero size 2024-03-04T09:27:04.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/258: dwrite f9 [0,4194304] 0 2024-03-04T09:27:04.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/259: readlink da/d14/d1e/d27/d4a/l58 0 2024-03-04T09:27:04.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/260: fsync da/f3a 0 2024-03-04T09:27:04.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/261: dread - da/dd/d2b/f3d zero size 2024-03-04T09:27:04.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/310: mkdir d1/d11/d6/d8/d1d/d34/d46/d5e 0 2024-03-04T09:27:04.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/311: write d1/f5a [513451,39245] 0 2024-03-04T09:27:04.620 INFO:tasks.workunit.client.0.smithi046.stdout:1/217: truncate d1/fd 3930982 0 2024-03-04T09:27:04.621 INFO:tasks.workunit.client.0.smithi046.stdout:1/218: truncate d1/d28/f45 59294 0 2024-03-04T09:27:04.621 INFO:tasks.workunit.client.0.smithi046.stdout:1/219: chown d1/f1e 350 1 2024-03-04T09:27:04.936 INFO:tasks.workunit.client.0.smithi046.stdout:0/241: rmdir d10/d12/d59 0 2024-03-04T09:27:05.377 INFO:tasks.workunit.client.0.smithi046.stdout:2/262: creat d5/da/d28/d47/f5c x:0 0 0 2024-03-04T09:27:05.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/262: creat da/d14/d1e/d2c/d34/f5a x:0 0 0 2024-03-04T09:27:05.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/312: link d1/d11/d6/d8/d12/f4a d1/d11/d6/d8/d1d/d34/d46/f5f 0 2024-03-04T09:27:05.878 INFO:tasks.workunit.client.0.smithi046.stdout:1/220: creat d1/f4c x:0 0 0 2024-03-04T09:27:05.878 INFO:tasks.workunit.client.0.smithi046.stdout:1/221: dread - d1/f2d zero size 2024-03-04T09:27:06.037 INFO:tasks.workunit.client.0.smithi046.stdout:8/199: creat d7/de/d12/f43 x:0 0 0 2024-03-04T09:27:06.081 INFO:tasks.workunit.client.0.smithi046.stdout:5/254: write d1/d3/d1f/f31 [194493,95930] 0 2024-03-04T09:27:06.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/200: dwrite d7/de/d13/f17 [0,4194304] 0 2024-03-04T09:27:06.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/201: chown d7/de/d28/f2e 9 1 2024-03-04T09:27:06.159 INFO:tasks.workunit.client.0.smithi046.stdout:0/242: creat d10/f5c x:0 0 0 2024-03-04T09:27:06.159 INFO:tasks.workunit.client.0.smithi046.stdout:0/243: chown d10/d12/l2b 25580 1 2024-03-04T09:27:06.159 INFO:tasks.workunit.client.0.smithi046.stdout:0/244: fsync d10/d12/d1f/d3b/f43 0 2024-03-04T09:27:06.447 INFO:tasks.workunit.client.0.smithi046.stdout:6/263: link da/dd/f10 da/d14/d1e/d2c/f5b 0 2024-03-04T09:27:06.658 INFO:tasks.workunit.client.0.smithi046.stdout:9/313: symlink d1/d11/d6/d8/d1d/d34/d46/d4c/l60 0 2024-03-04T09:27:06.829 INFO:tasks.workunit.client.0.smithi046.stdout:1/222: creat d1/f4d x:0 0 0 2024-03-04T09:27:06.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/255: getdents d1/d3 0 2024-03-04T09:27:06.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/256: fsync d1/d3/d3e/f3f 0 2024-03-04T09:27:06.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/257: truncate d1/d3/de/d41/f48 199989 0 2024-03-04T09:27:06.895 INFO:tasks.workunit.client.0.smithi046.stdout:5/258: dread d1/d3/d1f/f31 [0,4194304] 0 2024-03-04T09:27:07.286 INFO:tasks.workunit.client.0.smithi046.stdout:8/202: mknod d7/de/d3e/c44 0 2024-03-04T09:27:07.299 INFO:tasks.workunit.client.0.smithi046.stdout:0/245: dread d10/d12/d1f/d3f/f44 [0,4194304] 0 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/203: dwrite d7/de/d13/f17 [0,4194304] 0 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/204: stat d7/l3b 0 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/205: chown d7/d24 744011 1 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/206: dread - d7/de/d13/f38 zero size 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/207: chown d7/de/d13/d2c/c32 77269856 1 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/208: fsync d7/de/d13/f17 0 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/209: truncate d7/de/d12/f43 252969 0 2024-03-04T09:27:07.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/210: creat d7/de/d13/d2c/f45 x:0 0 0 2024-03-04T09:27:07.408 INFO:tasks.workunit.client.0.smithi046.stdout:8/211: dwrite d7/de/d12/f15 [0,4194304] 0 2024-03-04T09:27:07.508 INFO:tasks.workunit.client.0.smithi046.stdout:9/314: mknod d1/d11/d6/d8/d1d/d34/d35/c61 0 2024-03-04T09:27:07.892 INFO:tasks.workunit.client.0.smithi046.stdout:0/246: mkdir d10/d12/d52/d5d 0 2024-03-04T09:27:08.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/259: truncate d1/f5 2821226 0 2024-03-04T09:27:08.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/247: mknod d10/d12/d1f/d3b/c5e 0 2024-03-04T09:27:08.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/248: stat d10/d12/d1f/d2d/f33 0 2024-03-04T09:27:09.026 INFO:tasks.workunit.client.0.smithi046.stdout:7/197: symlink d0/d4/l44 0 2024-03-04T09:27:09.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/198: stat d0/da/f29 0 2024-03-04T09:27:09.336 INFO:tasks.workunit.client.0.smithi046.stdout:5/260: symlink d1/d3/de/d20/l52 0 2024-03-04T09:27:09.427 INFO:tasks.workunit.client.0.smithi046.stdout:0/249: mknod d10/d12/d52/c5f 0 2024-03-04T09:27:10.540 INFO:tasks.workunit.client.0.smithi046.stdout:5/261: creat d1/d3/de/d4f/f53 x:0 0 0 2024-03-04T09:27:10.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/262: dread d1/d3/f23 [0,4194304] 0 2024-03-04T09:27:10.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/263: truncate d1/d3/de/d4f/f53 235248 0 2024-03-04T09:27:10.642 INFO:tasks.workunit.client.0.smithi046.stdout:0/250: mknod d10/d12/d52/d5d/c60 0 2024-03-04T09:27:10.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/251: creat d10/d12/d52/d5d/f61 x:0 0 0 2024-03-04T09:27:11.242 INFO:tasks.workunit.client.0.smithi046.stdout:3/270: write d1/f20 [17696,120688] 0 2024-03-04T09:27:11.266 INFO:tasks.workunit.client.0.smithi046.stdout:4/261: mknod d0/c62 0 2024-03-04T09:27:11.266 INFO:tasks.workunit.client.0.smithi046.stdout:8/212: link d7/de/d12/f15 d7/f46 0 2024-03-04T09:27:11.665 INFO:tasks.workunit.client.0.smithi046.stdout:4/262: mkdir d0/d1f/d25/d50/d63 0 2024-03-04T09:27:11.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/252: truncate d10/d12/d1f/f27 2951968 0 2024-03-04T09:27:12.167 INFO:tasks.workunit.client.0.smithi046.stdout:4/263: rmdir d0/d1f/d25/d50 39 2024-03-04T09:27:12.167 INFO:tasks.workunit.client.0.smithi046.stdout:4/264: dread - d0/d1f/d35/f61 zero size 2024-03-04T09:27:12.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/265: dwrite d0/d1f/d25/d50/f51 [0,4194304] 0 2024-03-04T09:27:12.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/264: mkdir d1/d3/de/d54 0 2024-03-04T09:27:12.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/253: link f1 d10/d12/d1f/d3f/d4b/f62 0 2024-03-04T09:27:12.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/265: dwrite d1/d3/f29 [0,4194304] 0 2024-03-04T09:27:13.028 INFO:tasks.workunit.client.0.smithi046.stdout:1/223: dwrite d1/d28/f47 [0,4194304] 0 2024-03-04T09:27:13.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/266: unlink d0/d3/d20/f21 0 2024-03-04T09:27:13.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/254: symlink d10/d12/d1f/d3f/d4b/l63 0 2024-03-04T09:27:13.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/255: getdents d10/d46 0 2024-03-04T09:27:13.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/256: creat d10/d12/d52/d5d/f64 x:0 0 0 2024-03-04T09:27:13.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/224: creat d1/d28/f4e x:0 0 0 2024-03-04T09:27:13.691 INFO:tasks.workunit.client.0.smithi046.stdout:4/267: rename d0/d1f/d35/f61 to d0/d3/d20/f64 0 2024-03-04T09:27:13.692 INFO:tasks.workunit.client.0.smithi046.stdout:4/268: write d0/f41 [4243701,79079] 0 2024-03-04T09:27:13.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/264: write da/dd/f13 [4350951,103453] 0 2024-03-04T09:27:13.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/199: write d0/d4/db/f3d [453442,80528] 0 2024-03-04T09:27:13.900 INFO:tasks.workunit.client.0.smithi046.stdout:6/265: dread da/dd/f1d [0,4194304] 0 2024-03-04T09:27:13.900 INFO:tasks.workunit.client.0.smithi046.stdout:6/266: chown da/dd/f29 1 1 2024-03-04T09:27:13.909 INFO:tasks.workunit.client.0.smithi046.stdout:7/200: dread d0/da/f39 [0,4194304] 0 2024-03-04T09:27:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:2/263: unlink d5/da/d28/c31 0 2024-03-04T09:27:14.193 INFO:tasks.workunit.client.0.smithi046.stdout:9/315: link d1/d11/d6/d8/d1d/d34/f49 d1/d11/d6/d8/f62 0 2024-03-04T09:27:14.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/271: write d1/d21/d35/d2b/f4b [2104121,112930] 0 2024-03-04T09:27:14.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/272: truncate d1/d1d/f4c 473904 0 2024-03-04T09:27:14.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/273: chown d1/d1d/d27/d4a/f55 1 1 2024-03-04T09:27:14.278 INFO:tasks.workunit.client.0.smithi046.stdout:8/213: rename d7/de/l1d to d7/de/l47 0 2024-03-04T09:27:14.278 INFO:tasks.workunit.client.0.smithi046.stdout:8/214: fsync d7/de/d12/f15 0 2024-03-04T09:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/257: rmdir d10/d12/d1f/d2d 39 2024-03-04T09:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/258: write d10/d12/f56 [1038620,91661] 0 2024-03-04T09:27:15.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/225: mknod d1/d28/c4f 0 2024-03-04T09:27:15.106 INFO:tasks.workunit.client.0.smithi046.stdout:1/226: dread d1/f19 [0,4194304] 0 2024-03-04T09:27:15.289 INFO:tasks.workunit.client.0.smithi046.stdout:4/269: mknod d0/c65 0 2024-03-04T09:27:15.505 INFO:tasks.workunit.client.0.smithi046.stdout:7/201: symlink d0/d4/db/d38/l45 0 2024-03-04T09:27:15.505 INFO:tasks.workunit.client.0.smithi046.stdout:7/202: fdatasync d0/da/f2a 0 2024-03-04T09:27:15.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/316: getdents d1/d11/d3e 0 2024-03-04T09:27:15.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/317: stat d1/d11/d6 0 2024-03-04T09:27:15.983 INFO:tasks.workunit.client.0.smithi046.stdout:3/274: mknod d1/d1d/c5b 0 2024-03-04T09:27:16.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/270: creat d0/d3/d16/f66 x:0 0 0 2024-03-04T09:27:16.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/271: chown d0/d3/c31 36482 1 2024-03-04T09:27:16.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/272: dread - d0/d3/d16/d1e/f36 zero size 2024-03-04T09:27:17.137 INFO:tasks.workunit.client.0.smithi046.stdout:7/203: mkdir d0/da/d46 0 2024-03-04T09:27:17.235 INFO:tasks.workunit.client.0.smithi046.stdout:5/266: write d1/d3/f23 [4869340,107482] 0 2024-03-04T09:27:17.304 INFO:tasks.workunit.client.0.smithi046.stdout:9/318: creat d1/d11/d6/d8/d13/f63 x:0 0 0 2024-03-04T09:27:17.880 INFO:tasks.workunit.client.0.smithi046.stdout:3/275: symlink d1/d1d/l5c 0 2024-03-04T09:27:17.936 INFO:tasks.workunit.client.0.smithi046.stdout:2/264: dwrite d5/da/d28/f35 [0,4194304] 0 2024-03-04T09:27:18.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/259: link d10/d36/f40 d10/d12/d1f/d3f/f65 0 2024-03-04T09:27:18.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/260: dread - d10/f14 zero size 2024-03-04T09:27:18.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/261: write d10/d12/d1f/d3b/f43 [790785,105038] 0 2024-03-04T09:27:18.254 INFO:tasks.workunit.client.0.smithi046.stdout:8/215: write d7/de/f1f [440560,81001] 0 2024-03-04T09:27:18.569 INFO:tasks.workunit.client.0.smithi046.stdout:7/204: dread d0/d4/f1f [0,4194304] 0 2024-03-04T09:27:18.584 INFO:tasks.workunit.client.0.smithi046.stdout:7/205: write d0/f11 [3116721,71696] 0 2024-03-04T09:27:18.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/267: rmdir d1 39 2024-03-04T09:27:18.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/319: symlink d1/d11/d6/d8/d13/l64 0 2024-03-04T09:27:18.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/320: stat d1/d11/d6/d8/d1d 0 2024-03-04T09:27:18.819 INFO:tasks.workunit.client.0.smithi046.stdout:5/268: dread d1/f2 [0,4194304] 0 2024-03-04T09:27:18.876 INFO:tasks.workunit.client.0.smithi046.stdout:3/276: creat d1/d1d/f5d x:0 0 0 2024-03-04T09:27:18.876 INFO:tasks.workunit.client.0.smithi046.stdout:3/277: fsync d1/d1d/f37 0 2024-03-04T09:27:18.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/321: dwrite d1/d11/d6/d8/d12/d1c/f31 [0,4194304] 0 2024-03-04T09:27:18.953 INFO:tasks.workunit.client.0.smithi046.stdout:1/227: dwrite d1/f25 [0,4194304] 0 2024-03-04T09:27:18.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/228: dread d1/f24 [0,4194304] 0 2024-03-04T09:27:18.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/229: dread - d1/d28/f30 zero size 2024-03-04T09:27:19.201 INFO:tasks.workunit.client.0.smithi046.stdout:2/265: rename d5/da/d1b/l34 to d5/d56/l5d 0 2024-03-04T09:27:19.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/269: rename d1 to d1/d3/de/d4f/d55 22 2024-03-04T09:27:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:6/267: write da/d14/d1e/d2c/f5b [2114949,63273] 0 2024-03-04T09:27:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:8/216: creat d7/de/d28/d3a/f48 x:0 0 0 2024-03-04T09:27:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:8/217: dread - d7/d24/f39 zero size 2024-03-04T09:27:19.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/268: dwrite da/dd/d2b/f3c [0,4194304] 0 2024-03-04T09:27:19.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/269: chown da/dd/f13 10 1 2024-03-04T09:27:19.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/270: getdents da/dd/d2b/d44 0 2024-03-04T09:27:19.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/271: chown da/dd 505648 1 2024-03-04T09:27:19.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/272: write da/f3a [4986855,127856] 0 2024-03-04T09:27:19.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/206: dread d0/d4/db/d12/f34 [0,4194304] 0 2024-03-04T09:27:19.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/207: truncate d0/d4/db/d38/f3f 514623 0 2024-03-04T09:27:19.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:27:19.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:27:19.418 INFO:tasks.workunit.client.0.smithi046.stdout:3/278: mkdir d1/d1d/d5e 0 2024-03-04T09:27:19.418 INFO:tasks.workunit.client.0.smithi046.stdout:3/279: write d1/d21/d26/f30 [842713,93713] 0 2024-03-04T09:27:19.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/280: dread d1/d1d/f4c [0,4194304] 0 2024-03-04T09:27:19.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/322: rmdir d1/d11/d6/d8/d1d/d34/d4d 39 2024-03-04T09:27:19.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/323: write d1/d11/d6/d8/d12/d1c/f31 [4988371,88988] 0 2024-03-04T09:27:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:1/230: rename d1/f1b to d1/d28/f50 0 2024-03-04T09:27:20.246 INFO:tasks.workunit.client.0.smithi046.stdout:5/270: truncate d1/d3/de/d41/f48 867674 0 2024-03-04T09:27:20.514 INFO:tasks.workunit.client.0.smithi046.stdout:0/262: truncate d10/d36/f40 688266 0 2024-03-04T09:27:20.515 INFO:tasks.workunit.client.0.smithi046.stdout:0/263: chown d10/d12/l55 59178 1 2024-03-04T09:27:20.515 INFO:tasks.workunit.client.0.smithi046.stdout:0/264: creat d10/d12/d1f/d3f/f66 x:0 0 0 2024-03-04T09:27:20.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/273: write d0/d1f/d25/f26 [7241624,123652] 0 2024-03-04T09:27:21.180 INFO:tasks.workunit.client.0.smithi046.stdout:3/281: truncate d1/d1d/d31/f3e 1924673 0 2024-03-04T09:27:21.372 INFO:tasks.workunit.client.0.smithi046.stdout:9/324: getdents d1/d11/d6/d8 0 2024-03-04T09:27:21.416 INFO:tasks.workunit.client.0.smithi046.stdout:9/325: dread d1/d11/d6/d8/d12/d1c/f31 [0,4194304] 0 2024-03-04T09:27:21.896 INFO:tasks.workunit.client.0.smithi046.stdout:8/218: rename d7/de/d12/f15 to d7/de/d3e/f49 0 2024-03-04T09:27:21.896 INFO:tasks.workunit.client.0.smithi046.stdout:0/265: rename d10 to d10/d12/d1f/d67 22 2024-03-04T09:27:21.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/219: dread d7/fd [0,4194304] 0 2024-03-04T09:27:21.967 INFO:tasks.workunit.client.0.smithi046.stdout:6/273: getdents da/dd/d2b 0 2024-03-04T09:27:21.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/231: symlink d1/l51 0 2024-03-04T09:27:21.968 INFO:tasks.workunit.client.0.smithi046.stdout:6/274: read da/dd/d39/f45 [647809,46204] 0 2024-03-04T09:27:22.033 INFO:tasks.workunit.client.0.smithi046.stdout:6/275: dwrite da/d14/d1e/d2c/f5b [0,4194304] 0 2024-03-04T09:27:22.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/282: rename d1/d1d/l5c to d1/d1d/d31/d51/l5f 0 2024-03-04T09:27:22.359 INFO:tasks.workunit.client.0.smithi046.stdout:8/220: unlink d7/d24/c26 0 2024-03-04T09:27:22.445 INFO:tasks.workunit.client.0.smithi046.stdout:8/221: dwrite d7/f1a [0,4194304] 0 2024-03-04T09:27:22.572 INFO:tasks.workunit.client.0.smithi046.stdout:1/232: unlink d1/f34 0 2024-03-04T09:27:22.572 INFO:tasks.workunit.client.0.smithi046.stdout:1/233: write d1/f4c [950419,99359] 0 2024-03-04T09:27:22.587 INFO:tasks.workunit.client.0.smithi046.stdout:1/234: dread d1/f24 [0,4194304] 0 2024-03-04T09:27:22.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/276: mknod da/dd/d22/d3f/c5c 0 2024-03-04T09:27:22.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/277: chown da/d14/d1e/d2c/f5b 271 1 2024-03-04T09:27:22.963 INFO:tasks.workunit.client.0.smithi046.stdout:9/326: rename d1/d11/d6/d8/d12/f4a to d1/d11/d6/d8/d36/f65 0 2024-03-04T09:27:22.963 INFO:tasks.workunit.client.0.smithi046.stdout:9/327: fdatasync d1/f5b 0 2024-03-04T09:27:23.118 INFO:tasks.workunit.client.0.smithi046.stdout:3/283: mknod d1/d1d/d27/d4a/c60 0 2024-03-04T09:27:23.612 INFO:tasks.workunit.client.0.smithi046.stdout:1/235: link d1/c2f d1/d28/c52 0 2024-03-04T09:27:23.613 INFO:tasks.workunit.client.0.smithi046.stdout:6/278: creat da/d4d/f5d x:0 0 0 2024-03-04T09:27:23.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/284: rename d1/f1c to d1/d21/d26/f61 0 2024-03-04T09:27:23.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/285: fdatasync d1/d1d/f5d 0 2024-03-04T09:27:23.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/286: chown d1/d1d/d27/c54 28431 1 2024-03-04T09:27:23.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/287: creat d1/d21/d35/d43/f62 x:0 0 0 2024-03-04T09:27:23.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/208: write d0/d4/db/d12/f34 [362348,33915] 0 2024-03-04T09:27:23.857 INFO:tasks.workunit.client.0.smithi046.stdout:1/236: symlink d1/d28/l53 0 2024-03-04T09:27:23.858 INFO:tasks.workunit.client.0.smithi046.stdout:1/237: stat d1/d28/f38 0 2024-03-04T09:27:24.032 INFO:tasks.workunit.client.0.smithi046.stdout:6/279: creat da/d14/d1e/d27/f5e x:0 0 0 2024-03-04T09:27:24.086 INFO:tasks.workunit.client.0.smithi046.stdout:6/280: dwrite da/f32 [0,4194304] 0 2024-03-04T09:27:24.608 INFO:tasks.workunit.client.0.smithi046.stdout:3/288: truncate d1/d21/d35/f36 643336 0 2024-03-04T09:27:24.608 INFO:tasks.workunit.client.0.smithi046.stdout:3/289: creat d1/d21/d35/d43/f63 x:0 0 0 2024-03-04T09:27:24.609 INFO:tasks.workunit.client.0.smithi046.stdout:3/290: creat d1/d21/d35/d43/f64 x:0 0 0 2024-03-04T09:27:24.760 INFO:tasks.workunit.client.0.smithi046.stdout:2/266: dwrite d5/f3b [0,4194304] 0 2024-03-04T09:27:25.034 INFO:tasks.workunit.client.0.smithi046.stdout:8/222: getdents d7/de/d3e 0 2024-03-04T09:27:25.034 INFO:tasks.workunit.client.0.smithi046.stdout:8/223: write d7/de/d13/f38 [401186,104419] 0 2024-03-04T09:27:25.034 INFO:tasks.workunit.client.0.smithi046.stdout:8/224: write d7/fc [1241819,88692] 0 2024-03-04T09:27:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:6/281: creat da/dd/d2b/f5f x:0 0 0 2024-03-04T09:27:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/291: creat d1/d1d/d27/d4a/f65 x:0 0 0 2024-03-04T09:27:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/292: chown d1/d1d/f3a 1231773903 1 2024-03-04T09:27:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/293: fsync d1/d1d/d31/f52 0 2024-03-04T09:27:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/294: fsync d1/d1d/f3a 0 2024-03-04T09:27:25.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/295: dread d1/d21/d35/d24/f18 [0,4194304] 0 2024-03-04T09:27:25.636 INFO:tasks.workunit.client.0.smithi046.stdout:2/267: symlink d5/d2c/d51/l5e 0 2024-03-04T09:27:25.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/268: dread - d5/da/d28/d47/f5c zero size 2024-03-04T09:27:25.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/269: dread - d5/da/d28/f55 zero size 2024-03-04T09:27:25.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/225: creat d7/de/f4a x:0 0 0 2024-03-04T09:27:25.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/271: unlink d1/d3/f19 0 2024-03-04T09:27:25.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/282: mkdir da/dd/d39/d60 0 2024-03-04T09:27:25.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/283: read - da/d14/d1e/f49 zero size 2024-03-04T09:27:26.011 INFO:tasks.workunit.client.0.smithi046.stdout:6/284: dwrite da/d14/d1e/f49 [0,4194304] 0 2024-03-04T09:27:26.017 INFO:tasks.workunit.client.0.smithi046.stdout:3/296: rmdir d1/d1d/d27/d40 39 2024-03-04T09:27:26.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/272: link d1/d3/c17 d1/d44/c56 0 2024-03-04T09:27:26.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/285: creat da/dd/f61 x:0 0 0 2024-03-04T09:27:26.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/286: creat da/d14/d1e/d2c/d34/f62 x:0 0 0 2024-03-04T09:27:26.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/287: creat da/d14/d1e/d2c/f63 x:0 0 0 2024-03-04T09:27:26.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/288: dread - da/d14/d1e/d2c/d34/f62 zero size 2024-03-04T09:27:26.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/289: chown da/d14/d17/l21 7 1 2024-03-04T09:27:26.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/290: fdatasync da/dd/d39/f45 0 2024-03-04T09:27:26.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/291: dwrite da/dd/f61 [0,4194304] 0 2024-03-04T09:27:26.779 INFO:tasks.workunit.client.0.smithi046.stdout:3/297: truncate d1/d1d/d27/f2d 545975 0 2024-03-04T09:27:26.839 INFO:tasks.workunit.client.0.smithi046.stdout:0/266: write d10/f14 [669294,28419] 0 2024-03-04T09:27:26.839 INFO:tasks.workunit.client.0.smithi046.stdout:0/267: chown d10/d36 266327310 1 2024-03-04T09:27:27.353 INFO:tasks.workunit.client.0.smithi046.stdout:6/292: unlink da/dd/f29 0 2024-03-04T09:27:27.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/298: mknod d1/d1d/d27/c66 0 2024-03-04T09:27:27.653 INFO:tasks.workunit.client.0.smithi046.stdout:0/268: symlink d10/d12/d1f/d3f/l68 0 2024-03-04T09:27:27.754 INFO:tasks.workunit.client.0.smithi046.stdout:3/299: mknod d1/d1d/d27/d4a/c67 0 2024-03-04T09:27:27.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/300: getdents d1/d1d/d5e 0 2024-03-04T09:27:27.817 INFO:tasks.workunit.client.0.smithi046.stdout:3/301: dwrite d1/d1d/d31/f52 [0,4194304] 0 2024-03-04T09:27:27.818 INFO:tasks.workunit.client.0.smithi046.stdout:3/302: write d1/d21/d35/d43/f62 [467336,120548] 0 2024-03-04T09:27:27.840 INFO:tasks.workunit.client.0.smithi046.stdout:8/226: rename l1 to d7/de/d28/d36/l4b 0 2024-03-04T09:27:28.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/274: rmdir d0/d1f/d35 39 2024-03-04T09:27:28.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/275: fdatasync d0/d3/d16/d1e/f1c 0 2024-03-04T09:27:28.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/276: chown d0/d1f/d5b 1 1 2024-03-04T09:27:28.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/328: truncate d1/d11/d6/d8/d12/d1c/f31 3372751 0 2024-03-04T09:27:28.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/329: stat d1/d11/d6/d8/d12 0 2024-03-04T09:27:29.013 INFO:tasks.workunit.client.0.smithi046.stdout:2/270: rmdir d5/d40 39 2024-03-04T09:27:29.014 INFO:tasks.workunit.client.0.smithi046.stdout:2/271: chown d5/d2c 31 1 2024-03-04T09:27:29.014 INFO:tasks.workunit.client.0.smithi046.stdout:2/272: dread - d5/da/d28/f55 zero size 2024-03-04T09:27:29.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/273: dread d5/da/f53 [0,4194304] 0 2024-03-04T09:27:29.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/274: stat d5/da/d28/d47 0 2024-03-04T09:27:29.228 INFO:tasks.workunit.client.0.smithi046.stdout:7/209: dwrite d0/d4/db/d12/f30 [0,4194304] 0 2024-03-04T09:27:29.519 INFO:tasks.workunit.client.0.smithi046.stdout:1/238: dwrite d1/fd [0,4194304] 0 2024-03-04T09:27:30.111 INFO:tasks.workunit.client.0.smithi046.stdout:3/303: mknod d1/d1d/d5e/c68 0 2024-03-04T09:27:30.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/304: fdatasync d1/d21/d35/d24/f28 0 2024-03-04T09:27:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/273: rename d1/d3/de/d1d/d24 to d1/d44/d57 0 2024-03-04T09:27:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/274: write d1/d3/de/d26/f4d [187603,1504] 0 2024-03-04T09:27:30.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/277: mknod d0/d1f/d25/d50/c67 0 2024-03-04T09:27:30.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/278: readlink d0/l19 0 2024-03-04T09:27:30.552 INFO:tasks.workunit.client.0.smithi046.stdout:4/279: write d0/d3/d16/d1e/f36 [349781,80820] 0 2024-03-04T09:27:30.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/330: getdents d1 0 2024-03-04T09:27:30.844 INFO:tasks.workunit.client.0.smithi046.stdout:2/275: dwrite d5/da/d28/d3f/f4b [0,4194304] 0 2024-03-04T09:27:31.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/210: symlink d0/d4/d40/l47 0 2024-03-04T09:27:32.273 INFO:tasks.workunit.client.0.smithi046.stdout:5/275: mknod d1/d3/d1f/c58 0 2024-03-04T09:27:32.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/276: dwrite d1/d3/de/d20/f42 [4194304,4194304] 0 2024-03-04T09:27:32.476 INFO:tasks.workunit.client.0.smithi046.stdout:9/331: mknod d1/d11/d6/d8/d12/d1c/d26/c66 0 2024-03-04T09:27:32.476 INFO:tasks.workunit.client.0.smithi046.stdout:9/332: chown d1/d11/d6/d8/d1d/d34/d4d/f55 41142 1 2024-03-04T09:27:32.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/276: rename d5/d38/d54/l5b to d5/d38/d54/l5f 0 2024-03-04T09:27:32.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/211: creat d0/d4/db/d12/f48 x:0 0 0 2024-03-04T09:27:33.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/277: truncate d1/d3/f29 2533368 0 2024-03-04T09:27:33.291 INFO:tasks.workunit.client.0.smithi046.stdout:9/333: unlink d1/d11/f27 0 2024-03-04T09:27:33.292 INFO:tasks.workunit.client.0.smithi046.stdout:9/334: fsync d1/d11/d6/d8/d12/f1e 0 2024-03-04T09:27:33.292 INFO:tasks.workunit.client.0.smithi046.stdout:5/278: write d1/d3/de/d20/f42 [8868013,118162] 0 2024-03-04T09:27:33.292 INFO:tasks.workunit.client.0.smithi046.stdout:5/279: write d1/f1b [1704727,38173] 0 2024-03-04T09:27:33.693 INFO:tasks.workunit.client.0.smithi046.stdout:2/277: creat d5/d40/d5a/f60 x:0 0 0 2024-03-04T09:27:33.694 INFO:tasks.workunit.client.0.smithi046.stdout:7/212: creat d0/d4/d40/f49 x:0 0 0 2024-03-04T09:27:33.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/335: mknod d1/d11/c67 0 2024-03-04T09:27:33.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/336: chown d1/d11/d6/d8/d1d/d34/f3c 360840087 1 2024-03-04T09:27:33.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/280: mknod d1/d3/de/d4f/c59 0 2024-03-04T09:27:33.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/269: sync 2024-03-04T09:27:33.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/337: dread d1/f5a [0,4194304] 0 2024-03-04T09:27:33.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/338: write d1/d11/d6/f4e [446305,91722] 0 2024-03-04T09:27:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/278: mkdir d5/d2c/d51/d61 0 2024-03-04T09:27:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/279: write d5/da/d1b/f30 [1090919,28308] 0 2024-03-04T09:27:34.279 INFO:tasks.workunit.client.0.smithi046.stdout:7/213: stat d0/d4/db/d12/d28/c2f 0 2024-03-04T09:27:34.280 INFO:tasks.workunit.client.0.smithi046.stdout:7/214: write d0/da/f2a [3411149,2803] 0 2024-03-04T09:27:34.280 INFO:tasks.workunit.client.0.smithi046.stdout:7/215: write d0/d4/db/f3d [604424,130684] 0 2024-03-04T09:27:34.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/227: dwrite f2 [0,4194304] 0 2024-03-04T09:27:34.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/270: unlink d10/d12/l2b 0 2024-03-04T09:27:34.503 INFO:tasks.workunit.client.0.smithi046.stdout:2/280: stat d5/l16 0 2024-03-04T09:27:34.506 INFO:tasks.workunit.client.0.smithi046.stdout:2/281: read d5/da/f23 [106149,1190] 0 2024-03-04T09:27:34.877 INFO:tasks.workunit.client.0.smithi046.stdout:4/280: dwrite d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:27:35.320 INFO:tasks.workunit.client.0.smithi046.stdout:7/216: mkdir d0/d4/d40/d4a 0 2024-03-04T09:27:35.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/281: rmdir d1/d3/de/d20 39 2024-03-04T09:27:35.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/282: dread - d1/d3/de/d1d/f2e zero size 2024-03-04T09:27:35.764 INFO:tasks.workunit.client.0.smithi046.stdout:2/282: creat d5/d56/f62 x:0 0 0 2024-03-04T09:27:35.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/283: dwrite d5/ff [0,4194304] 0 2024-03-04T09:27:35.940 INFO:tasks.workunit.client.0.smithi046.stdout:4/281: creat d0/d1f/d5b/d60/f68 x:0 0 0 2024-03-04T09:27:37.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/228: mkdir d7/de/d4c 0 2024-03-04T09:27:37.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/284: getdents d5/d38/d54 0 2024-03-04T09:27:37.829 INFO:tasks.workunit.client.0.smithi046.stdout:4/282: creat d0/d1f/d25/f69 x:0 0 0 2024-03-04T09:27:37.829 INFO:tasks.workunit.client.0.smithi046.stdout:4/283: chown d0/d3/d16/d17/c3a 4315161 1 2024-03-04T09:27:37.829 INFO:tasks.workunit.client.0.smithi046.stdout:4/284: dread - d0/d3/d20/f64 zero size 2024-03-04T09:27:37.830 INFO:tasks.workunit.client.0.smithi046.stdout:2/285: dwrite d5/da/d28/f43 [0,4194304] 0 2024-03-04T09:27:37.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/285: dread d0/d3/d16/f1a [0,4194304] 0 2024-03-04T09:27:37.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/286: fdatasync d0/d3/f6 0 2024-03-04T09:27:38.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/287: symlink d0/d1f/d5b/d60/l6a 0 2024-03-04T09:27:38.637 INFO:tasks.workunit.client.0.smithi046.stdout:4/288: write d0/d3/d20/f38 [371023,36313] 0 2024-03-04T09:27:38.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/229: mkdir d7/de/d4d 0 2024-03-04T09:27:38.746 INFO:tasks.workunit.client.0.smithi046.stdout:0/271: write d10/f26 [1739978,103130] 0 2024-03-04T09:27:38.777 INFO:tasks.workunit.client.0.smithi046.stdout:7/217: dwrite d0/d4/fd [0,4194304] 0 2024-03-04T09:27:38.796 INFO:tasks.workunit.client.0.smithi046.stdout:0/272: dwrite d10/d12/f1b [4194304,4194304] 0 2024-03-04T09:27:38.847 INFO:tasks.workunit.client.0.smithi046.stdout:0/273: dwrite d10/f20 [0,4194304] 0 2024-03-04T09:27:38.847 INFO:tasks.workunit.client.0.smithi046.stdout:0/274: creat d10/d12/d52/d5d/f69 x:0 0 0 2024-03-04T09:27:38.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/275: write d10/d12/d52/d5d/f61 [643077,95134] 0 2024-03-04T09:27:38.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/289: creat d0/d1f/d35/f6b x:0 0 0 2024-03-04T09:27:38.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/290: read - d0/d3/d16/f5a zero size 2024-03-04T09:27:38.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/291: fdatasync d0/d3/d16/d1e/f3e 0 2024-03-04T09:27:38.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/230: creat d7/f4e x:0 0 0 2024-03-04T09:27:39.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/286: dwrite d5/da/f20 [0,4194304] 0 2024-03-04T09:27:39.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/287: chown d5/d56/l5d 114410 1 2024-03-04T09:27:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:0/276: symlink d10/d12/d1f/l6a 0 2024-03-04T09:27:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:0/277: write d10/f45 [762081,16131] 0 2024-03-04T09:27:39.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/218: dwrite d0/d4/db/d38/f3f [0,4194304] 0 2024-03-04T09:27:40.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/293: rename da/d4d to da/dd/d2b/d44/d64 0 2024-03-04T09:27:41.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/278: mkdir d10/d12/d1f/d3b/d6b 0 2024-03-04T09:27:41.652 INFO:tasks.workunit.client.0.smithi046.stdout:8/231: truncate d7/de/f1b 3889085 0 2024-03-04T09:27:41.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/219: creat d0/d4/db/d12/d28/f4b x:0 0 0 2024-03-04T09:27:41.652 INFO:tasks.workunit.client.0.smithi046.stdout:8/232: chown d7/de/d28/d3a/f48 813039 1 2024-03-04T09:27:41.652 INFO:tasks.workunit.client.0.smithi046.stdout:8/233: dread - d7/de/f3f zero size 2024-03-04T09:27:41.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/220: chown d0/d4/db/d38/c43 3385 1 2024-03-04T09:27:41.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/221: write d0/da/f2a [4271160,70769] 0 2024-03-04T09:27:41.994 INFO:tasks.workunit.client.0.smithi046.stdout:0/279: mkdir d10/d12/d52/d6c 0 2024-03-04T09:27:41.994 INFO:tasks.workunit.client.0.smithi046.stdout:0/280: dread - d10/d12/d1f/d2d/f33 zero size 2024-03-04T09:27:41.994 INFO:tasks.workunit.client.0.smithi046.stdout:0/281: dread - d10/f5c zero size 2024-03-04T09:27:42.050 INFO:tasks.workunit.client.0.smithi046.stdout:5/283: sync 2024-03-04T09:27:42.050 INFO:tasks.workunit.client.0.smithi046.stdout:5/284: dread - d1/f36 zero size 2024-03-04T09:27:42.396 INFO:tasks.workunit.client.0.smithi046.stdout:2/288: dwrite d5/da/d28/d3f/f52 [4194304,4194304] 0 2024-03-04T09:27:42.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/289: creat d5/d40/d5a/f63 x:0 0 0 2024-03-04T09:27:42.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/234: rename d7/de/d28/l41 to d7/de/d28/l4f 0 2024-03-04T09:27:42.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/239: rename d1/d28/f35 to d1/f54 0 2024-03-04T09:27:42.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/240: fsync d1/d28/f30 0 2024-03-04T09:27:43.291 INFO:tasks.workunit.client.0.smithi046.stdout:2/290: creat d5/d2c/d51/d61/f64 x:0 0 0 2024-03-04T09:27:43.310 INFO:tasks.workunit.client.0.smithi046.stdout:2/291: write d5/da/d28/d3f/f4b [2733756,20484] 0 2024-03-04T09:27:43.515 INFO:tasks.workunit.client.0.smithi046.stdout:3/305: rename d1/d21/d35/d24/l25 to d1/d1d/l69 0 2024-03-04T09:27:43.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/294: write da/dd/d2b/f3c [587943,69420] 0 2024-03-04T09:27:43.619 INFO:tasks.workunit.client.0.smithi046.stdout:6/295: fdatasync da/d14/f19 0 2024-03-04T09:27:43.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/296: dread da/dd/f61 [0,4194304] 0 2024-03-04T09:27:43.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/297: stat da/dd/d2b/d44/d64/f5d 0 2024-03-04T09:27:43.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/298: chown da/dd/d46 65436858 1 2024-03-04T09:27:43.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/299: chown da/dd/f1d 41617 1 2024-03-04T09:27:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:1/241: mknod d1/d28/c55 0 2024-03-04T09:27:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:1/242: dread - d1/d28/f40 zero size 2024-03-04T09:27:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:0/282: getdents d10/d12/d52 0 2024-03-04T09:27:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:0/283: chown d10/d12/l1d 191 1 2024-03-04T09:27:43.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/292: creat d5/da/f65 x:0 0 0 2024-03-04T09:27:43.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/293: read - d5/da/f24 zero size 2024-03-04T09:27:43.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/294: write d5/da/f2b [857376,129298] 0 2024-03-04T09:27:43.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/295: fsync d5/da/d28/f44 0 2024-03-04T09:27:44.116 INFO:tasks.workunit.client.0.smithi046.stdout:9/339: rename d1/ff to d1/d11/d6/d8/d12/d1c/d26/f68 0 2024-03-04T09:27:44.218 INFO:tasks.workunit.client.0.smithi046.stdout:3/306: creat d1/d21/d35/d2b/f6a x:0 0 0 2024-03-04T09:27:44.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/307: write d1/d21/d35/d24/f18 [228791,120747] 0 2024-03-04T09:27:44.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/308: fsync d1/d1d/d27/d4a/f55 0 2024-03-04T09:27:44.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/300: rmdir da/d14/d1e/d2c/d34/d53 0 2024-03-04T09:27:44.586 INFO:tasks.workunit.client.0.smithi046.stdout:6/301: read da/dd/f13 [1461667,51615] 0 2024-03-04T09:27:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/302: dread da/f32 [0,4194304] 0 2024-03-04T09:27:44.685 INFO:tasks.workunit.client.0.smithi046.stdout:1/243: creat d1/f56 x:0 0 0 2024-03-04T09:27:44.685 INFO:tasks.workunit.client.0.smithi046.stdout:1/244: dread - d1/d28/f41 zero size 2024-03-04T09:27:44.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/245: chown d1/f17 306254 1 2024-03-04T09:27:44.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/246: write d1/f21 [103688,63915] 0 2024-03-04T09:27:45.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/284: creat d10/d12/d1f/d2d/f6d x:0 0 0 2024-03-04T09:27:45.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/296: creat d5/d38/f66 x:0 0 0 2024-03-04T09:27:45.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/297: creat d5/da/d28/d47/f67 x:0 0 0 2024-03-04T09:27:45.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/298: dwrite d5/d56/f62 [0,4194304] 0 2024-03-04T09:27:45.157 INFO:tasks.workunit.client.0.smithi046.stdout:2/299: dread d5/d2c/f33 [4194304,4194304] 0 2024-03-04T09:27:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/340: creat d1/d11/d6/d8/d13/d21/f69 x:0 0 0 2024-03-04T09:27:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/341: truncate d1/d11/d6/d8/f1a 4968178 0 2024-03-04T09:27:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/342: truncate d1/f5a 555488 0 2024-03-04T09:27:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/343: chown d1/d11/d6/d8/d36/l37 5 1 2024-03-04T09:27:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:9/344: dwrite d1/d11/d6/d8/d1d/d34/d46/f5f [0,4194304] 0 2024-03-04T09:27:45.867 INFO:tasks.workunit.client.0.smithi046.stdout:6/303: getdents da/d14/d1e 0 2024-03-04T09:27:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/304: dwrite da/d14/d1e/d27/f55 [0,4194304] 0 2024-03-04T09:27:45.984 INFO:tasks.workunit.client.0.smithi046.stdout:6/305: dwrite da/d14/f19 [0,4194304] 0 2024-03-04T09:27:45.988 INFO:tasks.workunit.client.0.smithi046.stdout:1/247: unlink d1/d28/f43 0 2024-03-04T09:27:45.989 INFO:tasks.workunit.client.0.smithi046.stdout:1/248: truncate d1/f2b 4536765 0 2024-03-04T09:27:46.046 INFO:tasks.workunit.client.0.smithi046.stdout:6/306: dwrite f5 [4194304,4194304] 0 2024-03-04T09:27:46.158 INFO:tasks.workunit.client.0.smithi046.stdout:5/285: write d1/f7 [4722890,59084] 0 2024-03-04T09:27:46.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/300: mknod d5/da/d28/d47/c68 0 2024-03-04T09:27:46.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/301: dwrite d5/da/d1b/f4f [0,4194304] 0 2024-03-04T09:27:47.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/345: creat d1/d11/d6/d8/d1d/d34/d46/d5e/f6a x:0 0 0 2024-03-04T09:27:47.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/346: dread d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:27:47.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/347: chown d1/d11/d6/d8/d12/d1c/d26/c66 31785658 1 2024-03-04T09:27:47.868 INFO:tasks.workunit.client.0.smithi046.stdout:6/307: mknod da/dd/d39/d60/c65 0 2024-03-04T09:27:47.868 INFO:tasks.workunit.client.0.smithi046.stdout:4/292: rename d0/d3/d16/l5e to d0/d1f/d5b/d60/l6c 0 2024-03-04T09:27:47.869 INFO:tasks.workunit.client.0.smithi046.stdout:4/293: dread - d0/f56 zero size 2024-03-04T09:27:47.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/286: link d1/d3/d3e/f46 d1/d44/f5a 0 2024-03-04T09:27:47.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/287: stat d1/d3/de/d26 0 2024-03-04T09:27:47.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/288: fsync d1/d3/de/d20/f3b 0 2024-03-04T09:27:47.887 INFO:tasks.workunit.client.0.smithi046.stdout:4/294: dread d0/d3/d16/d1e/f36 [0,4194304] 0 2024-03-04T09:27:47.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/308: dwrite da/d14/d1e/f49 [0,4194304] 0 2024-03-04T09:27:47.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/309: stat da/dd/f36 0 2024-03-04T09:27:48.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/302: symlink d5/da/d28/l69 0 2024-03-04T09:27:48.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/303: fsync d5/da/d1b/f4f 0 2024-03-04T09:27:48.207 INFO:tasks.workunit.client.0.smithi046.stdout:2/304: dread d5/da/f2b [0,4194304] 0 2024-03-04T09:27:48.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/309: creat d1/d1d/f6b x:0 0 0 2024-03-04T09:27:48.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/310: fdatasync d1/d21/d35/f13 0 2024-03-04T09:27:48.466 INFO:tasks.workunit.client.0.smithi046.stdout:0/285: write d10/d12/d1f/d3f/f65 [54252,40259] 0 2024-03-04T09:27:48.575 INFO:tasks.workunit.client.0.smithi046.stdout:0/286: dwrite d10/d12/d1f/d2d/f49 [0,4194304] 0 2024-03-04T09:27:48.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/348: link d1/d11/d6/d8/d12/d1c/d26/c57 d1/d11/d6/d8/d1d/d34/d4d/c6b 0 2024-03-04T09:27:48.847 INFO:tasks.workunit.client.0.smithi046.stdout:9/349: dwrite d1/d11/d6/d8/d12/d1c/f41 [0,4194304] 0 2024-03-04T09:27:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/249: getdents d1 0 2024-03-04T09:27:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/250: truncate d1/d28/f4e 46760 0 2024-03-04T09:27:49.000 INFO:tasks.workunit.client.0.smithi046.stdout:1/251: dread d1/f25 [0,4194304] 0 2024-03-04T09:27:49.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/295: truncate d0/d3/d16/d17/f1b 5321628 0 2024-03-04T09:27:49.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:27:49.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:27:49.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/310: mkdir da/dd/d2b/d66 0 2024-03-04T09:27:49.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/311: truncate da/dd/d2b/f3d 131617 0 2024-03-04T09:27:49.566 INFO:tasks.workunit.client.0.smithi046.stdout:2/305: creat d5/d2c/f6a x:0 0 0 2024-03-04T09:27:49.638 INFO:tasks.workunit.client.0.smithi046.stdout:3/311: creat d1/d21/d35/f6c x:0 0 0 2024-03-04T09:27:49.638 INFO:tasks.workunit.client.0.smithi046.stdout:3/312: write d1/d1d/f3a [1048531,113061] 0 2024-03-04T09:27:49.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/287: mkdir d10/d12/d6e 0 2024-03-04T09:27:50.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/252: unlink d1/f1e 0 2024-03-04T09:27:50.199 INFO:tasks.workunit.client.0.smithi046.stdout:7/222: rename d0/d4/c7 to d0/da/d46/c4c 0 2024-03-04T09:27:50.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/296: mkdir d0/d3/d16/d17/d6d 0 2024-03-04T09:27:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:3/313: read d1/d21/d26/f30 [204555,100694] 0 2024-03-04T09:27:50.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/288: link d10/f20 d10/d12/d52/d5d/f6f 0 2024-03-04T09:27:51.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/297: mkdir d0/d3/d16/d17/d6d/d6e 0 2024-03-04T09:27:51.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/298: write d0/d3/d16/d1e/f3e [1485035,109298] 0 2024-03-04T09:27:51.439 INFO:tasks.workunit.client.0.smithi046.stdout:6/312: rmdir da/d14/d1e/d2c 39 2024-03-04T09:27:51.440 INFO:tasks.workunit.client.0.smithi046.stdout:6/313: readlink da/l25 0 2024-03-04T09:27:51.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/314: rename d1/d1d/f50 to d1/d1d/f6d 0 2024-03-04T09:27:51.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/315: chown d1/d21/d35/d2b/f4b 6445 1 2024-03-04T09:27:51.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/316: write d1/d21/d35/f6c [322233,100647] 0 2024-03-04T09:27:51.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/317: chown d1/d1d/d27/d4a/c67 30091361 1 2024-03-04T09:27:51.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/299: chown d0/d3/d16/le 42485 1 2024-03-04T09:27:51.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/253: getdents d1/d28 0 2024-03-04T09:27:51.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/254: stat d1/d28/f3e 0 2024-03-04T09:27:52.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/318: creat d1/d1d/d5e/f6e x:0 0 0 2024-03-04T09:27:52.675 INFO:tasks.workunit.client.0.smithi046.stdout:0/289: rmdir d10/d46 0 2024-03-04T09:27:53.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/300: getdents d0/d3/d16/d17 0 2024-03-04T09:27:53.854 INFO:tasks.workunit.client.0.smithi046.stdout:7/223: dwrite d0/da/f39 [4194304,4194304] 0 2024-03-04T09:27:54.921 INFO:tasks.workunit.client.0.smithi046.stdout:4/301: mkdir d0/d5f/d6f 0 2024-03-04T09:27:54.921 INFO:tasks.workunit.client.0.smithi046.stdout:4/302: chown d0/d5f 1258 1 2024-03-04T09:27:54.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/303: dwrite d0/d1f/f4d [0,4194304] 0 2024-03-04T09:27:54.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/304: dread - d0/d3/d16/f4b zero size 2024-03-04T09:27:55.060 INFO:tasks.workunit.client.0.smithi046.stdout:4/305: dwrite d0/d3/d16/d1e/f3e [0,4194304] 0 2024-03-04T09:27:55.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/306: mknod d0/d3/d16/d17/d6d/d6e/c70 0 2024-03-04T09:27:55.512 INFO:tasks.workunit.client.0.smithi046.stdout:4/307: dwrite d0/d3/f4 [0,4194304] 0 2024-03-04T09:27:55.512 INFO:tasks.workunit.client.0.smithi046.stdout:4/308: readlink d0/l19 0 2024-03-04T09:27:56.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/306: creat d5/f6b x:0 0 0 2024-03-04T09:27:56.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/307: dwrite d5/d56/f62 [4194304,4194304] 0 2024-03-04T09:27:56.467 INFO:tasks.workunit.client.0.smithi046.stdout:1/255: rename d1/c13 to d1/c57 0 2024-03-04T09:27:56.596 INFO:tasks.workunit.client.0.smithi046.stdout:4/309: getdents d0/d3/d20 0 2024-03-04T09:27:56.596 INFO:tasks.workunit.client.0.smithi046.stdout:4/310: write d0/d1f/f44 [467694,46645] 0 2024-03-04T09:27:56.596 INFO:tasks.workunit.client.0.smithi046.stdout:4/311: stat d0/d3/c4f 0 2024-03-04T09:27:56.617 INFO:tasks.workunit.client.0.smithi046.stdout:4/312: dread d0/d1f/d25/d50/f51 [0,4194304] 0 2024-03-04T09:27:56.617 INFO:tasks.workunit.client.0.smithi046.stdout:4/313: chown d0/d1f/l47 491573 1 2024-03-04T09:27:56.742 INFO:tasks.workunit.client.0.smithi046.stdout:2/308: mknod d5/da/d28/c6c 0 2024-03-04T09:27:56.779 INFO:tasks.workunit.client.0.smithi046.stdout:2/309: read d5/f1d [1415056,29043] 0 2024-03-04T09:27:56.779 INFO:tasks.workunit.client.0.smithi046.stdout:2/310: write d5/d2c/f6a [317495,61217] 0 2024-03-04T09:27:56.779 INFO:tasks.workunit.client.0.smithi046.stdout:2/311: dread - d5/f6b zero size 2024-03-04T09:27:56.833 INFO:tasks.workunit.client.0.smithi046.stdout:2/312: dwrite d5/d56/f62 [0,4194304] 0 2024-03-04T09:27:56.947 INFO:tasks.workunit.client.0.smithi046.stdout:8/235: rename d7/d24 to d7/de/d4c/d50 0 2024-03-04T09:27:57.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/314: mknod d0/d1f/d25/d50/d63/c71 0 2024-03-04T09:27:57.442 INFO:tasks.workunit.client.0.smithi046.stdout:4/315: dwrite d0/d1f/f4d [0,4194304] 0 2024-03-04T09:27:57.486 INFO:tasks.workunit.client.0.smithi046.stdout:4/316: dwrite d0/d3/d20/f38 [0,4194304] 0 2024-03-04T09:27:57.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/313: link d5/da/d28/d3f/f52 d5/d40/d5a/f6d 0 2024-03-04T09:27:57.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/314: readlink d5/da/d28/l69 0 2024-03-04T09:27:57.600 INFO:tasks.workunit.client.0.smithi046.stdout:2/315: readlink d5/d2c/d51/l5e 0 2024-03-04T09:27:57.622 INFO:tasks.workunit.client.0.smithi046.stdout:2/316: read d5/d56/f62 [3727652,39789] 0 2024-03-04T09:27:57.649 INFO:tasks.workunit.client.0.smithi046.stdout:2/317: write d5/d2c/f2e [1894580,108134] 0 2024-03-04T09:27:57.650 INFO:tasks.workunit.client.0.smithi046.stdout:2/318: getdents d5/d38/d54 0 2024-03-04T09:27:57.665 INFO:tasks.workunit.client.0.smithi046.stdout:2/319: dread d5/f3b [0,4194304] 0 2024-03-04T09:27:57.915 INFO:tasks.workunit.client.0.smithi046.stdout:5/289: rename d1/d3/de/c22 to d1/d3/de/d20/c5b 0 2024-03-04T09:27:57.916 INFO:tasks.workunit.client.0.smithi046.stdout:1/256: mknod d1/c58 0 2024-03-04T09:27:57.917 INFO:tasks.workunit.client.0.smithi046.stdout:8/236: getdents d7/de 0 2024-03-04T09:27:57.941 INFO:tasks.workunit.client.0.smithi046.stdout:5/290: dread d1/d3/de/d20/f42 [0,4194304] 0 2024-03-04T09:27:57.941 INFO:tasks.workunit.client.0.smithi046.stdout:5/291: fsync d1/d3/de/d1d/f2e 0 2024-03-04T09:27:58.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/292: dwrite d1/d3/d1f/f31 [0,4194304] 0 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/317: rmdir d0/d3/d3b 39 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:9/350: rename d1/d11/d6/d8/d12/l1b to d1/d11/d6/d8/d13/l6c 0 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:9/351: fdatasync d1/d11/d6/d8/d1d/d34/d46/d5e/f6a 0 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/318: dread - d0/f39 zero size 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/319: readlink d0/l3d 0 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/320: write d0/d3/d20/f64 [23897,123410] 0 2024-03-04T09:27:58.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/321: chown d0/d1f/d25/c2f 57560 1 2024-03-04T09:27:58.111 INFO:tasks.workunit.client.0.smithi046.stdout:1/257: readlink d1/l51 0 2024-03-04T09:27:58.413 INFO:tasks.workunit.client.0.smithi046.stdout:8/237: creat d7/de/d3e/f51 x:0 0 0 2024-03-04T09:27:58.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/314: rename da/dd/d2b/d44 to da/d14/d1e/d2c/d34/d67 0 2024-03-04T09:27:58.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/315: stat da/d14/d1e/f49 0 2024-03-04T09:27:58.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/316: write da/d14/d1e/d2c/d34/d67/d64/f5d [312926,119374] 0 2024-03-04T09:27:58.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/320: symlink d5/da/d28/d3f/l6e 0 2024-03-04T09:27:58.901 INFO:tasks.workunit.client.0.smithi046.stdout:9/352: creat d1/d11/d6/d8/d12/f6d x:0 0 0 2024-03-04T09:27:59.103 INFO:tasks.workunit.client.0.smithi046.stdout:3/319: sync 2024-03-04T09:27:59.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/322: dread d0/d3/d16/d17/f1b [0,4194304] 0 2024-03-04T09:27:59.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/323: fsync d0/d1f/d25/d50/f51 0 2024-03-04T09:27:59.233 INFO:tasks.workunit.client.0.smithi046.stdout:1/258: dwrite d1/f21 [0,4194304] 0 2024-03-04T09:27:59.233 INFO:tasks.workunit.client.0.smithi046.stdout:1/259: chown d1/d28/f45 0 1 2024-03-04T09:27:59.316 INFO:tasks.workunit.client.0.smithi046.stdout:8/238: rmdir d7/de/d4d 0 2024-03-04T09:27:59.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/239: readlink d7/l3b 0 2024-03-04T09:27:59.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/240: fdatasync d7/de/d13/f35 0 2024-03-04T09:27:59.573 INFO:tasks.workunit.client.0.smithi046.stdout:0/290: rename d10/d12/d1f/d2d/l4c to d10/d12/d1f/d3f/d4b/l70 0 2024-03-04T09:27:59.651 INFO:tasks.workunit.client.0.smithi046.stdout:0/291: dwrite d10/d12/f4f [0,4194304] 0 2024-03-04T09:27:59.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/317: mknod da/dd/d39/d60/c68 0 2024-03-04T09:27:59.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/321: creat d5/da/d28/f6f x:0 0 0 2024-03-04T09:27:59.753 INFO:tasks.workunit.client.0.smithi046.stdout:2/322: write d5/da/d1b/f25 [4212436,118435] 0 2024-03-04T09:27:59.753 INFO:tasks.workunit.client.0.smithi046.stdout:2/323: dread - d5/da/d28/f55 zero size 2024-03-04T09:28:00.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/320: unlink d1/d1d/l69 0 2024-03-04T09:28:00.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/321: fsync d1/d21/d35/d24/f1b 0 2024-03-04T09:28:00.901 INFO:tasks.workunit.client.0.smithi046.stdout:7/224: rename d0/da/lf to d0/d4/db/d3b/l4d 0 2024-03-04T09:28:01.087 INFO:tasks.workunit.client.0.smithi046.stdout:0/292: mkdir d10/d12/d52/d5d/d71 0 2024-03-04T09:28:01.500 INFO:tasks.workunit.client.0.smithi046.stdout:5/293: dwrite d1/d3/de/f49 [4194304,4194304] 0 2024-03-04T09:28:01.500 INFO:tasks.workunit.client.0.smithi046.stdout:5/294: dread - d1/d3/d3e/f3f zero size 2024-03-04T09:28:01.500 INFO:tasks.workunit.client.0.smithi046.stdout:5/295: readlink d1/d3/de/d1d/l2a 0 2024-03-04T09:28:01.500 INFO:tasks.workunit.client.0.smithi046.stdout:5/296: readlink d1/d3/l14 0 2024-03-04T09:28:01.500 INFO:tasks.workunit.client.0.smithi046.stdout:5/297: fsync d1/d44/f5a 0 2024-03-04T09:28:01.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/324: getdents d5/da/d1b 0 2024-03-04T09:28:01.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/325: chown d5/d2c/d51/l5e 853253296 1 2024-03-04T09:28:01.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/326: creat d5/d56/f70 x:0 0 0 2024-03-04T09:28:01.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/327: chown d5/d2c/d51/d61 374403 1 2024-03-04T09:28:01.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/328: readlink d5/da/d1b/l2a 0 2024-03-04T09:28:01.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/329: write d5/da/d28/f3e [718304,121725] 0 2024-03-04T09:28:01.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/330: truncate d5/da/f24 458094 0 2024-03-04T09:28:02.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/260: symlink d1/l59 0 2024-03-04T09:28:02.558 INFO:tasks.workunit.client.0.smithi046.stdout:9/353: rename d1/d11/d6/d8/d12/d1c/d26/f68 to d1/d11/d6/d8/d12/d1c/f6e 0 2024-03-04T09:28:02.578 INFO:tasks.workunit.client.0.smithi046.stdout:9/354: dread d1/d11/d6/d8/d36/f65 [0,4194304] 0 2024-03-04T09:28:02.624 INFO:tasks.workunit.client.0.smithi046.stdout:7/225: mkdir d0/da/d4e 0 2024-03-04T09:28:03.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/298: symlink d1/d3/de/d54/l5c 0 2024-03-04T09:28:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/355: unlink d1/d11/d6/d8/d12/d1c/d26/c3f 0 2024-03-04T09:28:03.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/226: getdents d0/da/d46 0 2024-03-04T09:28:03.593 INFO:tasks.workunit.client.0.smithi046.stdout:9/356: dread d1/d11/d6/f4e [0,4194304] 0 2024-03-04T09:28:03.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/299: creat d1/d3/de/d20/f5d x:0 0 0 2024-03-04T09:28:03.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/300: write d1/d3/de/d20/f42 [8881357,72287] 0 2024-03-04T09:28:03.752 INFO:tasks.workunit.client.0.smithi046.stdout:1/261: truncate d1/f48 40043 0 2024-03-04T09:28:03.752 INFO:tasks.workunit.client.0.smithi046.stdout:1/262: chown d1/d28/c55 287 1 2024-03-04T09:28:04.146 INFO:tasks.workunit.client.0.smithi046.stdout:8/241: rename d7/de/d4c/d50/f39 to d7/de/f52 0 2024-03-04T09:28:04.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/227: link d0/d4/db/d38/l45 d0/d4/d40/d4a/l4f 0 2024-03-04T09:28:04.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/263: chown d1/f27 94 1 2024-03-04T09:28:04.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/318: sync 2024-03-04T09:28:04.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/319: readlink da/d14/d1e/d27/l2e 0 2024-03-04T09:28:04.891 INFO:tasks.workunit.client.0.smithi046.stdout:8/242: mkdir d7/d53 0 2024-03-04T09:28:05.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/264: mknod d1/d28/c5a 0 2024-03-04T09:28:05.431 INFO:tasks.workunit.client.0.smithi046.stdout:4/324: rename d0/d3/d16/d1e/c2e to d0/d3/d3b/c72 0 2024-03-04T09:28:05.527 INFO:tasks.workunit.client.0.smithi046.stdout:6/320: getdents da/d4e 0 2024-03-04T09:28:05.527 INFO:tasks.workunit.client.0.smithi046.stdout:6/321: write da/d14/d1e/d2c/d34/d67/d64/f5d [383980,54259] 0 2024-03-04T09:28:05.699 INFO:tasks.workunit.client.0.smithi046.stdout:8/243: rmdir d7/de/d4c/d50 39 2024-03-04T09:28:05.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/244: dwrite d7/fc [0,4194304] 0 2024-03-04T09:28:06.151 INFO:tasks.workunit.client.0.smithi046.stdout:4/325: mkdir d0/d3/d16/d1e/d73 0 2024-03-04T09:28:06.304 INFO:tasks.workunit.client.0.smithi046.stdout:6/322: rmdir da/dd/d39/d60 39 2024-03-04T09:28:06.304 INFO:tasks.workunit.client.0.smithi046.stdout:6/323: chown da/dd/d22/d3f/c5c 386216 1 2024-03-04T09:28:06.304 INFO:tasks.workunit.client.0.smithi046.stdout:6/324: stat da/dd/d39/d60/c68 0 2024-03-04T09:28:06.656 INFO:tasks.workunit.client.0.smithi046.stdout:8/245: mknod d7/de/d28/d36/c54 0 2024-03-04T09:28:07.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/357: dwrite d1/d11/d6/d8/d12/d1c/f31 [0,4194304] 0 2024-03-04T09:28:07.321 INFO:tasks.workunit.client.0.smithi046.stdout:6/325: creat da/d14/d1e/d2c/d34/f69 x:0 0 0 2024-03-04T09:28:07.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/246: mknod d7/de/d13/d3c/c55 0 2024-03-04T09:28:07.799 INFO:tasks.workunit.client.0.smithi046.stdout:6/326: rmdir da/d14/d1e/d27/d4a 39 2024-03-04T09:28:07.840 INFO:tasks.workunit.client.0.smithi046.stdout:7/228: write d0/da/f2a [4220105,65429] 0 2024-03-04T09:28:07.979 INFO:tasks.workunit.client.0.smithi046.stdout:8/247: mknod d7/de/d13/c56 0 2024-03-04T09:28:08.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/248: read d7/de/d3e/f49 [123685,96603] 0 2024-03-04T09:28:08.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/249: readlink d7/de/l29 0 2024-03-04T09:28:08.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/229: truncate d0/d4/db/d12/f30 665466 0 2024-03-04T09:28:08.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/230: readlink d0/d4/db/d12/l1e 0 2024-03-04T09:28:08.422 INFO:tasks.workunit.client.0.smithi046.stdout:0/293: rmdir d10/d12/d1f 39 2024-03-04T09:28:08.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/301: sync 2024-03-04T09:28:08.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/302: write d1/d3/d3e/f3f [571659,55416] 0 2024-03-04T09:28:08.488 INFO:tasks.workunit.client.0.smithi046.stdout:0/294: dwrite d10/f22 [0,4194304] 0 2024-03-04T09:28:08.848 INFO:tasks.workunit.client.0.smithi046.stdout:3/322: rename d1/d21/d35/f36 to d1/f6f 0 2024-03-04T09:28:08.848 INFO:tasks.workunit.client.0.smithi046.stdout:3/323: write d1/f39 [4892473,126772] 0 2024-03-04T09:28:08.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/265: dwrite d1/d28/f45 [0,4194304] 0 2024-03-04T09:28:09.227 INFO:tasks.workunit.client.0.smithi046.stdout:0/295: link d10/d12/f21 d10/d12/d1f/d3b/d6b/f72 0 2024-03-04T09:28:09.228 INFO:tasks.workunit.client.0.smithi046.stdout:0/296: chown d10/d36/f40 9 1 2024-03-04T09:28:09.349 INFO:tasks.workunit.client.0.smithi046.stdout:2/331: rename d5/d40/d5a/f60 to d5/d2c/f71 0 2024-03-04T09:28:09.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/332: dwrite d5/d40/d5a/f63 [0,4194304] 0 2024-03-04T09:28:09.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/333: chown d5/d2c/f6a 8745865 1 2024-03-04T09:28:09.533 INFO:tasks.workunit.client.0.smithi046.stdout:3/324: mkdir d1/d1d/d27/d40/d70 0 2024-03-04T09:28:10.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/303: getdents d1/d3/de/d20 0 2024-03-04T09:28:10.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/304: read - d1/d44/f5a zero size 2024-03-04T09:28:10.241 INFO:tasks.workunit.client.0.smithi046.stdout:0/297: fsync d10/d36/f3a 0 2024-03-04T09:28:10.241 INFO:tasks.workunit.client.0.smithi046.stdout:0/298: write ff [3568535,105104] 0 2024-03-04T09:28:10.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/327: rename da/d14/d1e/f49 to da/d4e/f6a 0 2024-03-04T09:28:10.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/334: link d5/d2c/f33 d5/d40/f72 0 2024-03-04T09:28:10.891 INFO:tasks.workunit.client.0.smithi046.stdout:3/325: getdents d1/d21/d35/d24 0 2024-03-04T09:28:11.111 INFO:tasks.workunit.client.0.smithi046.stdout:1/266: link d1/f2d d1/d28/f5b 0 2024-03-04T09:28:11.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/326: sync 2024-03-04T09:28:11.271 INFO:tasks.workunit.client.0.smithi046.stdout:4/327: dwrite d0/d1f/f44 [0,4194304] 0 2024-03-04T09:28:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:9/358: mkdir d1/d11/d6/d8/d6f 0 2024-03-04T09:28:11.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/305: mkdir d1/d3/de/d20/d5e 0 2024-03-04T09:28:11.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/231: dwrite d0/d4/f1f [0,4194304] 0 2024-03-04T09:28:11.820 INFO:tasks.workunit.client.0.smithi046.stdout:6/328: mknod da/d14/d1e/d2c/d34/d67/d64/d56/c6b 0 2024-03-04T09:28:11.843 INFO:tasks.workunit.client.0.smithi046.stdout:6/329: write da/d14/d1e/f26 [3079831,68446] 0 2024-03-04T09:28:11.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/335: link d5/da/d28/d3f/l6e d5/da/d28/d47/l73 0 2024-03-04T09:28:12.076 INFO:tasks.workunit.client.0.smithi046.stdout:3/326: symlink d1/d21/d26/l71 0 2024-03-04T09:28:12.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/328: symlink d0/d3/d16/d17/l74 0 2024-03-04T09:28:12.592 INFO:tasks.workunit.client.0.smithi046.stdout:4/329: stat d0/d3/d16/f5a 0 2024-03-04T09:28:12.684 INFO:tasks.workunit.client.0.smithi046.stdout:9/359: rmdir d1/d11/d6/d8/d13/d59 0 2024-03-04T09:28:12.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/330: mkdir da/dd/d2b/d6c 0 2024-03-04T09:28:12.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/331: write da/d14/d1e/d27/f5e [257686,14092] 0 2024-03-04T09:28:12.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/332: fdatasync da/d14/f19 0 2024-03-04T09:28:13.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/336: link d5/c48 d5/d56/c74 0 2024-03-04T09:28:13.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/337: write d5/da/d28/f3e [997983,63803] 0 2024-03-04T09:28:13.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/338: write d5/f1d [3883821,59592] 0 2024-03-04T09:28:13.188 INFO:tasks.workunit.client.0.smithi046.stdout:3/327: symlink d1/d21/d35/l72 0 2024-03-04T09:28:13.204 INFO:tasks.workunit.client.0.smithi046.stdout:3/328: dread d1/d21/d26/f30 [0,4194304] 0 2024-03-04T09:28:13.283 INFO:tasks.workunit.client.0.smithi046.stdout:3/329: dwrite d1/d21/d35/d43/f63 [0,4194304] 0 2024-03-04T09:28:13.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/330: write d1/d21/d35/f13 [1088350,46847] 0 2024-03-04T09:28:13.920 INFO:tasks.workunit.client.0.smithi046.stdout:5/306: truncate d1/f5 181886 0 2024-03-04T09:28:13.921 INFO:tasks.workunit.client.0.smithi046.stdout:5/307: write d1/d3/d3e/f46 [613862,33938] 0 2024-03-04T09:28:14.228 INFO:tasks.workunit.client.0.smithi046.stdout:8/250: sync 2024-03-04T09:28:14.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/251: dwrite d7/de/f4a [0,4194304] 0 2024-03-04T09:28:14.493 INFO:tasks.workunit.client.0.smithi046.stdout:0/299: rename d10/d12/d1f/d2d/c39 to d10/d12/c73 0 2024-03-04T09:28:14.493 INFO:tasks.workunit.client.0.smithi046.stdout:0/300: chown d10/c1a 0 1 2024-03-04T09:28:14.494 INFO:tasks.workunit.client.0.smithi046.stdout:0/301: getdents d10/d12/d6e 0 2024-03-04T09:28:14.932 INFO:tasks.workunit.client.0.smithi046.stdout:1/267: dwrite d1/d28/f4e [0,4194304] 0 2024-03-04T09:28:14.933 INFO:tasks.workunit.client.0.smithi046.stdout:1/268: chown d1/d28/f50 1128800 1 2024-03-04T09:28:15.020 INFO:tasks.workunit.client.0.smithi046.stdout:1/269: dwrite d1/d28/f45 [0,4194304] 0 2024-03-04T09:28:15.148 INFO:tasks.workunit.client.0.smithi046.stdout:7/232: rename d0/d4/d40/l47 to d0/da/l50 0 2024-03-04T09:28:15.148 INFO:tasks.workunit.client.0.smithi046.stdout:7/233: fsync d0/d4/db/f3d 0 2024-03-04T09:28:15.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/302: truncate d10/f20 1477141 0 2024-03-04T09:28:15.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/303: chown d10/d12/d52/d5d/f61 143758075 1 2024-03-04T09:28:15.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/270: dread - d1/f33 zero size 2024-03-04T09:28:15.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/331: getdents d1/d21/d35 0 2024-03-04T09:28:15.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/332: dread - d1/f3f zero size 2024-03-04T09:28:15.828 INFO:tasks.workunit.client.0.smithi046.stdout:3/333: fsync d1/d21/d35/d24/f28 0 2024-03-04T09:28:15.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/360: rename d1/d11/d6/d8/d12/d1c/d26/c2d to d1/d11/d6/d8/d12/c70 0 2024-03-04T09:28:15.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/361: chown d1/d11/d6/d8/d13/d21/c45 1064 1 2024-03-04T09:28:16.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/271: dwrite d1/f56 [0,4194304] 0 2024-03-04T09:28:16.523 INFO:tasks.workunit.client.0.smithi046.stdout:2/339: dwrite d5/f13 [0,4194304] 0 2024-03-04T09:28:16.524 INFO:tasks.workunit.client.0.smithi046.stdout:2/340: write d5/da/d1b/f4f [4659674,11786] 0 2024-03-04T09:28:16.988 INFO:tasks.workunit.client.0.smithi046.stdout:3/334: link d1/d1d/f6b d1/d1d/d27/f73 0 2024-03-04T09:28:16.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/333: rename da/d14/d1e/d2c/d34/d67/d64/f5d to da/d14/d1e/d2c/d34/d67/f6d 0 2024-03-04T09:28:16.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/334: chown da/dd/d39/d60 6947 1 2024-03-04T09:28:16.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/335: chown f9 0 1 2024-03-04T09:28:17.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/330: sync 2024-03-04T09:28:17.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/331: fsync d0/d3/d16/f4b 0 2024-03-04T09:28:17.012 INFO:tasks.workunit.client.0.smithi046.stdout:9/362: truncate d1/d11/d6/d8/d12/d1c/f38 320295 0 2024-03-04T09:28:17.072 INFO:tasks.workunit.client.0.smithi046.stdout:9/363: dwrite d1/d11/d6/d8/d12/f30 [0,4194304] 0 2024-03-04T09:28:17.077 INFO:tasks.workunit.client.0.smithi046.stdout:6/336: dwrite da/d14/d1e/d27/f5e [0,4194304] 0 2024-03-04T09:28:17.087 INFO:tasks.workunit.client.0.smithi046.stdout:5/308: dwrite d1/d3/de/d26/f4d [0,4194304] 0 2024-03-04T09:28:17.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/337: dwrite da/d4e/f6a [0,4194304] 0 2024-03-04T09:28:17.117 INFO:tasks.workunit.client.0.smithi046.stdout:6/338: dread da/dd/f1d [0,4194304] 0 2024-03-04T09:28:17.155 INFO:tasks.workunit.client.0.smithi046.stdout:9/364: dwrite d1/d11/d6/d8/f43 [0,4194304] 0 2024-03-04T09:28:17.156 INFO:tasks.workunit.client.0.smithi046.stdout:9/365: write d1/d11/d6/f4e [1112029,14777] 0 2024-03-04T09:28:17.200 INFO:tasks.workunit.client.0.smithi046.stdout:1/272: dread d1/f48 [0,4194304] 0 2024-03-04T09:28:18.024 INFO:tasks.workunit.client.0.smithi046.stdout:3/335: getdents d1 0 2024-03-04T09:28:18.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/336: dwrite d1/d1d/d27/d40/f5a [0,4194304] 0 2024-03-04T09:28:18.169 INFO:tasks.workunit.client.0.smithi046.stdout:7/234: dwrite d0/d4/f5 [4194304,4194304] 0 2024-03-04T09:28:18.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/235: dwrite d0/d4/db/d12/f1d [0,4194304] 0 2024-03-04T09:28:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:7/236: stat d0/d4/db/d38 0 2024-03-04T09:28:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:7/237: stat d0/d4/db/d3b 0 2024-03-04T09:28:18.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/238: dread d0/d4/f1f [0,4194304] 0 2024-03-04T09:28:18.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/239: fsync d0/da/f29 0 2024-03-04T09:28:18.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/240: chown d0/da/d41 12 1 2024-03-04T09:28:18.339 INFO:tasks.workunit.client.0.smithi046.stdout:8/252: rename d7/de/d28/d3a/f48 to d7/de/d3e/f57 0 2024-03-04T09:28:18.405 INFO:tasks.workunit.client.0.smithi046.stdout:8/253: dwrite d7/de/d12/f43 [0,4194304] 0 2024-03-04T09:28:18.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/254: write d7/de/f4a [1713970,82005] 0 2024-03-04T09:28:18.584 INFO:tasks.workunit.client.0.smithi046.stdout:4/332: symlink d0/d3/d16/d17/l75 0 2024-03-04T09:28:18.585 INFO:tasks.workunit.client.0.smithi046.stdout:4/333: stat d0/d1f/f4d 0 2024-03-04T09:28:19.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/309: mkdir d1/d5f 0 2024-03-04T09:28:19.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/273: creat d1/d28/f5c x:0 0 0 2024-03-04T09:28:19.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:28:19.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:28:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/304: rename d10/d12/d1f/l6a to d10/d12/l74 0 2024-03-04T09:28:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/255: unlink d7/de/d13/d2c/f33 0 2024-03-04T09:28:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/256: chown d7/f4e 59783965 1 2024-03-04T09:28:20.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/310: creat d1/d5f/f60 x:0 0 0 2024-03-04T09:28:20.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/341: sync 2024-03-04T09:28:21.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/241: mknod d0/d4/c51 0 2024-03-04T09:28:21.338 INFO:tasks.workunit.client.0.smithi046.stdout:7/242: dread d0/d4/f1f [0,4194304] 0 2024-03-04T09:28:21.338 INFO:tasks.workunit.client.0.smithi046.stdout:7/243: write d0/f31 [527679,131014] 0 2024-03-04T09:28:21.749 INFO:tasks.workunit.client.0.smithi046.stdout:4/334: mkdir d0/d3/d16/d76 0 2024-03-04T09:28:21.823 INFO:tasks.workunit.client.0.smithi046.stdout:8/257: creat d7/de/d28/f58 x:0 0 0 2024-03-04T09:28:21.823 INFO:tasks.workunit.client.0.smithi046.stdout:8/258: creat d7/de/d12/f59 x:0 0 0 2024-03-04T09:28:21.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/342: unlink d5/da/f53 0 2024-03-04T09:28:21.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/311: creat d1/d3/de/d26/f61 x:0 0 0 2024-03-04T09:28:21.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/312: chown d1/d3/d1f/l4e 3 1 2024-03-04T09:28:21.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/313: stat d1/d3/de/d20/d5e 0 2024-03-04T09:28:22.434 INFO:tasks.workunit.client.0.smithi046.stdout:7/244: symlink d0/l52 0 2024-03-04T09:28:22.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/245: dwrite d0/d4/db/d12/f48 [0,4194304] 0 2024-03-04T09:28:22.611 INFO:tasks.workunit.client.0.smithi046.stdout:3/337: mkdir d1/d74 0 2024-03-04T09:28:22.755 INFO:tasks.workunit.client.0.smithi046.stdout:4/335: link d0/d3/d20/f64 d0/d1f/f77 0 2024-03-04T09:28:22.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/259: mkdir d7/de/d4c/d5a 0 2024-03-04T09:28:22.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/260: truncate d7/de/d13/f35 953006 0 2024-03-04T09:28:23.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/343: rmdir d5/da/d28 39 2024-03-04T09:28:23.083 INFO:tasks.workunit.client.0.smithi046.stdout:2/344: dwrite d5/f1d [0,4194304] 0 2024-03-04T09:28:23.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/305: rename fa to d10/f75 0 2024-03-04T09:28:23.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/306: fsync ff 0 2024-03-04T09:28:23.513 INFO:tasks.workunit.client.0.smithi046.stdout:9/366: dwrite d1/d11/d6/d8/d1d/d34/f49 [0,4194304] 0 2024-03-04T09:28:23.513 INFO:tasks.workunit.client.0.smithi046.stdout:9/367: read d1/d11/d6/d8/fd [3720560,12819] 0 2024-03-04T09:28:23.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/246: getdents d0/d2d 0 2024-03-04T09:28:23.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/338: mkdir d1/d1d/d5e/d75 0 2024-03-04T09:28:23.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/339: write d1/d1d/f6d [4788866,95816] 0 2024-03-04T09:28:24.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/339: symlink da/l6e 0 2024-03-04T09:28:24.074 INFO:tasks.workunit.client.0.smithi046.stdout:4/336: creat d0/d1f/d5b/f78 x:0 0 0 2024-03-04T09:28:24.641 INFO:tasks.workunit.client.0.smithi046.stdout:2/345: mkdir d5/da/d28/d75 0 2024-03-04T09:28:24.939 INFO:tasks.workunit.client.0.smithi046.stdout:9/368: creat d1/d11/d6/d8/d1d/d34/d46/d4c/f71 x:0 0 0 2024-03-04T09:28:24.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/247: creat d0/d4/db/d3b/f53 x:0 0 0 2024-03-04T09:28:24.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/248: chown d0/d3c 358352 1 2024-03-04T09:28:24.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/249: readlink d0/d4/l8 0 2024-03-04T09:28:25.103 INFO:tasks.workunit.client.0.smithi046.stdout:6/340: unlink da/dd/f12 0 2024-03-04T09:28:25.116 INFO:tasks.workunit.client.0.smithi046.stdout:3/340: dread d1/d21/d35/d2b/f47 [0,4194304] 0 2024-03-04T09:28:25.649 INFO:tasks.workunit.client.0.smithi046.stdout:2/346: truncate f3 2759870 0 2024-03-04T09:28:25.650 INFO:tasks.workunit.client.0.smithi046.stdout:2/347: creat d5/d38/f76 x:0 0 0 2024-03-04T09:28:25.650 INFO:tasks.workunit.client.0.smithi046.stdout:2/348: fsync d5/da/d1b/f30 0 2024-03-04T09:28:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:2/349: dwrite d5/d2c/f71 [0,4194304] 0 2024-03-04T09:28:25.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/250: mkdir d0/d4/d40/d4a/d54 0 2024-03-04T09:28:25.866 INFO:tasks.workunit.client.0.smithi046.stdout:9/369: mknod d1/d11/d6/d8/d1d/d34/c72 0 2024-03-04T09:28:26.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/341: truncate da/f32 750645 0 2024-03-04T09:28:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:2/350: symlink d5/da/d1b/l77 0 2024-03-04T09:28:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:2/351: fsync d5/d40/f72 0 2024-03-04T09:28:27.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/352: dread d5/d2c/f71 [0,4194304] 0 2024-03-04T09:28:27.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/370: dread d1/d11/d6/d8/d12/d1c/f38 [0,4194304] 0 2024-03-04T09:28:27.452 INFO:tasks.workunit.client.0.smithi046.stdout:1/274: sync 2024-03-04T09:28:27.752 INFO:tasks.workunit.client.0.smithi046.stdout:8/261: dwrite d7/de/d28/f2b [0,4194304] 0 2024-03-04T09:28:27.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/353: dread d5/d2c/d51/f58 [0,4194304] 0 2024-03-04T09:28:28.019 INFO:tasks.workunit.client.0.smithi046.stdout:6/342: creat da/d14/d1e/d27/d4a/f6f x:0 0 0 2024-03-04T09:28:28.223 INFO:tasks.workunit.client.0.smithi046.stdout:1/275: dread d1/f44 [0,4194304] 0 2024-03-04T09:28:28.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/354: truncate d5/da/f14 6546139 0 2024-03-04T09:28:28.705 INFO:tasks.workunit.client.0.smithi046.stdout:6/343: creat da/dd/d22/f70 x:0 0 0 2024-03-04T09:28:28.738 INFO:tasks.workunit.client.0.smithi046.stdout:6/344: write da/d14/d1e/d27/f55 [2529272,48069] 0 2024-03-04T09:28:28.738 INFO:tasks.workunit.client.0.smithi046.stdout:6/345: fdatasync da/dd/f36 0 2024-03-04T09:28:28.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/276: symlink d1/d28/l5d 0 2024-03-04T09:28:29.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/355: dread d5/da/d28/f35 [0,4194304] 0 2024-03-04T09:28:29.478 INFO:tasks.workunit.client.0.smithi046.stdout:0/307: dwrite d10/d12/d1f/d2d/f3c [0,4194304] 0 2024-03-04T09:28:29.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/346: unlink da/d14/d1e/d27/d4b/c59 0 2024-03-04T09:28:29.786 INFO:tasks.workunit.client.0.smithi046.stdout:1/277: creat d1/f5e x:0 0 0 2024-03-04T09:28:29.786 INFO:tasks.workunit.client.0.smithi046.stdout:1/278: write d1/d28/f30 [937782,82565] 0 2024-03-04T09:28:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:2/356: mknod d5/d38/d54/c78 0 2024-03-04T09:28:30.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/314: rmdir d1/d3 39 2024-03-04T09:28:30.448 INFO:tasks.workunit.client.0.smithi046.stdout:5/315: chown d1/d3/de/d26/f43 317404 1 2024-03-04T09:28:30.448 INFO:tasks.workunit.client.0.smithi046.stdout:9/371: symlink d1/d11/d6/l73 0 2024-03-04T09:28:30.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/337: sync 2024-03-04T09:28:30.449 INFO:tasks.workunit.client.0.smithi046.stdout:3/341: sync 2024-03-04T09:28:30.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/338: dread - d0/f39 zero size 2024-03-04T09:28:30.449 INFO:tasks.workunit.client.0.smithi046.stdout:3/342: truncate d1/d21/d35/d43/f64 329228 0 2024-03-04T09:28:30.478 INFO:tasks.workunit.client.0.smithi046.stdout:9/372: write d1/d11/d6/d8/d36/f65 [3425399,64398] 0 2024-03-04T09:28:30.522 INFO:tasks.workunit.client.0.smithi046.stdout:7/251: dwrite d0/d4/db/d12/f30 [0,4194304] 0 2024-03-04T09:28:30.549 INFO:tasks.workunit.client.0.smithi046.stdout:7/252: dread d0/d4/f1f [4194304,4194304] 0 2024-03-04T09:28:30.758 INFO:tasks.workunit.client.0.smithi046.stdout:6/347: rename da/dd/f1d to da/dd/d39/d60/f71 0 2024-03-04T09:28:31.032 INFO:tasks.workunit.client.0.smithi046.stdout:8/262: dwrite d7/de/f1f [0,4194304] 0 2024-03-04T09:28:31.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/339: creat d0/d1f/f79 x:0 0 0 2024-03-04T09:28:31.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/316: read d1/d3/de/d20/f42 [8716911,66998] 0 2024-03-04T09:28:31.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/317: dread d1/d3/fc [0,4194304] 0 2024-03-04T09:28:31.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/318: write d1/d3/fc [1773815,7770] 0 2024-03-04T09:28:31.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/319: readlink d1/d3/d1f/l50 0 2024-03-04T09:28:32.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/348: creat da/dd/d46/f72 x:0 0 0 2024-03-04T09:28:32.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/349: truncate da/d14/d1e/d2c/d34/f69 319818 0 2024-03-04T09:28:32.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/279: rmdir d1 39 2024-03-04T09:28:32.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/350: creat da/dd/d2b/d6c/f73 x:0 0 0 2024-03-04T09:28:32.823 INFO:tasks.workunit.client.0.smithi046.stdout:0/308: sync 2024-03-04T09:28:32.856 INFO:tasks.workunit.client.0.smithi046.stdout:0/309: read fc [2546184,11393] 0 2024-03-04T09:28:32.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/320: dwrite d1/d44/d57/f35 [0,4194304] 0 2024-03-04T09:28:32.912 INFO:tasks.workunit.client.0.smithi046.stdout:1/280: mknod d1/d28/c5f 0 2024-03-04T09:28:32.912 INFO:tasks.workunit.client.0.smithi046.stdout:1/281: truncate d1/d28/f3c 914865 0 2024-03-04T09:28:32.959 INFO:tasks.workunit.client.0.smithi046.stdout:5/321: dwrite d1/d3/d1f/f31 [0,4194304] 0 2024-03-04T09:28:32.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/322: write d1/d3/d1f/f31 [2286350,124640] 0 2024-03-04T09:28:33.039 INFO:tasks.workunit.client.0.smithi046.stdout:8/263: symlink d7/de/d13/l5b 0 2024-03-04T09:28:33.066 INFO:tasks.workunit.client.0.smithi046.stdout:8/264: write d7/de/d13/d2c/f31 [973910,107630] 0 2024-03-04T09:28:33.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/357: rmdir d5/d40 39 2024-03-04T09:28:33.169 INFO:tasks.workunit.client.0.smithi046.stdout:6/351: mknod da/d14/d17/c74 0 2024-03-04T09:28:33.416 INFO:tasks.workunit.client.0.smithi046.stdout:0/310: creat d10/d36/f76 x:0 0 0 2024-03-04T09:28:33.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/343: dwrite d1/d1d/d31/f3e [0,4194304] 0 2024-03-04T09:28:33.723 INFO:tasks.workunit.client.0.smithi046.stdout:3/344: write d1/d21/d35/f13 [3120466,119607] 0 2024-03-04T09:28:33.948 INFO:tasks.workunit.client.0.smithi046.stdout:8/265: rmdir d7/de/d13/d3c 39 2024-03-04T09:28:34.248 INFO:tasks.workunit.client.0.smithi046.stdout:6/352: creat da/d14/d1e/d27/d4b/f75 x:0 0 0 2024-03-04T09:28:34.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/311: rmdir d10/d12/d52/d5d/d71 0 2024-03-04T09:28:34.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/345: mkdir d1/d1d/d27/d40/d76 0 2024-03-04T09:28:34.924 INFO:tasks.workunit.client.0.smithi046.stdout:8/266: link d7/de/d13/d2c/c32 d7/de/d4c/c5c 0 2024-03-04T09:28:34.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/373: sync 2024-03-04T09:28:34.984 INFO:tasks.workunit.client.0.smithi046.stdout:9/374: dread d1/d11/d6/d8/d1d/d34/f3c [0,4194304] 0 2024-03-04T09:28:34.984 INFO:tasks.workunit.client.0.smithi046.stdout:9/375: read d1/d11/d6/d8/d12/d1c/f38 [16758,32833] 0 2024-03-04T09:28:35.027 INFO:tasks.workunit.client.0.smithi046.stdout:2/358: rmdir d5/d38 39 2024-03-04T09:28:35.027 INFO:tasks.workunit.client.0.smithi046.stdout:2/359: truncate d5/da/d28/d47/f5c 24931 0 2024-03-04T09:28:35.037 INFO:tasks.workunit.client.0.smithi046.stdout:9/376: dwrite d1/d11/d6/d8/d12/f30 [0,4194304] 0 2024-03-04T09:28:35.125 INFO:tasks.workunit.client.0.smithi046.stdout:6/353: mknod da/d14/d1e/d2c/d34/c76 0 2024-03-04T09:28:35.125 INFO:tasks.workunit.client.0.smithi046.stdout:6/354: write da/dd/d2b/f3c [4453575,9096] 0 2024-03-04T09:28:35.304 INFO:tasks.workunit.client.0.smithi046.stdout:0/312: mknod d10/d12/d1f/c77 0 2024-03-04T09:28:35.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/346: mknod d1/d74/c77 0 2024-03-04T09:28:35.489 INFO:tasks.workunit.client.0.smithi046.stdout:8/267: read d7/de/d13/f35 [286842,53786] 0 2024-03-04T09:28:35.812 INFO:tasks.workunit.client.0.smithi046.stdout:2/360: truncate d5/da/d28/f35 4376186 0 2024-03-04T09:28:35.812 INFO:tasks.workunit.client.0.smithi046.stdout:0/313: truncate d10/f2e 8213544 0 2024-03-04T09:28:35.812 INFO:tasks.workunit.client.0.smithi046.stdout:2/361: chown d5/da/d1b 99001769 1 2024-03-04T09:28:35.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/340: write d0/d1f/f2c [1711856,123221] 0 2024-03-04T09:28:35.829 INFO:tasks.workunit.client.0.smithi046.stdout:0/314: dread ff [0,4194304] 0 2024-03-04T09:28:35.829 INFO:tasks.workunit.client.0.smithi046.stdout:0/315: stat d10/d12/d1f/l37 0 2024-03-04T09:28:36.173 INFO:tasks.workunit.client.0.smithi046.stdout:3/347: mkdir d1/d1d/d27/d4a/d78 0 2024-03-04T09:28:36.946 INFO:tasks.workunit.client.0.smithi046.stdout:4/341: mknod d0/d5f/d6f/c7a 0 2024-03-04T09:28:36.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/348: mknod d1/d21/d35/c79 0 2024-03-04T09:28:36.979 INFO:tasks.workunit.client.0.smithi046.stdout:3/349: dread d1/d21/d35/d24/f28 [0,4194304] 0 2024-03-04T09:28:36.979 INFO:tasks.workunit.client.0.smithi046.stdout:3/350: fdatasync d1/d21/d35/d43/f49 0 2024-03-04T09:28:37.127 INFO:tasks.workunit.client.0.smithi046.stdout:1/282: dwrite d1/f2b [0,4194304] 0 2024-03-04T09:28:37.127 INFO:tasks.workunit.client.0.smithi046.stdout:1/283: write d1/d28/f50 [183266,12261] 0 2024-03-04T09:28:37.379 INFO:tasks.workunit.client.0.smithi046.stdout:2/362: symlink d5/l79 0 2024-03-04T09:28:37.379 INFO:tasks.workunit.client.0.smithi046.stdout:2/363: dread - d5/da/d28/f44 zero size 2024-03-04T09:28:37.379 INFO:tasks.workunit.client.0.smithi046.stdout:2/364: fsync d5/d2c/f33 0 2024-03-04T09:28:37.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/342: mkdir d0/d1f/d25/d7b 0 2024-03-04T09:28:37.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/351: creat d1/d1d/f7a x:0 0 0 2024-03-04T09:28:37.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/365: dread d5/d2c/f6a [0,4194304] 0 2024-03-04T09:28:37.714 INFO:tasks.workunit.client.0.smithi046.stdout:7/253: rename d0/d4/db/d12/d28/c2f to d0/d4/db/c55 0 2024-03-04T09:28:38.804 INFO:tasks.workunit.client.0.smithi046.stdout:4/343: creat d0/d3/d16/d17/d6d/f7c x:0 0 0 2024-03-04T09:28:38.804 INFO:tasks.workunit.client.0.smithi046.stdout:3/352: getdents d1/d21 0 2024-03-04T09:28:38.870 INFO:tasks.workunit.client.0.smithi046.stdout:4/344: dwrite d0/d1f/d35/f4a [0,4194304] 0 2024-03-04T09:28:39.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/323: rename d1/d3/d1f/l50 to d1/d44/l62 0 2024-03-04T09:28:39.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/324: chown d1/d3/de/f4c 719803280 1 2024-03-04T09:28:39.210 INFO:tasks.workunit.client.0.smithi046.stdout:5/325: dwrite d1/d3/d3e/f3f [0,4194304] 0 2024-03-04T09:28:39.647 INFO:tasks.workunit.client.0.smithi046.stdout:4/345: mknod d0/d3/d20/c7d 0 2024-03-04T09:28:40.052 INFO:tasks.workunit.client.0.smithi046.stdout:9/377: rename d1/d11/d6/d8/d1d/d34/d4d/c6b to d1/d11/d6/d8/d1d/d34/d35/c74 0 2024-03-04T09:28:40.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/378: dread d1/d11/d6/d8/d36/f51 [0,4194304] 0 2024-03-04T09:28:40.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/346: rmdir d0 39 2024-03-04T09:28:40.495 INFO:tasks.workunit.client.0.smithi046.stdout:5/326: mkdir d1/d3/de/d1d/d63 0 2024-03-04T09:28:40.496 INFO:tasks.workunit.client.0.smithi046.stdout:4/347: fdatasync d0/d1f/d5b/f78 0 2024-03-04T09:28:40.496 INFO:tasks.workunit.client.0.smithi046.stdout:5/327: creat d1/d5f/f64 x:0 0 0 2024-03-04T09:28:40.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/355: rename da/dd/d22/d3f to da/d14/d1e/d2c/d34/d67/d64/d56/d77 0 2024-03-04T09:28:40.511 INFO:tasks.workunit.client.0.smithi046.stdout:9/379: unlink d1/f5a 0 2024-03-04T09:28:40.538 INFO:tasks.workunit.client.0.smithi046.stdout:9/380: write d1/d11/d6/d8/d12/f30 [2993949,112908] 0 2024-03-04T09:28:40.538 INFO:tasks.workunit.client.0.smithi046.stdout:9/381: write d1/d11/d6/d8/fd [5488385,81873] 0 2024-03-04T09:28:40.802 INFO:tasks.workunit.client.0.smithi046.stdout:1/284: sync 2024-03-04T09:28:40.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/366: dwrite d5/da/f23 [0,4194304] 0 2024-03-04T09:28:40.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/348: unlink d0/d3/d3b/c72 0 2024-03-04T09:28:40.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/349: readlink d0/d3/d16/le 0 2024-03-04T09:28:40.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/350: read d0/f11 [3975852,25653] 0 2024-03-04T09:28:40.945 INFO:tasks.workunit.client.0.smithi046.stdout:4/351: dread - d0/d3/d16/f4b zero size 2024-03-04T09:28:41.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/268: rename d7/de/d28/l2f to d7/de/d12/l5d 0 2024-03-04T09:28:41.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/269: stat d7/de/d12 0 2024-03-04T09:28:41.263 INFO:tasks.workunit.client.0.smithi046.stdout:8/270: dread d7/de/f1b [0,4194304] 0 2024-03-04T09:28:41.474 INFO:tasks.workunit.client.0.smithi046.stdout:9/382: creat d1/d11/f75 x:0 0 0 2024-03-04T09:28:41.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/383: dread d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:28:41.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/384: creat d1/d11/d6/d8/d1d/d34/d35/f76 x:0 0 0 2024-03-04T09:28:41.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/254: rmdir d0/da 39 2024-03-04T09:28:41.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/353: sync 2024-03-04T09:28:41.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/255: read d0/d4/f1f [3359512,102583] 0 2024-03-04T09:28:41.566 INFO:tasks.workunit.client.0.smithi046.stdout:3/354: write d1/d1d/d31/f3e [3185027,28273] 0 2024-03-04T09:28:41.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/355: chown d1/d21/d35/l72 236 1 2024-03-04T09:28:41.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/356: creat d1/d1d/d27/d4a/f7b x:0 0 0 2024-03-04T09:28:41.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/357: chown d1/d1d/d27/d4a/f65 7596 1 2024-03-04T09:28:41.568 INFO:tasks.workunit.client.0.smithi046.stdout:9/385: dwrite d1/d11/d6/d8/d1d/d34/d46/d5e/f6a [0,4194304] 0 2024-03-04T09:28:41.568 INFO:tasks.workunit.client.0.smithi046.stdout:9/386: write d1/d11/d6/d8/d12/f30 [1965399,85841] 0 2024-03-04T09:28:41.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/285: dread d1/f54 [0,4194304] 0 2024-03-04T09:28:42.095 INFO:tasks.workunit.client.0.smithi046.stdout:2/367: creat d5/d38/d54/f7a x:0 0 0 2024-03-04T09:28:42.126 INFO:tasks.workunit.client.0.smithi046.stdout:2/368: dread d5/f13 [0,4194304] 0 2024-03-04T09:28:42.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/369: read - d5/da/f21 zero size 2024-03-04T09:28:42.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/352: mknod d0/d1f/d5b/c7e 0 2024-03-04T09:28:42.693 INFO:tasks.workunit.client.0.smithi046.stdout:8/271: link d7/de/d4c/d50/l42 d7/de/d4c/d50/l5e 0 2024-03-04T09:28:42.719 INFO:tasks.workunit.client.0.smithi046.stdout:8/272: dread d7/de/d28/f2b [0,4194304] 0 2024-03-04T09:28:43.145 INFO:tasks.workunit.client.0.smithi046.stdout:3/358: mknod d1/d1d/d5e/c7c 0 2024-03-04T09:28:43.145 INFO:tasks.workunit.client.0.smithi046.stdout:3/359: chown d1/f3f 51652 1 2024-03-04T09:28:43.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/286: rename d1/d28/f45 to d1/d28/f60 0 2024-03-04T09:28:43.968 INFO:tasks.workunit.client.0.smithi046.stdout:2/370: stat d5/d40/d5a/f6d 0 2024-03-04T09:28:44.156 INFO:tasks.workunit.client.0.smithi046.stdout:4/353: link d0/d3/d16/f4b d0/d5f/d6f/f7f 0 2024-03-04T09:28:44.157 INFO:tasks.workunit.client.0.smithi046.stdout:4/354: write d0/d3/d16/f5a [760610,32295] 0 2024-03-04T09:28:44.229 INFO:tasks.workunit.client.0.smithi046.stdout:4/355: dwrite d0/d3/d20/f64 [0,4194304] 0 2024-03-04T09:28:44.407 INFO:tasks.workunit.client.0.smithi046.stdout:3/360: truncate d1/d1d/f3a 825763 0 2024-03-04T09:28:44.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/361: read d1/d21/d35/f6c [275310,99698] 0 2024-03-04T09:28:44.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/362: chown d1/d21/d35/d2b/f6a 450431762 1 2024-03-04T09:28:44.706 INFO:tasks.workunit.client.0.smithi046.stdout:2/371: symlink d5/d2c/l7b 0 2024-03-04T09:28:44.988 INFO:tasks.workunit.client.0.smithi046.stdout:0/316: rename d10/d12/d1f/d2d to d10/d12/d52/d78 0 2024-03-04T09:28:45.259 INFO:tasks.workunit.client.0.smithi046.stdout:4/356: mknod d0/d1f/d5b/c80 0 2024-03-04T09:28:45.259 INFO:tasks.workunit.client.0.smithi046.stdout:4/357: chown d0/d1f/d5b 20439 1 2024-03-04T09:28:45.646 INFO:tasks.workunit.client.0.smithi046.stdout:2/372: mkdir d5/d56/d7c 0 2024-03-04T09:28:45.927 INFO:tasks.workunit.client.0.smithi046.stdout:1/287: creat d1/f61 x:0 0 0 2024-03-04T09:28:45.928 INFO:tasks.workunit.client.0.smithi046.stdout:5/328: rename d1/d3/de/d4f/f53 to d1/d3/de/d41/f65 0 2024-03-04T09:28:45.928 INFO:tasks.workunit.client.0.smithi046.stdout:5/329: write d1/d3/d1f/f31 [1801217,58714] 0 2024-03-04T09:28:46.268 INFO:tasks.workunit.client.0.smithi046.stdout:4/358: creat d0/d3/d16/d17/d6d/d6e/f81 x:0 0 0 2024-03-04T09:28:46.333 INFO:tasks.workunit.client.0.smithi046.stdout:3/363: getdents d1/d21/d35/d43 0 2024-03-04T09:28:46.333 INFO:tasks.workunit.client.0.smithi046.stdout:3/364: write d1/d21/d35/d43/f46 [987953,52232] 0 2024-03-04T09:28:46.333 INFO:tasks.workunit.client.0.smithi046.stdout:3/365: write d1/d1d/d31/f3e [4135801,21869] 0 2024-03-04T09:28:46.353 INFO:tasks.workunit.client.0.smithi046.stdout:3/366: read d1/d21/d35/d24/f28 [52329,73170] 0 2024-03-04T09:28:46.353 INFO:tasks.workunit.client.0.smithi046.stdout:3/367: chown d1/d1d/d27/d4a/f7b 414851727 1 2024-03-04T09:28:46.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/373: symlink d5/d40/d5a/l7d 0 2024-03-04T09:28:46.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/374: creat d5/d2c/f7e x:0 0 0 2024-03-04T09:28:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/288: unlink d1/d28/f3e 0 2024-03-04T09:28:47.204 INFO:tasks.workunit.client.0.smithi046.stdout:0/317: rmdir d10/d12/d52/d5d 39 2024-03-04T09:28:47.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/318: dread d10/d12/f56 [0,4194304] 0 2024-03-04T09:28:47.266 INFO:tasks.workunit.client.0.smithi046.stdout:0/319: dread d10/d12/d1f/d3f/d4b/f62 [0,4194304] 0 2024-03-04T09:28:47.266 INFO:tasks.workunit.client.0.smithi046.stdout:0/320: fdatasync d10/d12/d52/d78/f3c 0 2024-03-04T09:28:47.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/321: dwrite f1 [0,4194304] 0 2024-03-04T09:28:47.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/322: chown d10/d12/d1f/d3b/f43 21122 1 2024-03-04T09:28:47.453 INFO:tasks.workunit.client.0.smithi046.stdout:7/256: sync 2024-03-04T09:28:47.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/387: sync 2024-03-04T09:28:47.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/388: write d1/d11/d6/d8/d36/f51 [1290750,76328] 0 2024-03-04T09:28:47.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/368: mkdir d1/d1d/d27/d40/d70/d7d 0 2024-03-04T09:28:47.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/375: mkdir d5/d2c/d51/d7f 0 2024-03-04T09:28:48.081 INFO:tasks.workunit.client.0.smithi046.stdout:1/289: rename d1/d28/c52 to d1/d28/c62 0 2024-03-04T09:28:48.490 INFO:tasks.workunit.client.0.smithi046.stdout:0/323: mknod d10/d12/d52/c79 0 2024-03-04T09:28:48.491 INFO:tasks.workunit.client.0.smithi046.stdout:0/324: fsync d10/d12/d52/d78/f6d 0 2024-03-04T09:28:48.491 INFO:tasks.workunit.client.0.smithi046.stdout:0/325: truncate f1 4393324 0 2024-03-04T09:28:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:7/257: rmdir d0/d4/d40/d4a/d54 0 2024-03-04T09:28:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:7/258: chown d0/d4/db/d12/l17 38 1 2024-03-04T09:28:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:7/259: stat d0/da/d46 0 2024-03-04T09:28:49.299 INFO:tasks.workunit.client.0.smithi046.stdout:8/273: rmdir d7/de/d28 39 2024-03-04T09:28:49.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/274: write d7/de/d13/f17 [3639506,109882] 0 2024-03-04T09:28:49.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/275: fsync d7/de/f21 0 2024-03-04T09:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/276: dwrite d7/de/d13/f38 [0,4194304] 0 2024-03-04T09:28:49.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/369: symlink d1/d1d/d27/d40/d70/d7d/l7e 0 2024-03-04T09:28:49.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/370: write d1/d1d/f6b [428901,84067] 0 2024-03-04T09:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:8/277: dwrite d7/de/d13/f17 [0,4194304] 0 2024-03-04T09:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:8/278: write d7/de/d12/f59 [220355,26477] 0 2024-03-04T09:28:49.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/279: write d7/f1a [1735525,25345] 0 2024-03-04T09:28:49.508 INFO:tasks.workunit.client.0.smithi046.stdout:8/280: dread d7/de/f1f [0,4194304] 0 2024-03-04T09:28:49.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/356: rename da/dd/d2b to da/d14/d1e/d27/d78 0 2024-03-04T09:28:49.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/357: chown da/d4e/l57 6333250 1 2024-03-04T09:28:49.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:28:49.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:28:49.782 INFO:tasks.workunit.client.0.smithi046.stdout:7/260: dread d0/d4/db/f2b [0,4194304] 0 2024-03-04T09:28:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/261: truncate d0/d4/db/f3d 1527392 0 2024-03-04T09:28:49.816 INFO:tasks.workunit.client.0.smithi046.stdout:7/262: dwrite d0/d4/db/d12/d28/f4b [0,4194304] 0 2024-03-04T09:28:49.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/263: creat d0/d4/db/d12/d28/f56 x:0 0 0 2024-03-04T09:28:49.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/264: fdatasync d0/da/f2a 0 2024-03-04T09:28:50.203 INFO:tasks.workunit.client.0.smithi046.stdout:3/371: mknod d1/c7f 0 2024-03-04T09:28:50.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/281: creat d7/f5f x:0 0 0 2024-03-04T09:28:50.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/282: readlink d7/de/l22 0 2024-03-04T09:28:50.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/283: stat d7/fd 0 2024-03-04T09:28:50.416 INFO:tasks.workunit.client.0.smithi046.stdout:1/290: link d1/f49 d1/d28/f63 0 2024-03-04T09:28:50.430 INFO:tasks.workunit.client.0.smithi046.stdout:1/291: dread d1/f44 [0,4194304] 0 2024-03-04T09:28:50.433 INFO:tasks.workunit.client.0.smithi046.stdout:1/292: write d1/f33 [80018,70257] 0 2024-03-04T09:28:50.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/376: rename d5/d56/c74 to d5/d38/d54/c80 0 2024-03-04T09:28:50.609 INFO:tasks.workunit.client.0.smithi046.stdout:9/389: write d1/d11/d6/d8/d1d/d34/d4d/f55 [3192760,21315] 0 2024-03-04T09:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/390: stat d1/d11/d6/d8/f33 0 2024-03-04T09:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/391: truncate d1/d11/d6/d8/d1d/d34/d35/f5d 37917 0 2024-03-04T09:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/392: fdatasync d1/d11/d6/d8/d13/f24 0 2024-03-04T09:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/393: chown d1/d11/d6/d8/d1d/d34/d46/d4c/f71 7166 1 2024-03-04T09:28:50.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/358: mknod da/d14/d1e/d2c/d34/d67/c79 0 2024-03-04T09:28:50.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/359: dread da/dd/f2a [0,4194304] 0 2024-03-04T09:28:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:0/326: mkdir d10/d36/d7a 0 2024-03-04T09:28:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:4/359: mknod d0/d3/c82 0 2024-03-04T09:28:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:0/327: fdatasync d10/d12/d1f/d3f/d4b/f62 0 2024-03-04T09:28:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:0/328: write fd [1438242,42930] 0 2024-03-04T09:28:51.479 INFO:tasks.workunit.client.0.smithi046.stdout:7/265: truncate d0/d4/db/d12/f48 1437775 0 2024-03-04T09:28:51.479 INFO:tasks.workunit.client.0.smithi046.stdout:8/284: mknod d7/de/d3e/c60 0 2024-03-04T09:28:51.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/372: rename d1/d21/d35/d2b/l48 to d1/d1d/d27/d4a/d78/l80 0 2024-03-04T09:28:51.640 INFO:tasks.workunit.client.0.smithi046.stdout:3/373: read d1/d1d/f6b [202530,2208] 0 2024-03-04T09:28:51.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/374: read d1/f39 [1729232,78376] 0 2024-03-04T09:28:51.771 INFO:tasks.workunit.client.0.smithi046.stdout:2/377: rmdir d5/d40 39 2024-03-04T09:28:51.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/394: creat d1/d11/d6/d8/d1d/f77 x:0 0 0 2024-03-04T09:28:51.988 INFO:tasks.workunit.client.0.smithi046.stdout:6/360: symlink da/d14/d1e/d2c/d34/d67/d64/d56/l7a 0 2024-03-04T09:28:52.059 INFO:tasks.workunit.client.0.smithi046.stdout:6/361: dwrite da/dd/f13 [4194304,4194304] 0 2024-03-04T09:28:52.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/360: mknod d0/d3/d16/d1e/c83 0 2024-03-04T09:28:52.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/361: write d0/d3/d16/f4b [583909,82598] 0 2024-03-04T09:28:52.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/362: creat d0/d1f/d35/f84 x:0 0 0 2024-03-04T09:28:52.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/363: truncate d0/d1f/d5b/d60/f68 481515 0 2024-03-04T09:28:52.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/330: sync 2024-03-04T09:28:52.555 INFO:tasks.workunit.client.0.smithi046.stdout:0/329: mknod d10/d12/d52/d5d/c7b 0 2024-03-04T09:28:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/285: creat d7/de/d28/d3a/f61 x:0 0 0 2024-03-04T09:28:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/286: write d7/de/d13/d2c/f31 [3046645,112967] 0 2024-03-04T09:28:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/287: write d7/de/f52 [645917,124288] 0 2024-03-04T09:28:52.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/288: read f2 [3614802,24356] 0 2024-03-04T09:28:52.755 INFO:tasks.workunit.client.0.smithi046.stdout:8/289: read d7/de/f1b [2176885,51074] 0 2024-03-04T09:28:54.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/378: symlink d5/d38/l81 0 2024-03-04T09:28:54.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/379: readlink d5/da/l26 0 2024-03-04T09:28:54.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/380: dread d5/d2c/f71 [0,4194304] 0 2024-03-04T09:28:54.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/381: chown d5/da 2166015 1 2024-03-04T09:28:54.214 INFO:tasks.workunit.client.0.smithi046.stdout:9/395: mknod d1/d11/d6/d8/d1d/d34/d46/d5e/c78 0 2024-03-04T09:28:54.301 INFO:tasks.workunit.client.0.smithi046.stdout:6/362: truncate da/d4e/f6a 1559984 0 2024-03-04T09:28:54.657 INFO:tasks.workunit.client.0.smithi046.stdout:4/364: truncate d0/d3/f4 490436 0 2024-03-04T09:28:54.657 INFO:tasks.workunit.client.0.smithi046.stdout:4/365: chown d0/d3/d16/d1e/f36 72791623 1 2024-03-04T09:28:54.657 INFO:tasks.workunit.client.0.smithi046.stdout:4/366: write d0/d1f/d25/f69 [527854,119991] 0 2024-03-04T09:28:54.683 INFO:tasks.workunit.client.0.smithi046.stdout:4/367: dread d0/d1f/f45 [0,4194304] 0 2024-03-04T09:28:54.732 INFO:tasks.workunit.client.0.smithi046.stdout:5/331: creat d1/d3/d3e/f66 x:0 0 0 2024-03-04T09:28:54.745 INFO:tasks.workunit.client.0.smithi046.stdout:5/332: dread d1/d3/de/d1d/f33 [0,4194304] 0 2024-03-04T09:28:54.745 INFO:tasks.workunit.client.0.smithi046.stdout:5/333: fdatasync d1/d3/d1f/f31 0 2024-03-04T09:28:55.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/375: rmdir d1/d21/d35/d2b 39 2024-03-04T09:28:55.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/376: write d1/d1d/f37 [438903,25165] 0 2024-03-04T09:28:55.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/377: chown d1/d74/c77 1023944 1 2024-03-04T09:28:55.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/290: mkdir d7/de/d13/d2c/d62 0 2024-03-04T09:28:55.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/291: read d7/f1a [3990541,42778] 0 2024-03-04T09:28:55.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/292: write d7/de/d12/f43 [2150245,128381] 0 2024-03-04T09:28:55.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/293: write d7/de/f21 [756004,50246] 0 2024-03-04T09:28:55.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/294: chown d7/de/d12/f43 8035 1 2024-03-04T09:28:55.302 INFO:tasks.workunit.client.0.smithi046.stdout:8/295: dread d7/f1a [0,4194304] 0 2024-03-04T09:28:56.043 INFO:tasks.workunit.client.0.smithi046.stdout:6/363: creat da/d14/d1e/d27/d78/f7b x:0 0 0 2024-03-04T09:28:56.043 INFO:tasks.workunit.client.0.smithi046.stdout:6/364: write da/d14/d1e/d27/d78/f3c [287014,11401] 0 2024-03-04T09:28:56.258 INFO:tasks.workunit.client.0.smithi046.stdout:4/368: mkdir d0/d3/d16/d17/d6d/d6e/d85 0 2024-03-04T09:28:56.278 INFO:tasks.workunit.client.0.smithi046.stdout:4/369: read d0/d1f/d25/d50/f51 [3320715,27208] 0 2024-03-04T09:28:56.333 INFO:tasks.workunit.client.0.smithi046.stdout:5/334: mknod d1/d5f/c67 0 2024-03-04T09:28:56.361 INFO:tasks.workunit.client.0.smithi046.stdout:4/370: dwrite d0/d1f/d5b/d60/f68 [0,4194304] 0 2024-03-04T09:28:56.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/335: write d1/d44/d57/f35 [1066121,948] 0 2024-03-04T09:28:56.463 INFO:tasks.workunit.client.0.smithi046.stdout:5/336: dwrite d1/d3/de/d26/f3d [0,4194304] 0 2024-03-04T09:28:56.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/337: fdatasync d1/d3/de/d26/f28 0 2024-03-04T09:28:56.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/338: truncate d1/d3/de/d1d/f33 2198850 0 2024-03-04T09:28:56.536 INFO:tasks.workunit.client.0.smithi046.stdout:0/330: rmdir d10/d36 39 2024-03-04T09:28:56.547 INFO:tasks.workunit.client.0.smithi046.stdout:0/331: dread d10/d12/d1f/d3f/f65 [0,4194304] 0 2024-03-04T09:28:56.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/378: mknod d1/d1d/d5e/c81 0 2024-03-04T09:28:57.160 INFO:tasks.workunit.client.0.smithi046.stdout:1/293: dwrite d1/d28/f37 [0,4194304] 0 2024-03-04T09:28:57.217 INFO:tasks.workunit.client.0.smithi046.stdout:1/294: dwrite d1/f27 [0,4194304] 0 2024-03-04T09:28:57.242 INFO:tasks.workunit.client.0.smithi046.stdout:7/266: sync 2024-03-04T09:28:57.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/267: write d0/da/f29 [336452,77031] 0 2024-03-04T09:28:57.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/268: chown d0/d4/db/d12/d28 5 1 2024-03-04T09:28:57.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/365: mknod da/d14/d1e/d2c/d34/d67/d64/c7c 0 2024-03-04T09:28:57.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/366: truncate da/dd/d46/f72 989265 0 2024-03-04T09:28:57.822 INFO:tasks.workunit.client.0.smithi046.stdout:4/371: creat d0/d5f/f86 x:0 0 0 2024-03-04T09:28:57.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/396: symlink d1/d11/d6/d8/d1d/d34/d46/l79 0 2024-03-04T09:28:58.793 INFO:tasks.workunit.client.0.smithi046.stdout:5/339: mknod d1/d5f/c68 0 2024-03-04T09:28:58.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/332: mknod d10/d12/d52/d78/c7c 0 2024-03-04T09:28:58.793 INFO:tasks.workunit.client.0.smithi046.stdout:3/379: mkdir d1/d74/d82 0 2024-03-04T09:28:58.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/380: read d1/f1e [1651478,38906] 0 2024-03-04T09:28:58.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/381: readlink d1/d21/l22 0 2024-03-04T09:28:58.883 INFO:tasks.workunit.client.0.smithi046.stdout:1/295: dwrite d1/fe [0,4194304] 0 2024-03-04T09:28:58.883 INFO:tasks.workunit.client.0.smithi046.stdout:1/296: chown d1/f27 0 1 2024-03-04T09:28:58.915 INFO:tasks.workunit.client.0.smithi046.stdout:1/297: dread d1/d28/f37 [0,4194304] 0 2024-03-04T09:28:59.750 INFO:tasks.workunit.client.0.smithi046.stdout:6/367: mknod da/d14/d1e/d27/d78/c7d 0 2024-03-04T09:28:59.750 INFO:tasks.workunit.client.0.smithi046.stdout:4/372: symlink d0/d3/d16/d17/d6d/d6e/d85/l87 0 2024-03-04T09:28:59.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/368: dread da/dd/f2a [0,4194304] 0 2024-03-04T09:28:59.869 INFO:tasks.workunit.client.0.smithi046.stdout:9/397: mknod d1/d11/d6/d8/d1d/d34/d46/d5e/c7a 0 2024-03-04T09:28:59.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/398: write d1/d11/d6/d8/d1d/f77 [957671,125416] 0 2024-03-04T09:28:59.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/340: fdatasync d1/d3/de/d20/f5d 0 2024-03-04T09:28:59.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/341: truncate d1/d3/de/d26/f28 934259 0 2024-03-04T09:28:59.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/342: write d1/d3/de/d20/f5d [379327,32007] 0 2024-03-04T09:28:59.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/343: chown d1/d3/d3e/f3f 52266289 1 2024-03-04T09:28:59.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/344: fsync d1/d44/f5a 0 2024-03-04T09:28:59.970 INFO:tasks.workunit.client.0.smithi046.stdout:9/399: dwrite d1/d11/d6/d8/d13/d21/f69 [0,4194304] 0 2024-03-04T09:28:59.970 INFO:tasks.workunit.client.0.smithi046.stdout:9/400: chown d1/d11/d6/d8/d12/d1c/d26/c66 0 1 2024-03-04T09:28:59.991 INFO:tasks.workunit.client.0.smithi046.stdout:9/401: dread d1/d11/d6/d8/d13/f24 [0,4194304] 0 2024-03-04T09:29:00.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/333: symlink d10/d12/l7d 0 2024-03-04T09:29:00.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/334: chown d10/d12/f3d 52 1 2024-03-04T09:29:00.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/382: symlink d1/d21/d35/d24/l83 0 2024-03-04T09:29:00.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/383: fsync d1/d21/d35/d43/f49 0 2024-03-04T09:29:00.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/384: fdatasync d1/d1d/f3a 0 2024-03-04T09:29:00.259 INFO:tasks.workunit.client.0.smithi046.stdout:2/382: mknod d5/c82 0 2024-03-04T09:29:00.344 INFO:tasks.workunit.client.0.smithi046.stdout:2/383: dwrite d5/f1d [4194304,4194304] 0 2024-03-04T09:29:00.424 INFO:tasks.workunit.client.0.smithi046.stdout:2/384: dwrite d5/f10 [0,4194304] 0 2024-03-04T09:29:00.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/298: mknod d1/d28/c64 0 2024-03-04T09:29:00.920 INFO:tasks.workunit.client.0.smithi046.stdout:1/299: fdatasync d1/fe 0 2024-03-04T09:29:00.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/373: symlink d0/d3/d16/d1e/d73/l88 0 2024-03-04T09:29:00.928 INFO:tasks.workunit.client.0.smithi046.stdout:6/369: mkdir da/dd/d39/d60/d7e 0 2024-03-04T09:29:00.928 INFO:tasks.workunit.client.0.smithi046.stdout:6/370: fdatasync da/dd/d39/f45 0 2024-03-04T09:29:01.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/402: creat d1/d11/d6/d8/d12/d1c/f7b x:0 0 0 2024-03-04T09:29:01.517 INFO:tasks.workunit.client.0.smithi046.stdout:0/335: mkdir d10/d12/d1f/d3f/d7e 0 2024-03-04T09:29:01.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/336: dread d10/d12/d52/d78/f49 [0,4194304] 0 2024-03-04T09:29:01.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/403: dwrite d1/d11/d6/d8/d1d/f77 [0,4194304] 0 2024-03-04T09:29:01.735 INFO:tasks.workunit.client.0.smithi046.stdout:3/385: unlink d1/d21/d35/d2b/f56 0 2024-03-04T09:29:01.930 INFO:tasks.workunit.client.0.smithi046.stdout:2/385: mknod d5/da/c83 0 2024-03-04T09:29:02.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/371: dread f5 [4194304,4194304] 0 2024-03-04T09:29:02.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/374: creat d0/d3/d16/d1e/d73/f89 x:0 0 0 2024-03-04T09:29:03.110 INFO:tasks.workunit.client.0.smithi046.stdout:7/269: write d0/d4/db/d12/f48 [864970,90577] 0 2024-03-04T09:29:03.280 INFO:tasks.workunit.client.0.smithi046.stdout:3/386: dwrite d1/d21/d35/d2b/f4b [0,4194304] 0 2024-03-04T09:29:03.303 INFO:tasks.workunit.client.0.smithi046.stdout:6/372: creat da/dd/f7f x:0 0 0 2024-03-04T09:29:03.303 INFO:tasks.workunit.client.0.smithi046.stdout:6/373: chown da/d14/d17 709474802 1 2024-03-04T09:29:03.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/375: symlink d0/d1f/d25/l8a 0 2024-03-04T09:29:03.695 INFO:tasks.workunit.client.0.smithi046.stdout:7/270: stat d0/d4/db/d12/d28/l35 0 2024-03-04T09:29:03.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/376: creat d0/d3/d16/d17/d6d/d6e/f8b x:0 0 0 2024-03-04T09:29:03.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/387: truncate d1/d1d/f6d 945340 0 2024-03-04T09:29:03.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/388: chown d1/d21/d35/d24/l19 114197 1 2024-03-04T09:29:03.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/389: write d1/d1d/d5e/f6e [269338,79140] 0 2024-03-04T09:29:03.723 INFO:tasks.workunit.client.0.smithi046.stdout:7/271: dread d0/da/f29 [0,4194304] 0 2024-03-04T09:29:03.750 INFO:tasks.workunit.client.0.smithi046.stdout:4/377: dwrite d0/d3/d16/d1e/f1c [0,4194304] 0 2024-03-04T09:29:03.766 INFO:tasks.workunit.client.0.smithi046.stdout:4/378: dread d0/d3/d16/f5a [0,4194304] 0 2024-03-04T09:29:03.917 INFO:tasks.workunit.client.0.smithi046.stdout:6/374: symlink da/dd/d39/d60/l80 0 2024-03-04T09:29:03.918 INFO:tasks.workunit.client.0.smithi046.stdout:6/375: chown da/d14/d1e/d2c/f63 14684 1 2024-03-04T09:29:04.504 INFO:tasks.workunit.client.0.smithi046.stdout:3/390: symlink d1/d1d/d27/d4a/d78/l84 0 2024-03-04T09:29:04.639 INFO:tasks.workunit.client.0.smithi046.stdout:7/272: truncate d0/d4/db/d12/f1d 5724188 0 2024-03-04T09:29:04.639 INFO:tasks.workunit.client.0.smithi046.stdout:7/273: creat d0/d4/db/d38/f57 x:0 0 0 2024-03-04T09:29:05.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/379: truncate d0/d1f/f77 1207428 0 2024-03-04T09:29:05.018 INFO:tasks.workunit.client.0.smithi046.stdout:4/380: write d0/d1f/d25/f69 [484167,75286] 0 2024-03-04T09:29:05.517 INFO:tasks.workunit.client.0.smithi046.stdout:6/376: mkdir da/d14/d1e/d27/d78/d66/d81 0 2024-03-04T09:29:05.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/386: rename d5/d56 to d5/d84 0 2024-03-04T09:29:05.537 INFO:tasks.workunit.client.0.smithi046.stdout:7/274: rmdir d0/da 39 2024-03-04T09:29:05.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/345: dwrite d1/d3/f23 [0,4194304] 0 2024-03-04T09:29:05.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/391: dwrite d1/d1d/f3a [0,4194304] 0 2024-03-04T09:29:05.922 INFO:tasks.workunit.client.0.smithi046.stdout:9/404: symlink d1/d11/l7c 0 2024-03-04T09:29:05.923 INFO:tasks.workunit.client.0.smithi046.stdout:9/405: chown d1/d11/d6/d8/d12/d1c/d26/c28 255473 1 2024-03-04T09:29:06.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/387: getdents d5/da/d28/d3f 0 2024-03-04T09:29:06.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/388: dwrite d5/f4e [0,4194304] 0 2024-03-04T09:29:06.295 INFO:tasks.workunit.client.0.smithi046.stdout:4/381: truncate d0/d3/f4 966469 0 2024-03-04T09:29:06.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/392: link d1/d1d/d31/c34 d1/d21/d35/d43/c85 0 2024-03-04T09:29:06.812 INFO:tasks.workunit.client.0.smithi046.stdout:9/406: link d1/d11/d6/c2b d1/d11/d6/d8/d1d/d34/d4d/c7d 0 2024-03-04T09:29:07.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/389: creat d5/d38/f85 x:0 0 0 2024-03-04T09:29:07.494 INFO:tasks.workunit.client.0.smithi046.stdout:5/346: getdents d1/d5f 0 2024-03-04T09:29:07.494 INFO:tasks.workunit.client.0.smithi046.stdout:5/347: dread - d1/d3/de/f4c zero size 2024-03-04T09:29:07.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/393: creat d1/d21/d35/d43/f86 x:0 0 0 2024-03-04T09:29:07.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/394: write d1/f20 [1862498,1328] 0 2024-03-04T09:29:07.513 INFO:tasks.workunit.client.0.smithi046.stdout:9/407: mkdir d1/d11/d6/d8/d1d/d34/d4d/d7e 0 2024-03-04T09:29:07.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/395: write d1/d1d/d27/d4a/f7b [734172,49264] 0 2024-03-04T09:29:07.514 INFO:tasks.workunit.client.0.smithi046.stdout:3/396: chown d1/d1d/d5e/f6e 62328737 1 2024-03-04T09:29:07.909 INFO:tasks.workunit.client.0.smithi046.stdout:8/296: rename d7/cf to d7/de/c63 0 2024-03-04T09:29:07.909 INFO:tasks.workunit.client.0.smithi046.stdout:8/297: write d7/de/d3e/f49 [493640,45593] 0 2024-03-04T09:29:07.910 INFO:tasks.workunit.client.0.smithi046.stdout:5/348: mkdir d1/d44/d69 0 2024-03-04T09:29:08.176 INFO:tasks.workunit.client.0.smithi046.stdout:1/300: rmdir d1 39 2024-03-04T09:29:08.279 INFO:tasks.workunit.client.0.smithi046.stdout:1/301: dwrite d1/f54 [0,4194304] 0 2024-03-04T09:29:08.522 INFO:tasks.workunit.client.0.smithi046.stdout:2/390: rmdir d5/d84 39 2024-03-04T09:29:08.745 INFO:tasks.workunit.client.0.smithi046.stdout:7/275: rename d0/d4/d40/d4a to d0/d58 0 2024-03-04T09:29:08.939 INFO:tasks.workunit.client.0.smithi046.stdout:8/298: mkdir d7/de/d13/d2c/d64 0 2024-03-04T09:29:08.939 INFO:tasks.workunit.client.0.smithi046.stdout:8/299: fsync d7/de/d12/f59 0 2024-03-04T09:29:08.939 INFO:tasks.workunit.client.0.smithi046.stdout:8/300: chown d7/de/d4c/c5c 18 1 2024-03-04T09:29:09.046 INFO:tasks.workunit.client.0.smithi046.stdout:5/349: mknod d1/d3/d3e/c6a 0 2024-03-04T09:29:09.257 INFO:tasks.workunit.client.0.smithi046.stdout:6/377: write da/dd/d46/f72 [1648940,90215] 0 2024-03-04T09:29:09.259 INFO:tasks.workunit.client.0.smithi046.stdout:6/378: write da/d14/d1e/f26 [891987,122836] 0 2024-03-04T09:29:09.315 INFO:tasks.workunit.client.0.smithi046.stdout:1/302: rmdir d1 39 2024-03-04T09:29:09.320 INFO:tasks.workunit.client.0.smithi046.stdout:6/379: dwrite da/dd/f36 [0,4194304] 0 2024-03-04T09:29:09.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/382: dread d0/d3/f4 [0,4194304] 0 2024-03-04T09:29:10.243 INFO:tasks.workunit.client.0.smithi046.stdout:7/276: mkdir d0/d59 0 2024-03-04T09:29:10.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/380: mkdir da/d14/d1e/d2c/d34/d67/d64/d82 0 2024-03-04T09:29:10.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/381: write da/dd/d22/f70 [54904,65189] 0 2024-03-04T09:29:10.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/277: dwrite d0/d4/db/d12/f30 [4194304,4194304] 0 2024-03-04T09:29:10.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/278: fsync d0/d4/db/f2b 0 2024-03-04T09:29:10.593 INFO:tasks.workunit.client.0.smithi046.stdout:9/408: mkdir d1/d11/d6/d8/d1d/d34/d7f 0 2024-03-04T09:29:10.684 INFO:tasks.workunit.client.0.smithi046.stdout:9/409: dwrite d1/d11/d6/d8/f62 [0,4194304] 0 2024-03-04T09:29:10.812 INFO:tasks.workunit.client.0.smithi046.stdout:0/337: sync 2024-03-04T09:29:10.813 INFO:tasks.workunit.client.0.smithi046.stdout:4/383: getdents d0/d1f/d5b 0 2024-03-04T09:29:10.840 INFO:tasks.workunit.client.0.smithi046.stdout:4/384: dread d0/d1f/d35/f4a [0,4194304] 0 2024-03-04T09:29:10.840 INFO:tasks.workunit.client.0.smithi046.stdout:4/385: dread - d0/f39 zero size 2024-03-04T09:29:10.840 INFO:tasks.workunit.client.0.smithi046.stdout:4/386: read - d0/d1f/f79 zero size 2024-03-04T09:29:11.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/397: dwrite d1/d1d/f6d [0,4194304] 0 2024-03-04T09:29:11.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/398: chown d1/d1d/d27/c33 34306092 1 2024-03-04T09:29:11.157 INFO:tasks.workunit.client.0.smithi046.stdout:1/303: symlink d1/l65 0 2024-03-04T09:29:11.157 INFO:tasks.workunit.client.0.smithi046.stdout:5/350: rename d1/d3/d1f/c39 to d1/c6b 0 2024-03-04T09:29:11.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/382: mkdir da/d14/d1e/d2c/d34/d67/d64/d82/d83 0 2024-03-04T09:29:11.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/279: symlink d0/da/d4e/l5a 0 2024-03-04T09:29:12.064 INFO:tasks.workunit.client.0.smithi046.stdout:9/410: creat d1/d11/d6/d8/d1d/d34/d46/f80 x:0 0 0 2024-03-04T09:29:12.065 INFO:tasks.workunit.client.0.smithi046.stdout:9/411: dread - d1/f5b zero size 2024-03-04T09:29:12.065 INFO:tasks.workunit.client.0.smithi046.stdout:9/412: write d1/d11/d6/d8/d1d/d34/d46/d4c/f71 [466004,68272] 0 2024-03-04T09:29:12.093 INFO:tasks.workunit.client.0.smithi046.stdout:9/413: dread d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:29:12.094 INFO:tasks.workunit.client.0.smithi046.stdout:9/414: readlink d1/d11/d6/d8/d1d/l42 0 2024-03-04T09:29:12.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/338: rmdir d10/d12/d52/d6c 0 2024-03-04T09:29:12.375 INFO:tasks.workunit.client.0.smithi046.stdout:4/387: truncate d0/d1f/d25/d50/f51 3205847 0 2024-03-04T09:29:12.375 INFO:tasks.workunit.client.0.smithi046.stdout:4/388: dread - d0/d1f/d35/f6b zero size 2024-03-04T09:29:12.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/399: creat d1/d74/d82/f87 x:0 0 0 2024-03-04T09:29:13.061 INFO:tasks.workunit.client.0.smithi046.stdout:3/400: dwrite d1/d1d/d27/d4a/f7b [0,4194304] 0 2024-03-04T09:29:13.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/351: mkdir d1/d3/de/d41/d6c 0 2024-03-04T09:29:13.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/352: write d1/d44/f5a [1255385,105175] 0 2024-03-04T09:29:13.543 INFO:tasks.workunit.client.0.smithi046.stdout:9/415: stat d1/d11/d6/d8/d1d/d34/d35/c74 0 2024-03-04T09:29:13.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/339: link fd d10/d12/d1f/d3f/d4b/f7f 0 2024-03-04T09:29:13.987 INFO:tasks.workunit.client.0.smithi046.stdout:2/391: symlink d5/l86 0 2024-03-04T09:29:14.037 INFO:tasks.workunit.client.0.smithi046.stdout:2/392: dwrite d5/f10 [0,4194304] 0 2024-03-04T09:29:14.037 INFO:tasks.workunit.client.0.smithi046.stdout:2/393: readlink d5/da/d1b/l2a 0 2024-03-04T09:29:14.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/394: dread d5/d84/f62 [4194304,4194304] 0 2024-03-04T09:29:14.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/395: stat d5/d84/f70 0 2024-03-04T09:29:14.128 INFO:tasks.workunit.client.0.smithi046.stdout:4/389: mkdir d0/d5f/d6f/d8c 0 2024-03-04T09:29:14.470 INFO:tasks.workunit.client.0.smithi046.stdout:1/304: rename d1/l1a to d1/d28/l66 0 2024-03-04T09:29:14.470 INFO:tasks.workunit.client.0.smithi046.stdout:1/305: chown d1/l59 104 1 2024-03-04T09:29:14.753 INFO:tasks.workunit.client.0.smithi046.stdout:5/353: dwrite d1/d3/f23 [8388608,4194304] 0 2024-03-04T09:29:14.817 INFO:tasks.workunit.client.0.smithi046.stdout:8/301: write d7/de/f18 [718559,77046] 0 2024-03-04T09:29:14.867 INFO:tasks.workunit.client.0.smithi046.stdout:2/396: mknod d5/da/d1b/c87 0 2024-03-04T09:29:15.272 INFO:tasks.workunit.client.0.smithi046.stdout:5/354: symlink d1/d3/de/d4f/l6d 0 2024-03-04T09:29:15.272 INFO:tasks.workunit.client.0.smithi046.stdout:8/302: creat d7/d53/f65 x:0 0 0 2024-03-04T09:29:15.484 INFO:tasks.workunit.client.0.smithi046.stdout:5/355: symlink d1/d3/d1f/l6e 0 2024-03-04T09:29:15.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/303: link d7/lb d7/de/d13/d3c/l66 0 2024-03-04T09:29:16.534 INFO:tasks.workunit.client.0.smithi046.stdout:7/280: write d0/d4/f1f [5657492,93659] 0 2024-03-04T09:29:16.534 INFO:tasks.workunit.client.0.smithi046.stdout:7/281: chown d0/c24 461375 1 2024-03-04T09:29:16.745 INFO:tasks.workunit.client.0.smithi046.stdout:7/282: creat d0/d59/f5b x:0 0 0 2024-03-04T09:29:16.746 INFO:tasks.workunit.client.0.smithi046.stdout:7/283: creat d0/d4/db/d12/d28/f5c x:0 0 0 2024-03-04T09:29:16.805 INFO:tasks.workunit.client.0.smithi046.stdout:6/383: sync 2024-03-04T09:29:16.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/384: dread da/dd/f36 [0,4194304] 0 2024-03-04T09:29:16.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/385: readlink da/d14/l2d 0 2024-03-04T09:29:16.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/386: fsync da/dd/f36 0 2024-03-04T09:29:16.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/387: dread - da/d14/d1e/d27/d78/f5f zero size 2024-03-04T09:29:16.857 INFO:tasks.workunit.client.0.smithi046.stdout:7/284: dwrite d0/d4/db/d12/d28/f4b [4194304,4194304] 0 2024-03-04T09:29:16.857 INFO:tasks.workunit.client.0.smithi046.stdout:7/285: chown d0/d4/db/l1a 222 1 2024-03-04T09:29:16.865 INFO:tasks.workunit.client.0.smithi046.stdout:6/388: write da/dd/f36 [1093403,6797] 0 2024-03-04T09:29:16.866 INFO:tasks.workunit.client.0.smithi046.stdout:6/389: chown da/d14 0 1 2024-03-04T09:29:16.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/390: dread da/d14/d1e/d2c/d34/d67/f6d [0,4194304] 0 2024-03-04T09:29:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/401: mkdir d1/d88 0 2024-03-04T09:29:17.265 INFO:tasks.workunit.client.0.smithi046.stdout:3/402: read d1/d1d/d27/d4a/f55 [3696748,87592] 0 2024-03-04T09:29:17.341 INFO:tasks.workunit.client.0.smithi046.stdout:1/306: dwrite d1/f44 [0,4194304] 0 2024-03-04T09:29:18.107 INFO:tasks.workunit.client.0.smithi046.stdout:7/286: mknod d0/d2d/c5d 0 2024-03-04T09:29:18.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/391: mkdir da/d14/d17/d84 0 2024-03-04T09:29:18.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/392: fdatasync da/d14/d1e/d27/f43 0 2024-03-04T09:29:18.411 INFO:tasks.workunit.client.0.smithi046.stdout:3/403: creat d1/f89 x:0 0 0 2024-03-04T09:29:18.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/404: read d1/d1d/d27/f2e [158165,106701] 0 2024-03-04T09:29:18.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/307: symlink d1/d28/l67 0 2024-03-04T09:29:18.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/308: dwrite d1/d28/f60 [0,4194304] 0 2024-03-04T09:29:18.632 INFO:tasks.workunit.client.0.smithi046.stdout:7/287: creat d0/da/d46/f5e x:0 0 0 2024-03-04T09:29:18.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/309: dread d1/d28/f47 [0,4194304] 0 2024-03-04T09:29:18.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/393: unlink da/d4e/l57 0 2024-03-04T09:29:18.808 INFO:tasks.workunit.client.0.smithi046.stdout:3/405: symlink d1/d21/d26/l8a 0 2024-03-04T09:29:19.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/288: mkdir d0/d3c/d5f 0 2024-03-04T09:29:19.563 INFO:tasks.workunit.client.0.smithi046.stdout:3/406: truncate d1/d1d/d27/d40/f5a 654020 0 2024-03-04T09:29:19.563 INFO:tasks.workunit.client.0.smithi046.stdout:9/416: rename d1/d11/d6/d8/l3d to d1/d11/d6/d8/d1d/d34/d46/d5e/l81 0 2024-03-04T09:29:19.563 INFO:tasks.workunit.client.0.smithi046.stdout:9/417: readlink d1/d11/d6/d8/d1d/d34/d46/d5e/l81 0 2024-03-04T09:29:19.563 INFO:tasks.workunit.client.0.smithi046.stdout:3/407: write d1/f3f [267675,121122] 0 2024-03-04T09:29:19.697 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:40:30.505 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.711 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:40:30.518 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.713 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:40:30.584 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.716 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:40:30.587 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.721 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:40:30.592 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.724 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:40:30.595 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.821 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:40:30.692 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.829 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:40:30.636 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.856 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:40:30.727 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:19.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:29:19.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:29:19.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/394: mknod da/d14/d1e/d27/d4a/c85 0 2024-03-04T09:29:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:6/395: dread da/dd/f61 [0,4194304] 0 2024-03-04T09:29:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:6/396: write da/d14/f19 [9071995,7627] 0 2024-03-04T09:29:20.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/340: rename d10/d12/d1f/l25 to d10/d12/d1f/d3b/d6b/l80 0 2024-03-04T09:29:20.186 INFO:tasks.workunit.client.0.smithi046.stdout:1/310: rename d1/f42 to d1/f68 0 2024-03-04T09:29:20.186 INFO:tasks.workunit.client.0.smithi046.stdout:1/311: fsync d1/d28/f5b 0 2024-03-04T09:29:20.555 INFO:tasks.workunit.client.0.smithi046.stdout:9/418: creat d1/d11/d6/d8/d6f/f82 x:0 0 0 2024-03-04T09:29:20.555 INFO:tasks.workunit.client.0.smithi046.stdout:3/408: creat d1/d21/f8b x:0 0 0 2024-03-04T09:29:20.555 INFO:tasks.workunit.client.0.smithi046.stdout:9/419: write d1/d11/d6/d8/fd [688516,22912] 0 2024-03-04T09:29:20.569 INFO:tasks.workunit.client.0.smithi046.stdout:9/420: dread d1/d11/d6/d8/d12/f52 [4194304,4194304] 0 2024-03-04T09:29:20.569 INFO:tasks.workunit.client.0.smithi046.stdout:9/421: fsync d1/f5b 0 2024-03-04T09:29:20.569 INFO:tasks.workunit.client.0.smithi046.stdout:9/422: read d1/d11/d6/d8/d36/f51 [4057910,87300] 0 2024-03-04T09:29:20.586 INFO:tasks.workunit.client.0.smithi046.stdout:6/397: mkdir da/d14/d1e/d2c/d34/d67/d64/d56/d86 0 2024-03-04T09:29:20.834 INFO:tasks.workunit.client.0.smithi046.stdout:1/312: rename d1/d28/f63 to d1/d28/f69 0 2024-03-04T09:29:21.107 INFO:tasks.workunit.client.0.smithi046.stdout:3/409: mknod d1/d1d/d27/d40/d76/c8c 0 2024-03-04T09:29:21.287 INFO:tasks.workunit.client.0.smithi046.stdout:9/423: creat d1/d11/d6/f83 x:0 0 0 2024-03-04T09:29:21.417 INFO:tasks.workunit.client.0.smithi046.stdout:6/398: unlink da/dd/d39/d60/c68 0 2024-03-04T09:29:21.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/399: dread da/dd/d39/f45 [0,4194304] 0 2024-03-04T09:29:21.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/400: fdatasync f5 0 2024-03-04T09:29:21.505 INFO:tasks.workunit.client.0.smithi046.stdout:6/401: dwrite da/d14/d17/f1b [0,4194304] 0 2024-03-04T09:29:21.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/390: rename d0/d1f/d5b/d60 to d0/d3/d3b/d8d 0 2024-03-04T09:29:21.809 INFO:tasks.workunit.client.0.smithi046.stdout:1/313: mkdir d1/d28/d6a 0 2024-03-04T09:29:22.039 INFO:tasks.workunit.client.0.smithi046.stdout:9/424: symlink d1/d11/d6/d8/d1d/l84 0 2024-03-04T09:29:22.259 INFO:tasks.workunit.client.0.smithi046.stdout:6/402: link da/d14/d1e/d2c/d34/c76 da/d14/d1e/d27/d78/c87 0 2024-03-04T09:29:22.259 INFO:tasks.workunit.client.0.smithi046.stdout:6/403: chown da/d14/d1e/d2c/d34/f69 2000575 1 2024-03-04T09:29:22.259 INFO:tasks.workunit.client.0.smithi046.stdout:6/404: dread - da/d14/d1e/d2c/f63 zero size 2024-03-04T09:29:22.370 INFO:tasks.workunit.client.0.smithi046.stdout:4/391: mkdir d0/d8e 0 2024-03-04T09:29:22.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/314: stat d1/l3f 0 2024-03-04T09:29:22.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/356: sync 2024-03-04T09:29:22.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/357: chown d1/d3/d3e/c45 1313266 1 2024-03-04T09:29:22.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/358: fsync d1/d3/f29 0 2024-03-04T09:29:22.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/425: mkdir d1/d11/d6/d8/d13/d85 0 2024-03-04T09:29:22.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/426: chown d1/d11/d6/d8/d1d/d34 14519571 1 2024-03-04T09:29:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:6/405: link da/d14/d1e/d2c/d34/d67/f6d da/d14/d1e/d2c/d34/f88 0 2024-03-04T09:29:23.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/397: rename d5/da/d28 to d5/d84/d88 0 2024-03-04T09:29:23.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/398: chown d5/d40/d5a 4042 1 2024-03-04T09:29:23.336 INFO:tasks.workunit.client.0.smithi046.stdout:5/359: mknod d1/d3/de/d1d/c6f 0 2024-03-04T09:29:23.393 INFO:tasks.workunit.client.0.smithi046.stdout:9/427: mknod d1/d11/d6/d8/d1d/d34/d46/d4c/c86 0 2024-03-04T09:29:23.426 INFO:tasks.workunit.client.0.smithi046.stdout:7/289: sync 2024-03-04T09:29:23.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/290: dwrite d0/d4/f1f [0,4194304] 0 2024-03-04T09:29:23.512 INFO:tasks.workunit.client.0.smithi046.stdout:6/406: symlink da/d14/l89 0 2024-03-04T09:29:23.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/407: dwrite da/d14/d1e/d2c/d34/f62 [0,4194304] 0 2024-03-04T09:29:23.696 INFO:tasks.workunit.client.0.smithi046.stdout:8/304: rename d7/de/l22 to d7/de/d4c/l67 0 2024-03-04T09:29:23.696 INFO:tasks.workunit.client.0.smithi046.stdout:8/305: fsync d7/fd 0 2024-03-04T09:29:23.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/360: truncate d1/d3/d1f/f31 3656008 0 2024-03-04T09:29:24.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/291: stat d0/d4/db/l27 0 2024-03-04T09:29:24.936 INFO:tasks.workunit.client.0.smithi046.stdout:6/408: truncate da/d14/d1e/d2c/f5b 283476 0 2024-03-04T09:29:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:8/306: rmdir d7/de/d28/d3a 39 2024-03-04T09:29:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:0/341: rename d10/d12/d1f/d3f/f44 to d10/d12/f81 0 2024-03-04T09:29:25.164 INFO:tasks.workunit.client.0.smithi046.stdout:5/361: mkdir d1/d44/d57/d70 0 2024-03-04T09:29:25.179 INFO:tasks.workunit.client.0.smithi046.stdout:7/292: mknod d0/d3c/d5f/c60 0 2024-03-04T09:29:25.193 INFO:tasks.workunit.client.0.smithi046.stdout:7/293: dread d0/f16 [0,4194304] 0 2024-03-04T09:29:25.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/294: dwrite d0/da/d46/f5e [0,4194304] 0 2024-03-04T09:29:25.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/295: write d0/d4/db/f2b [1091408,18449] 0 2024-03-04T09:29:25.628 INFO:tasks.workunit.client.0.smithi046.stdout:6/409: symlink da/d4e/l8a 0 2024-03-04T09:29:25.628 INFO:tasks.workunit.client.0.smithi046.stdout:6/410: chown da/d14/d1e/d2c/d34/f69 502208816 1 2024-03-04T09:29:25.628 INFO:tasks.workunit.client.0.smithi046.stdout:6/411: fsync da/dd/f61 0 2024-03-04T09:29:25.657 INFO:tasks.workunit.client.0.smithi046.stdout:6/412: read da/d14/d17/f1b [1442510,86580] 0 2024-03-04T09:29:26.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/410: rename d1/d1d/d5e/d75 to d1/d1d/d27/d40/d76/d8d 0 2024-03-04T09:29:26.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/411: dread - d1/d21/d35/d43/f49 zero size 2024-03-04T09:29:26.013 INFO:tasks.workunit.client.0.smithi046.stdout:0/342: link d10/d12/d52/d5d/f69 d10/d12/f82 0 2024-03-04T09:29:26.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/412: write d1/d21/d35/d24/f1b [1613463,111907] 0 2024-03-04T09:29:26.074 INFO:tasks.workunit.client.0.smithi046.stdout:0/343: dwrite fc [4194304,4194304] 0 2024-03-04T09:29:26.155 INFO:tasks.workunit.client.0.smithi046.stdout:0/344: dwrite d10/f22 [0,4194304] 0 2024-03-04T09:29:26.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/345: dwrite d10/d36/f40 [0,4194304] 0 2024-03-04T09:29:26.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/346: dread - d10/d12/d1f/d3b/d6b/f72 zero size 2024-03-04T09:29:26.448 INFO:tasks.workunit.client.0.smithi046.stdout:7/296: mknod d0/d4/db/d38/c61 0 2024-03-04T09:29:26.448 INFO:tasks.workunit.client.0.smithi046.stdout:7/297: truncate d0/d4/db/d3b/f53 247785 0 2024-03-04T09:29:26.448 INFO:tasks.workunit.client.0.smithi046.stdout:7/298: read d0/da/f2a [4320798,14628] 0 2024-03-04T09:29:26.928 INFO:tasks.workunit.client.0.smithi046.stdout:6/413: rmdir da/d14/d1e/d2c/d34/d67/d64 39 2024-03-04T09:29:26.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/392: rename d0/d3/d16/l53 to d0/d3/d16/d17/d6d/l8f 0 2024-03-04T09:29:27.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/399: getdents d5/d84 0 2024-03-04T09:29:27.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/413: symlink d1/d1d/d27/d40/d70/l8e 0 2024-03-04T09:29:27.410 INFO:tasks.workunit.client.0.smithi046.stdout:1/315: dwrite d1/f23 [0,4194304] 0 2024-03-04T09:29:27.410 INFO:tasks.workunit.client.0.smithi046.stdout:1/316: chown d1/f2b 96776499 1 2024-03-04T09:29:27.422 INFO:tasks.workunit.client.0.smithi046.stdout:0/347: mkdir d10/d12/d52/d5d/d83 0 2024-03-04T09:29:27.445 INFO:tasks.workunit.client.0.smithi046.stdout:0/348: read d10/d36/f40 [4078656,14928] 0 2024-03-04T09:29:27.486 INFO:tasks.workunit.client.0.smithi046.stdout:7/299: read d0/da/f39 [4522814,39604] 0 2024-03-04T09:29:27.770 INFO:tasks.workunit.client.0.smithi046.stdout:9/428: sync 2024-03-04T09:29:27.770 INFO:tasks.workunit.client.0.smithi046.stdout:9/429: fdatasync d1/d11/d6/d8/d1d/d34/d35/f5d 0 2024-03-04T09:29:27.770 INFO:tasks.workunit.client.0.smithi046.stdout:9/430: stat d1/d11/d6/d8/d13 0 2024-03-04T09:29:28.282 INFO:tasks.workunit.client.0.smithi046.stdout:6/414: creat da/d14/d1e/d2c/d34/d67/f8b x:0 0 0 2024-03-04T09:29:28.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/393: rmdir d0/d3/d16/d17/d6d/d6e/d85 39 2024-03-04T09:29:28.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/415: write da/d14/d1e/d27/d4a/f6f [537859,112180] 0 2024-03-04T09:29:28.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/416: readlink da/l6e 0 2024-03-04T09:29:28.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/417: dwrite da/d14/d1e/d27/f55 [0,4194304] 0 2024-03-04T09:29:28.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/400: mknod d5/d2c/d51/d61/c89 0 2024-03-04T09:29:28.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/401: write d5/d2c/d51/f57 [70577,34636] 0 2024-03-04T09:29:28.487 INFO:tasks.workunit.client.0.smithi046.stdout:2/402: dwrite d5/da/f20 [0,4194304] 0 2024-03-04T09:29:28.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/403: read d5/da/f2b [39010,42523] 0 2024-03-04T09:29:29.630 INFO:tasks.workunit.client.0.smithi046.stdout:5/362: sync 2024-03-04T09:29:29.630 INFO:tasks.workunit.client.0.smithi046.stdout:8/307: sync 2024-03-04T09:29:29.633 INFO:tasks.workunit.client.0.smithi046.stdout:8/308: write d7/de/d28/f37 [671152,28827] 0 2024-03-04T09:29:29.678 INFO:tasks.workunit.client.0.smithi046.stdout:5/363: dread d1/d3/de/d26/f4d [0,4194304] 0 2024-03-04T09:29:29.714 INFO:tasks.workunit.client.0.smithi046.stdout:8/309: dwrite d7/de/f1f [0,4194304] 0 2024-03-04T09:29:29.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/349: mkdir d10/d12/d6e/d84 0 2024-03-04T09:29:29.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/300: symlink d0/da/l62 0 2024-03-04T09:29:29.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/301: truncate d0/d4/db/d12/d28/f5c 610710 0 2024-03-04T09:29:29.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/302: dread d0/d4/f5 [0,4194304] 0 2024-03-04T09:29:29.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/303: write d0/d4/d40/f49 [493835,103506] 0 2024-03-04T09:29:30.341 INFO:tasks.workunit.client.0.smithi046.stdout:4/394: symlink d0/d3/d3b/d8d/l90 0 2024-03-04T09:29:30.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/418: mkdir da/d14/d1e/d27/d8c 0 2024-03-04T09:29:30.460 INFO:tasks.workunit.client.0.smithi046.stdout:6/419: dread da/dd/d22/f70 [0,4194304] 0 2024-03-04T09:29:30.597 INFO:tasks.workunit.client.0.smithi046.stdout:2/404: mkdir d5/d38/d54/d8a 0 2024-03-04T09:29:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:2/405: dread d5/f4e [0,4194304] 0 2024-03-04T09:29:30.701 INFO:tasks.workunit.client.0.smithi046.stdout:2/406: dwrite d5/d38/f76 [0,4194304] 0 2024-03-04T09:29:30.839 INFO:tasks.workunit.client.0.smithi046.stdout:5/364: truncate d1/d3/de/d26/f3d 2099928 0 2024-03-04T09:29:30.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/317: symlink d1/l6b 0 2024-03-04T09:29:30.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/318: fsync d1/f2b 0 2024-03-04T09:29:31.286 INFO:tasks.workunit.client.0.smithi046.stdout:8/310: link d7/de/d13/d2c/c32 d7/de/d13/d2c/c68 0 2024-03-04T09:29:31.287 INFO:tasks.workunit.client.0.smithi046.stdout:8/311: chown d7/de/f4a 15349 1 2024-03-04T09:29:31.287 INFO:tasks.workunit.client.0.smithi046.stdout:0/350: rmdir d10/d12/d6e/d84 0 2024-03-04T09:29:31.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/414: sync 2024-03-04T09:29:31.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/415: fsync d1/d21/d35/f13 0 2024-03-04T09:29:31.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/304: mknod d0/da/d4e/c63 0 2024-03-04T09:29:31.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/305: dwrite d0/d4/db/d12/f30 [0,4194304] 0 2024-03-04T09:29:31.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/306: stat d0/d4/db/l1a 0 2024-03-04T09:29:31.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/307: fdatasync d0/d4/db/d38/f57 0 2024-03-04T09:29:31.443 INFO:tasks.workunit.client.0.smithi046.stdout:9/431: getdents d1/d11/d6/d8/d13/d21 0 2024-03-04T09:29:31.443 INFO:tasks.workunit.client.0.smithi046.stdout:9/432: truncate d1/d11/d6/d8/d13/f63 1010107 0 2024-03-04T09:29:31.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/433: dwrite d1/d11/d6/d8/d1d/d34/d46/f80 [0,4194304] 0 2024-03-04T09:29:31.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/434: dread - d1/d11/d6/d8/d12/d1c/f48 zero size 2024-03-04T09:29:31.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/435: getdents d1/d11/d6/d8/d13/d21 0 2024-03-04T09:29:31.606 INFO:tasks.workunit.client.0.smithi046.stdout:4/395: dwrite d0/f11 [0,4194304] 0 2024-03-04T09:29:32.379 INFO:tasks.workunit.client.0.smithi046.stdout:0/351: creat d10/d36/f85 x:0 0 0 2024-03-04T09:29:33.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/365: dread d1/d3/d1f/f31 [0,4194304] 0 2024-03-04T09:29:33.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/308: mkdir d0/d4/db/d38/d64 0 2024-03-04T09:29:33.341 INFO:tasks.workunit.client.0.smithi046.stdout:7/309: dwrite d0/d4/db/f2b [0,4194304] 0 2024-03-04T09:29:33.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/407: getdents d5/d38/d54 0 2024-03-04T09:29:33.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/408: dread d5/d2c/d51/f57 [0,4194304] 0 2024-03-04T09:29:33.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/409: chown d5/da/l15 0 1 2024-03-04T09:29:33.994 INFO:tasks.workunit.client.0.smithi046.stdout:2/410: dwrite d5/fd [0,4194304] 0 2024-03-04T09:29:34.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/411: dwrite d5/da/d1b/f4c [0,4194304] 0 2024-03-04T09:29:34.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/412: chown d5/f6b 23 1 2024-03-04T09:29:34.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/319: getdents d1 0 2024-03-04T09:29:34.394 INFO:tasks.workunit.client.0.smithi046.stdout:5/366: creat d1/d44/f71 x:0 0 0 2024-03-04T09:29:34.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/310: link d0/da/d4e/l5a d0/d2d/l65 0 2024-03-04T09:29:34.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/311: fdatasync d0/f31 0 2024-03-04T09:29:34.790 INFO:tasks.workunit.client.0.smithi046.stdout:4/396: getdents d0/d3/d16/d1e/d73 0 2024-03-04T09:29:35.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/413: getdents d5/d40 0 2024-03-04T09:29:35.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/414: truncate d5/da/d1b/f25 4487310 0 2024-03-04T09:29:35.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/415: dread d5/d84/f62 [0,4194304] 0 2024-03-04T09:29:35.259 INFO:tasks.workunit.client.0.smithi046.stdout:2/416: readlink d5/d84/l5d 0 2024-03-04T09:29:35.287 INFO:tasks.workunit.client.0.smithi046.stdout:2/417: dread d5/f1f [0,4194304] 0 2024-03-04T09:29:35.578 INFO:tasks.workunit.client.0.smithi046.stdout:6/420: rename da/dd/f10 to da/d14/d1e/d2c/d34/d67/d64/d82/d83/f8d 0 2024-03-04T09:29:35.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/312: symlink d0/d59/l66 0 2024-03-04T09:29:35.615 INFO:tasks.workunit.client.0.smithi046.stdout:6/421: write da/d14/d1e/d2c/d34/f62 [3671738,43354] 0 2024-03-04T09:29:35.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/418: creat d5/d2c/f8b x:0 0 0 2024-03-04T09:29:35.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/419: dwrite d5/f10 [0,4194304] 0 2024-03-04T09:29:35.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/320: mknod d1/c6c 0 2024-03-04T09:29:36.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/436: rename d1/d11/c67 to d1/d11/d6/d8/d36/c87 0 2024-03-04T09:29:36.710 INFO:tasks.workunit.client.0.smithi046.stdout:6/422: symlink da/d14/d1e/d27/l8e 0 2024-03-04T09:29:36.710 INFO:tasks.workunit.client.0.smithi046.stdout:6/423: chown da/d14/d1e/d2c/f63 250115442 1 2024-03-04T09:29:36.710 INFO:tasks.workunit.client.0.smithi046.stdout:6/424: readlink da/d14/d17/l4c 0 2024-03-04T09:29:37.113 INFO:tasks.workunit.client.0.smithi046.stdout:7/313: rename d0/da/d4e/c63 to d0/d4/db/c67 0 2024-03-04T09:29:37.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/321: rename d1/d28 to d1/d28/d6d 22 2024-03-04T09:29:37.113 INFO:tasks.workunit.client.0.smithi046.stdout:7/314: truncate d0/f16 1423317 0 2024-03-04T09:29:37.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/322: chown d1/f44 0 1 2024-03-04T09:29:37.149 INFO:tasks.workunit.client.0.smithi046.stdout:7/315: write d0/d4/db/d12/f1d [4049521,38172] 0 2024-03-04T09:29:37.358 INFO:tasks.workunit.client.0.smithi046.stdout:6/425: mkdir da/d14/d1e/d8f 0 2024-03-04T09:29:37.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/420: link d5/da/f14 d5/d84/d88/d3f/f8c 0 2024-03-04T09:29:37.729 INFO:tasks.workunit.client.0.smithi046.stdout:1/323: creat d1/d28/f6e x:0 0 0 2024-03-04T09:29:37.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/421: creat d5/d38/f8d x:0 0 0 2024-03-04T09:29:37.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/324: write d1/d28/f39 [4271784,107046] 0 2024-03-04T09:29:37.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/325: chown d1/d28/d6a 2010030 1 2024-03-04T09:29:37.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/326: chown d1/l1c 73 1 2024-03-04T09:29:37.814 INFO:tasks.workunit.client.0.smithi046.stdout:7/316: symlink d0/d59/l68 0 2024-03-04T09:29:38.040 INFO:tasks.workunit.client.0.smithi046.stdout:2/422: getdents d5 0 2024-03-04T09:29:38.347 INFO:tasks.workunit.client.0.smithi046.stdout:0/352: dwrite d10/d12/d52/d5d/f6f [0,4194304] 0 2024-03-04T09:29:38.897 INFO:tasks.workunit.client.0.smithi046.stdout:7/317: creat d0/d3c/f69 x:0 0 0 2024-03-04T09:29:38.993 INFO:tasks.workunit.client.0.smithi046.stdout:7/318: dwrite d0/d4/db/d12/f2c [0,4194304] 0 2024-03-04T09:29:39.429 INFO:tasks.workunit.client.0.smithi046.stdout:5/367: write d1/d3/de/d1d/f33 [2203614,42092] 0 2024-03-04T09:29:39.431 INFO:tasks.workunit.client.0.smithi046.stdout:3/416: sync 2024-03-04T09:29:39.507 INFO:tasks.workunit.client.0.smithi046.stdout:8/312: symlink d7/de/l69 0 2024-03-04T09:29:39.552 INFO:tasks.workunit.client.0.smithi046.stdout:3/417: dwrite d1/d1d/f6b [0,4194304] 0 2024-03-04T09:29:39.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/397: dwrite d0/d1f/f77 [0,4194304] 0 2024-03-04T09:29:39.974 INFO:tasks.workunit.client.0.smithi046.stdout:7/319: mknod d0/da/d41/c6a 0 2024-03-04T09:29:39.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/368: dread - d1/f36 zero size 2024-03-04T09:29:40.159 INFO:tasks.workunit.client.0.smithi046.stdout:8/313: mknod d7/de/d4c/c6a 0 2024-03-04T09:29:40.290 INFO:tasks.workunit.client.0.smithi046.stdout:6/426: unlink da/d14/d1e/d2c/d34/f69 0 2024-03-04T09:29:40.317 INFO:tasks.workunit.client.0.smithi046.stdout:6/427: dread da/d14/d1e/d27/f55 [0,4194304] 0 2024-03-04T09:29:40.513 INFO:tasks.workunit.client.0.smithi046.stdout:9/437: write d1/d11/d6/d8/d12/d1c/f38 [324264,62182] 0 2024-03-04T09:29:40.929 INFO:tasks.workunit.client.0.smithi046.stdout:4/398: creat d0/d8e/f91 x:0 0 0 2024-03-04T09:29:40.948 INFO:tasks.workunit.client.0.smithi046.stdout:4/399: dread d0/d1f/f2c [0,4194304] 0 2024-03-04T09:29:40.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/400: write d0/d3/d20/f38 [1834621,122264] 0 2024-03-04T09:29:41.230 INFO:tasks.workunit.client.0.smithi046.stdout:7/320: mkdir d0/d4/db/d3b/d6b 0 2024-03-04T09:29:41.230 INFO:tasks.workunit.client.0.smithi046.stdout:5/369: mkdir d1/d3/de/d1d/d72 0 2024-03-04T09:29:41.259 INFO:tasks.workunit.client.0.smithi046.stdout:5/370: write d1/d3/de/d26/f4d [694364,16823] 0 2024-03-04T09:29:41.350 INFO:tasks.workunit.client.0.smithi046.stdout:8/314: stat d7/de/l30 0 2024-03-04T09:29:41.551 INFO:tasks.workunit.client.0.smithi046.stdout:6/428: symlink da/dd/d39/d60/l90 0 2024-03-04T09:29:41.560 INFO:tasks.workunit.client.0.smithi046.stdout:6/429: write da/d14/f19 [8461274,108737] 0 2024-03-04T09:29:41.597 INFO:tasks.workunit.client.0.smithi046.stdout:6/430: dread da/d14/d1e/f30 [0,4194304] 0 2024-03-04T09:29:41.597 INFO:tasks.workunit.client.0.smithi046.stdout:6/431: rename da/d14/d1e to da/d14/d1e/d2c/d34/d67/d64/d82/d83/d91 22 2024-03-04T09:29:41.766 INFO:tasks.workunit.client.0.smithi046.stdout:9/438: dread d1/d11/d6/d8/d13/f63 [0,4194304] 0 2024-03-04T09:29:41.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/439: dwrite d1/d11/d6/d8/d1d/d34/d4d/f55 [0,4194304] 0 2024-03-04T09:29:41.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/440: chown d1/f5b 59499631 1 2024-03-04T09:29:41.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/441: fsync d1/d11/d6/d8/f33 0 2024-03-04T09:29:42.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/401: creat d0/d1f/d25/d7b/f92 x:0 0 0 2024-03-04T09:29:42.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/321: creat d0/d3c/d5f/f6c x:0 0 0 2024-03-04T09:29:42.061 INFO:tasks.workunit.client.0.smithi046.stdout:5/371: write d1/f7 [1866353,95080] 0 2024-03-04T09:29:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/315: creat d7/de/f6b x:0 0 0 2024-03-04T09:29:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/316: write d7/f1a [3505704,70592] 0 2024-03-04T09:29:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/317: chown d7/de/d3e/c60 81086 1 2024-03-04T09:29:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/318: chown d7/f23 35335 1 2024-03-04T09:29:42.204 INFO:tasks.workunit.client.0.smithi046.stdout:8/319: dwrite d7/de/d13/d2c/f31 [0,4194304] 0 2024-03-04T09:29:42.494 INFO:tasks.workunit.client.0.smithi046.stdout:9/442: link d1/d11/d6/c9 d1/d11/d6/d8/d1d/d34/d46/c88 0 2024-03-04T09:29:42.495 INFO:tasks.workunit.client.0.smithi046.stdout:9/443: fsync d1/d11/d6/d8/d1d/d34/d35/f76 0 2024-03-04T09:29:42.542 INFO:tasks.workunit.client.0.smithi046.stdout:4/402: rename d0/d3/d16/d17/d6d/f7c to d0/d8e/f93 0 2024-03-04T09:29:42.581 INFO:tasks.workunit.client.0.smithi046.stdout:4/403: read d0/d3/d16/d1e/f3e [3314313,22690] 0 2024-03-04T09:29:42.617 INFO:tasks.workunit.client.0.smithi046.stdout:4/404: dread d0/d3/d3b/d8d/f68 [0,4194304] 0 2024-03-04T09:29:42.759 INFO:tasks.workunit.client.0.smithi046.stdout:7/322: link d0/d4/db/d38/f57 d0/d4/db/d38/d64/f6d 0 2024-03-04T09:29:42.837 INFO:tasks.workunit.client.0.smithi046.stdout:5/372: symlink d1/d44/d69/l73 0 2024-03-04T09:29:42.900 INFO:tasks.workunit.client.0.smithi046.stdout:8/320: truncate d7/f23 1157025 0 2024-03-04T09:29:43.116 INFO:tasks.workunit.client.0.smithi046.stdout:4/405: mknod d0/d3/d20/c94 0 2024-03-04T09:29:43.116 INFO:tasks.workunit.client.0.smithi046.stdout:9/444: creat d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 x:0 0 0 2024-03-04T09:29:43.116 INFO:tasks.workunit.client.0.smithi046.stdout:4/406: truncate d0/d1f/f79 937380 0 2024-03-04T09:29:43.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/445: creat d1/d11/d6/d8/d1d/d34/d46/f8a x:0 0 0 2024-03-04T09:29:43.118 INFO:tasks.workunit.client.0.smithi046.stdout:5/373: creat d1/d3/de/d20/d5e/f74 x:0 0 0 2024-03-04T09:29:43.284 INFO:tasks.workunit.client.0.smithi046.stdout:0/353: mknod d10/c86 0 2024-03-04T09:29:43.341 INFO:tasks.workunit.client.0.smithi046.stdout:8/321: symlink d7/de/d4c/l6c 0 2024-03-04T09:29:43.341 INFO:tasks.workunit.client.0.smithi046.stdout:8/322: chown d7/de/d28/f58 50342 1 2024-03-04T09:29:43.377 INFO:tasks.workunit.client.0.smithi046.stdout:8/323: dread d7/de/d13/f17 [0,4194304] 0 2024-03-04T09:29:43.705 INFO:tasks.workunit.client.0.smithi046.stdout:4/407: mknod d0/d3/d16/d1e/d73/c95 0 2024-03-04T09:29:43.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/446: rename d1/d11/d6/d8/d1d/d34/d35/l3a to d1/d11/d6/d8/d13/l8b 0 2024-03-04T09:29:43.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/447: chown d1/d11/d6/d8/d1d/d34/d46/f5f 118 1 2024-03-04T09:29:43.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/448: readlink d1/d11/d6/d8/d1d/d34/d46/l79 0 2024-03-04T09:29:44.031 INFO:tasks.workunit.client.0.smithi046.stdout:7/323: truncate d0/d4/db/d12/f2c 815412 0 2024-03-04T09:29:44.032 INFO:tasks.workunit.client.0.smithi046.stdout:5/374: unlink d1/d3/d1f/l6e 0 2024-03-04T09:29:44.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/324: read d0/d4/db/d38/f3f [2115606,64053] 0 2024-03-04T09:29:44.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/325: dwrite d0/d4/db/d38/f57 [0,4194304] 0 2024-03-04T09:29:44.327 INFO:tasks.workunit.client.0.smithi046.stdout:8/324: symlink d7/de/d28/l6d 0 2024-03-04T09:29:44.699 INFO:tasks.workunit.client.0.smithi046.stdout:1/327: sync 2024-03-04T09:29:44.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/328: dread d1/d28/f60 [0,4194304] 0 2024-03-04T09:29:44.732 INFO:tasks.workunit.client.0.smithi046.stdout:1/329: fdatasync d1/fd 0 2024-03-04T09:29:44.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/449: stat d1/d11/d6/d8/d1d/l58 0 2024-03-04T09:29:44.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/450: truncate d1/d11/d6/d8/d1d/d34/d46/f8a 423255 0 2024-03-04T09:29:45.089 INFO:tasks.workunit.client.0.smithi046.stdout:3/418: dwrite d1/d1d/d27/f2e [0,4194304] 0 2024-03-04T09:29:45.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/419: dwrite d1/d74/d82/f87 [0,4194304] 0 2024-03-04T09:29:45.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/354: mkdir d10/d36/d87 0 2024-03-04T09:29:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:8/325: creat d7/de/d4c/d50/f6e x:0 0 0 2024-03-04T09:29:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:8/326: chown d7/de/d13/f35 47 1 2024-03-04T09:29:46.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/451: mkdir d1/d11/d6/d8/d6f/d8c 0 2024-03-04T09:29:46.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/452: creat d1/d11/d6/d8/d1d/d34/d46/d5e/f8d x:0 0 0 2024-03-04T09:29:46.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/453: fdatasync d1/d11/d6/d8/d13/f63 0 2024-03-04T09:29:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:3/420: symlink d1/d1d/d27/d40/d70/l8f 0 2024-03-04T09:29:47.132 INFO:tasks.workunit.client.0.smithi046.stdout:7/326: mkdir d0/d4/d6e 0 2024-03-04T09:29:47.132 INFO:tasks.workunit.client.0.smithi046.stdout:8/327: mkdir d7/de/d28/d3a/d6f 0 2024-03-04T09:29:47.143 INFO:tasks.workunit.client.0.smithi046.stdout:7/327: dread d0/f31 [0,4194304] 0 2024-03-04T09:29:47.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/328: dread d0/d4/db/d12/d28/f4b [0,4194304] 0 2024-03-04T09:29:47.472 INFO:tasks.workunit.client.0.smithi046.stdout:9/454: mknod d1/d11/d6/d8/d1d/c8e 0 2024-03-04T09:29:48.247 INFO:tasks.workunit.client.0.smithi046.stdout:3/421: unlink d1/d1d/d27/c54 0 2024-03-04T09:29:48.247 INFO:tasks.workunit.client.0.smithi046.stdout:3/422: fsync d1/d1d/f7a 0 2024-03-04T09:29:48.248 INFO:tasks.workunit.client.0.smithi046.stdout:3/423: read d1/f3f [321177,64832] 0 2024-03-04T09:29:48.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/328: symlink d7/de/d4c/d5a/l70 0 2024-03-04T09:29:48.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/455: link d1/d11/d6/d8/d36/l54 d1/d11/d3e/l8f 0 2024-03-04T09:29:48.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/424: unlink d1/d21/d35/c3c 0 2024-03-04T09:29:48.892 INFO:tasks.workunit.client.0.smithi046.stdout:4/408: rename d0/d3/d16/d17/d6d to d0/d3/d20/d96 0 2024-03-04T09:29:48.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/329: mkdir d7/de/d28/d71 0 2024-03-04T09:29:48.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/330: chown d7/de/d3e/f57 524189851 1 2024-03-04T09:29:48.960 INFO:tasks.workunit.client.0.smithi046.stdout:4/409: dwrite d0/d1f/f77 [0,4194304] 0 2024-03-04T09:29:49.140 INFO:tasks.workunit.client.0.smithi046.stdout:0/355: rename d10/d12/d1f/d3b/f43 to d10/d12/d52/d5d/f88 0 2024-03-04T09:29:49.237 INFO:tasks.workunit.client.0.smithi046.stdout:3/425: creat d1/d21/d35/f90 x:0 0 0 2024-03-04T09:29:49.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/432: rmdir da/d14/d17 39 2024-03-04T09:29:49.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/433: creat da/dd/d22/f92 x:0 0 0 2024-03-04T09:29:49.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/434: readlink da/dd/lf 0 2024-03-04T09:29:49.646 INFO:tasks.workunit.client.0.smithi046.stdout:3/426: fsync d1/d21/d35/d2b/f6a 0 2024-03-04T09:29:49.967 INFO:tasks.workunit.client.0.smithi046.stdout:3/427: creat d1/d1d/d27/d40/d70/d7d/f91 x:0 0 0 2024-03-04T09:29:49.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/428: dread d1/d1d/f4c [0,4194304] 0 2024-03-04T09:29:50.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:29:50.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:29:50.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/456: rename d1/d11/d6/d8/f43 to d1/d11/d6/d8/d1d/d34/d35/f90 0 2024-03-04T09:29:50.540 INFO:tasks.workunit.client.0.smithi046.stdout:1/330: dwrite d1/f1d [4194304,4194304] 0 2024-03-04T09:29:50.868 INFO:tasks.workunit.client.0.smithi046.stdout:9/457: mkdir d1/d11/d6/d8/d12/d1c/d26/d91 0 2024-03-04T09:29:50.889 INFO:tasks.workunit.client.0.smithi046.stdout:9/458: dread d1/d11/d6/d8/d12/f30 [0,4194304] 0 2024-03-04T09:29:51.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/423: rmdir d5/d38 39 2024-03-04T09:29:51.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/331: mkdir d1/d28/d6f 0 2024-03-04T09:29:51.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/332: stat d1/fe 0 2024-03-04T09:29:51.208 INFO:tasks.workunit.client.0.smithi046.stdout:1/333: dread d1/f7 [0,4194304] 0 2024-03-04T09:29:51.951 INFO:tasks.workunit.client.0.smithi046.stdout:2/424: dread d5/d84/d88/f43 [0,4194304] 0 2024-03-04T09:29:52.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/334: unlink d1/d28/f5c 0 2024-03-04T09:29:52.056 INFO:tasks.workunit.client.0.smithi046.stdout:0/356: rename d10/d12/d52/d5d/f88 to d10/d12/d1f/d3b/d6b/f89 0 2024-03-04T09:29:52.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/329: sync 2024-03-04T09:29:52.060 INFO:tasks.workunit.client.0.smithi046.stdout:5/375: sync 2024-03-04T09:29:52.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/410: creat d0/f97 x:0 0 0 2024-03-04T09:29:52.455 INFO:tasks.workunit.client.0.smithi046.stdout:4/411: dwrite d0/d3/d16/d1e/d73/f89 [0,4194304] 0 2024-03-04T09:29:52.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/335: rmdir d1 39 2024-03-04T09:29:52.655 INFO:tasks.workunit.client.0.smithi046.stdout:0/357: mkdir d10/d12/d52/d78/d8a 0 2024-03-04T09:29:52.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/336: dwrite d1/d28/f39 [0,4194304] 0 2024-03-04T09:29:52.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/337: dread - d1/d28/f5b zero size 2024-03-04T09:29:52.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/376: fdatasync d1/f1b 0 2024-03-04T09:29:52.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/330: symlink d0/da/d4e/l6f 0 2024-03-04T09:29:52.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/331: readlink d0/d4/db/d12/l3e 0 2024-03-04T09:29:52.885 INFO:tasks.workunit.client.0.smithi046.stdout:7/332: dread d0/d4/db/d12/d28/f4b [4194304,4194304] 0 2024-03-04T09:29:52.885 INFO:tasks.workunit.client.0.smithi046.stdout:7/333: stat d0/da/f2a 0 2024-03-04T09:29:53.391 INFO:tasks.workunit.client.0.smithi046.stdout:2/425: truncate d5/d2c/f2e 2487988 0 2024-03-04T09:29:53.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/358: rmdir d10/d12/d52 39 2024-03-04T09:29:53.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/338: creat d1/d28/d6a/f70 x:0 0 0 2024-03-04T09:29:53.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/339: readlink d1/l65 0 2024-03-04T09:29:53.819 INFO:tasks.workunit.client.0.smithi046.stdout:1/340: dread d1/f2b [0,4194304] 0 2024-03-04T09:29:54.225 INFO:tasks.workunit.client.0.smithi046.stdout:7/334: symlink d0/da/d46/l70 0 2024-03-04T09:29:54.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/412: creat d0/d3/f98 x:0 0 0 2024-03-04T09:29:54.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/413: dread - d0/d1f/d25/d7b/f92 zero size 2024-03-04T09:29:54.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/359: truncate d10/d12/d1f/d3f/d4b/f7f 1105405 0 2024-03-04T09:29:54.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/360: dwrite d10/d12/d52/d78/f49 [0,4194304] 0 2024-03-04T09:29:55.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/414: rmdir d0/d1f/d25/d50 39 2024-03-04T09:29:55.122 INFO:tasks.workunit.client.0.smithi046.stdout:4/415: dread d0/d3/d20/f38 [0,4194304] 0 2024-03-04T09:29:55.379 INFO:tasks.workunit.client.0.smithi046.stdout:0/361: unlink d10/d12/d52/d78/f49 0 2024-03-04T09:29:55.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/416: rmdir d0/d1f/d25 39 2024-03-04T09:29:55.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/417: write d0/d1f/d35/f6b [83842,119419] 0 2024-03-04T09:29:55.705 INFO:tasks.workunit.client.0.smithi046.stdout:0/362: getdents d10/d12/d1f/d3f/d4b 0 2024-03-04T09:29:55.706 INFO:tasks.workunit.client.0.smithi046.stdout:0/363: write d10/d12/d1f/d3f/f65 [2980533,77175] 0 2024-03-04T09:29:55.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/418: read d0/f41 [3531055,4750] 0 2024-03-04T09:29:55.754 INFO:tasks.workunit.client.0.smithi046.stdout:4/419: fsync d0/d3/f4 0 2024-03-04T09:29:56.108 INFO:tasks.workunit.client.0.smithi046.stdout:8/331: unlink d7/de/f1f 0 2024-03-04T09:29:56.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/335: mknod d0/c71 0 2024-03-04T09:29:56.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/336: chown d0/d4/db/d12/l17 3182 1 2024-03-04T09:29:56.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/337: chown d0/da 980019 1 2024-03-04T09:29:56.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/338: dread - d0/d59/f5b zero size 2024-03-04T09:29:56.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/339: fdatasync d0/da/f39 0 2024-03-04T09:29:56.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/377: dwrite d1/d3/de/d26/f3d [0,4194304] 0 2024-03-04T09:29:56.487 INFO:tasks.workunit.client.0.smithi046.stdout:0/364: symlink d10/d12/d1f/d3b/d6b/l8b 0 2024-03-04T09:29:56.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/420: creat d0/d3/d16/d1e/d73/f99 x:0 0 0 2024-03-04T09:29:57.132 INFO:tasks.workunit.client.0.smithi046.stdout:8/332: mkdir d7/d53/d72 0 2024-03-04T09:29:57.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/340: dread d0/d4/db/d12/f48 [0,4194304] 0 2024-03-04T09:29:57.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/341: dread d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:29:57.359 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:41:08.166 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.367 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:41:08.174 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.404 INFO:tasks.workunit.client.0.smithi046.stdout:5/378: symlink d1/d3/l75 0 2024-03-04T09:29:57.404 INFO:tasks.workunit.client.0.smithi046.stdout:5/379: dread - d1/f36 zero size 2024-03-04T09:29:57.413 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:41:08.220 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.440 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:41:08.311 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.441 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:41:08.311 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.447 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:41:08.318 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.468 INFO:tasks.workunit.client.0.smithi046.stdout:6/435: sync 2024-03-04T09:29:57.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/429: sync 2024-03-04T09:29:57.468 INFO:tasks.workunit.client.0.smithi046.stdout:2/426: sync 2024-03-04T09:29:57.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/459: sync 2024-03-04T09:29:57.485 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:41:08.356 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.487 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:41:08.358 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.520 INFO:tasks.workunit.client.0.smithi046.stdout:6/436: dwrite da/d14/d1e/d2c/d34/f88 [0,4194304] 0 2024-03-04T09:29:57.520 INFO:tasks.workunit.client.0.smithi046.stdout:6/437: write da/dd/d39/f45 [2955456,26284] 0 2024-03-04T09:29:57.548 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:41:08.418 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:29:57.567 INFO:tasks.workunit.client.0.smithi046.stdout:6/438: dwrite da/d14/d1e/f30 [0,4194304] 0 2024-03-04T09:29:57.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/365: getdents d10/d12/d1f 0 2024-03-04T09:29:57.615 INFO:tasks.workunit.client.0.smithi046.stdout:6/439: dwrite da/d14/d1e/d27/f43 [0,4194304] 0 2024-03-04T09:29:57.615 INFO:tasks.workunit.client.0.smithi046.stdout:6/440: write da/d14/d1e/d27/d4a/f6f [617241,54539] 0 2024-03-04T09:29:57.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/421: rename d0/f11 to d0/d3/d16/d1e/d73/f9a 0 2024-03-04T09:29:57.822 INFO:tasks.workunit.client.0.smithi046.stdout:8/333: unlink d7/lb 0 2024-03-04T09:29:57.828 INFO:tasks.workunit.client.0.smithi046.stdout:8/334: write d7/de/f52 [154043,97848] 0 2024-03-04T09:29:57.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/342: mknod d0/d4/db/d12/d28/c72 0 2024-03-04T09:29:57.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/343: fdatasync d0/da/f2a 0 2024-03-04T09:29:57.938 INFO:tasks.workunit.client.0.smithi046.stdout:7/344: dread d0/f11 [0,4194304] 0 2024-03-04T09:29:57.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/345: fsync d0/d4/f5 0 2024-03-04T09:29:57.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/346: readlink d0/d4/l44 0 2024-03-04T09:29:58.036 INFO:tasks.workunit.client.0.smithi046.stdout:5/380: dwrite d1/d3/de/f4c [0,4194304] 0 2024-03-04T09:29:58.051 INFO:tasks.workunit.client.0.smithi046.stdout:1/341: symlink d1/l71 0 2024-03-04T09:29:58.052 INFO:tasks.workunit.client.0.smithi046.stdout:1/342: chown d1/f25 19 1 2024-03-04T09:29:58.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/430: mkdir d1/d1d/d27/d40/d92 0 2024-03-04T09:29:58.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/343: dwrite d1/f56 [4194304,4194304] 0 2024-03-04T09:29:58.151 INFO:tasks.workunit.client.0.smithi046.stdout:3/431: dread d1/d21/d35/f6c [0,4194304] 0 2024-03-04T09:29:58.171 INFO:tasks.workunit.client.0.smithi046.stdout:3/432: write d1/d21/d35/d43/f63 [3668915,28569] 0 2024-03-04T09:29:58.250 INFO:tasks.workunit.client.0.smithi046.stdout:9/460: mkdir d1/d11/d6/d8/d13/d92 0 2024-03-04T09:29:58.250 INFO:tasks.workunit.client.0.smithi046.stdout:9/461: stat d1/d11/d3e/c53 0 2024-03-04T09:29:58.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/462: write d1/d11/d6/d8/f33 [58854,60911] 0 2024-03-04T09:29:59.234 INFO:tasks.workunit.client.0.smithi046.stdout:6/441: creat da/d14/d1e/d27/d78/d66/d81/f93 x:0 0 0 2024-03-04T09:29:59.234 INFO:tasks.workunit.client.0.smithi046.stdout:6/442: readlink da/d14/l52 0 2024-03-04T09:29:59.541 INFO:tasks.workunit.client.0.smithi046.stdout:4/422: mknod d0/d1f/d35/c9b 0 2024-03-04T09:29:59.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/335: rename d7/de/d4c/c5c to d7/de/d12/c73 0 2024-03-04T09:29:59.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/347: truncate d0/da/f2a 4009404 0 2024-03-04T09:29:59.629 INFO:tasks.workunit.client.0.smithi046.stdout:7/348: dread d0/d4/db/d38/f57 [0,4194304] 0 2024-03-04T09:29:59.629 INFO:tasks.workunit.client.0.smithi046.stdout:7/349: truncate d0/da/f42 1016638 0 2024-03-04T09:29:59.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/350: fsync d0/d4/db/d12/f1d 0 2024-03-04T09:29:59.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/351: fdatasync d0/da/f42 0 2024-03-04T09:29:59.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/352: chown d0/d4/f1f 102672095 1 2024-03-04T09:29:59.903 INFO:tasks.workunit.client.0.smithi046.stdout:3/433: symlink d1/d1d/d27/d4a/d78/l93 0 2024-03-04T09:29:59.903 INFO:tasks.workunit.client.0.smithi046.stdout:3/434: fdatasync d1/d1d/d27/d40/f5a 0 2024-03-04T09:30:01.102 INFO:tasks.workunit.client.0.smithi046.stdout:4/423: getdents d0/d5f/d6f/d8c 0 2024-03-04T09:30:01.289 INFO:tasks.workunit.client.0.smithi046.stdout:8/336: mkdir d7/de/d4c/d5a/d74 0 2024-03-04T09:30:01.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/353: mknod d0/d3c/d5f/c73 0 2024-03-04T09:30:01.758 INFO:tasks.workunit.client.0.smithi046.stdout:0/366: creat d10/d12/d52/f8c x:0 0 0 2024-03-04T09:30:01.782 INFO:tasks.workunit.client.0.smithi046.stdout:0/367: dread d10/d12/d52/d5d/f61 [0,4194304] 0 2024-03-04T09:30:01.782 INFO:tasks.workunit.client.0.smithi046.stdout:0/368: fdatasync d10/d36/f40 0 2024-03-04T09:30:01.782 INFO:tasks.workunit.client.0.smithi046.stdout:0/369: fdatasync d10/d12/f41 0 2024-03-04T09:30:02.298 INFO:tasks.workunit.client.0.smithi046.stdout:6/443: mkdir da/d14/d1e/d27/d4a/d94 0 2024-03-04T09:30:02.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/381: rename d1/d3/de/d41 to d1/d3/de/d20/d76 0 2024-03-04T09:30:02.473 INFO:tasks.workunit.client.0.smithi046.stdout:4/424: unlink d0/d3/d16/d17/f1b 0 2024-03-04T09:30:02.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/337: creat d7/de/f75 x:0 0 0 2024-03-04T09:30:02.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/370: mknod d10/d12/d1f/d3f/c8d 0 2024-03-04T09:30:03.179 INFO:tasks.workunit.client.0.smithi046.stdout:9/463: rename d1/d11/d6/d8/d12/f6d to d1/d11/d6/d8/d1d/d34/f93 0 2024-03-04T09:30:03.796 INFO:tasks.workunit.client.0.smithi046.stdout:4/425: creat d0/d1f/d25/f9c x:0 0 0 2024-03-04T09:30:03.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/338: symlink d7/de/d13/d2c/l76 0 2024-03-04T09:30:04.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/464: symlink d1/d11/d6/d8/d12/d1c/d26/l94 0 2024-03-04T09:30:04.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/465: chown d1/d11/d6/d8/d1d/l58 4 1 2024-03-04T09:30:04.827 INFO:tasks.workunit.client.0.smithi046.stdout:5/382: unlink d1/d3/d1f/f31 0 2024-03-04T09:30:04.827 INFO:tasks.workunit.client.0.smithi046.stdout:8/339: symlink d7/de/d13/d2c/d64/l77 0 2024-03-04T09:30:04.841 INFO:tasks.workunit.client.0.smithi046.stdout:2/427: sync 2024-03-04T09:30:04.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/466: dwrite d1/d11/d6/f4e [0,4194304] 0 2024-03-04T09:30:04.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/467: readlink d1/d11/d6/d8/d1d/l84 0 2024-03-04T09:30:04.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/468: truncate d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 631020 0 2024-03-04T09:30:04.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/469: dread d1/d11/d6/d8/d1d/d34/d46/f8a [0,4194304] 0 2024-03-04T09:30:04.896 INFO:tasks.workunit.client.0.smithi046.stdout:1/344: dwrite d1/f25 [0,4194304] 0 2024-03-04T09:30:05.288 INFO:tasks.workunit.client.0.smithi046.stdout:8/340: symlink d7/de/d28/l78 0 2024-03-04T09:30:05.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/426: mkdir d0/d3/d3b/d9d 0 2024-03-04T09:30:05.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/427: truncate d0/d3/d16/d1e/f1c 4321601 0 2024-03-04T09:30:05.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/354: dwrite d0/d4/f36 [0,4194304] 0 2024-03-04T09:30:05.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/355: chown d0/d4/db/d12/f2c 299 1 2024-03-04T09:30:05.796 INFO:tasks.workunit.client.0.smithi046.stdout:3/435: write d1/d21/d26/f61 [6815301,51030] 0 2024-03-04T09:30:05.796 INFO:tasks.workunit.client.0.smithi046.stdout:3/436: truncate d1/d21/d35/d24/f28 4342188 0 2024-03-04T09:30:06.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/341: symlink d7/de/d28/l79 0 2024-03-04T09:30:06.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/342: write d7/d53/f65 [836544,14020] 0 2024-03-04T09:30:06.059 INFO:tasks.workunit.client.0.smithi046.stdout:8/343: dread d7/de/d13/d2c/f31 [0,4194304] 0 2024-03-04T09:30:06.059 INFO:tasks.workunit.client.0.smithi046.stdout:8/344: creat d7/de/d4c/d50/f7a x:0 0 0 2024-03-04T09:30:06.129 INFO:tasks.workunit.client.0.smithi046.stdout:4/428: creat d0/d3/d20/d96/d6e/f9e x:0 0 0 2024-03-04T09:30:06.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/345: dwrite d7/fc [0,4194304] 0 2024-03-04T09:30:06.574 INFO:tasks.workunit.client.0.smithi046.stdout:6/444: sync 2024-03-04T09:30:06.574 INFO:tasks.workunit.client.0.smithi046.stdout:7/356: link d0/d4/db/d38/c61 d0/d2d/c74 0 2024-03-04T09:30:06.574 INFO:tasks.workunit.client.0.smithi046.stdout:6/445: read - da/dd/d22/f92 zero size 2024-03-04T09:30:06.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/446: dread da/d14/d1e/d2c/f35 [0,4194304] 0 2024-03-04T09:30:07.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/429: mknod d0/d1f/d25/d50/c9f 0 2024-03-04T09:30:07.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/430: readlink d0/d1f/l2a 0 2024-03-04T09:30:07.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/346: creat d7/de/f7b x:0 0 0 2024-03-04T09:30:07.575 INFO:tasks.workunit.client.0.smithi046.stdout:7/357: getdents d0/d4/db 0 2024-03-04T09:30:07.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/358: write d0/da/f39 [1660129,11666] 0 2024-03-04T09:30:07.680 INFO:tasks.workunit.client.0.smithi046.stdout:6/447: dread da/d14/d1e/d2c/d34/d67/d64/d82/d83/f8d [0,4194304] 0 2024-03-04T09:30:07.680 INFO:tasks.workunit.client.0.smithi046.stdout:6/448: stat da/dd/d39/c51 0 2024-03-04T09:30:07.681 INFO:tasks.workunit.client.0.smithi046.stdout:6/449: stat da/d14/d1e/d27/d4a/c85 0 2024-03-04T09:30:07.906 INFO:tasks.workunit.client.0.smithi046.stdout:4/431: creat d0/d3/d20/d96/fa0 x:0 0 0 2024-03-04T09:30:08.079 INFO:tasks.workunit.client.0.smithi046.stdout:0/371: rmdir d10/d12 39 2024-03-04T09:30:08.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/372: dwrite d10/d12/f3d [0,4194304] 0 2024-03-04T09:30:08.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/359: unlink d0/d4/db/d12/f2c 0 2024-03-04T09:30:08.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/360: truncate d0/d59/f5b 53856 0 2024-03-04T09:30:08.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/361: write d0/d4/db/d38/d64/f6d [2932935,102292] 0 2024-03-04T09:30:08.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/450: truncate da/dd/fe 122740 0 2024-03-04T09:30:08.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/432: mkdir d0/d3/d16/d1e/da1 0 2024-03-04T09:30:08.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/373: creat d10/d12/f8e x:0 0 0 2024-03-04T09:30:08.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/374: chown d10/d12/d52/f8c 54052 1 2024-03-04T09:30:08.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/375: readlink l5 0 2024-03-04T09:30:09.284 INFO:tasks.workunit.client.0.smithi046.stdout:7/362: creat d0/d4/db/d12/f75 x:0 0 0 2024-03-04T09:30:09.318 INFO:tasks.workunit.client.0.smithi046.stdout:7/363: dread d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:30:09.318 INFO:tasks.workunit.client.0.smithi046.stdout:7/364: chown d0/da/d46/f5e 1356531 1 2024-03-04T09:30:09.768 INFO:tasks.workunit.client.0.smithi046.stdout:4/433: mkdir d0/d5f/da2 0 2024-03-04T09:30:09.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/383: write d1/d3/de/d20/d76/f65 [650213,13896] 0 2024-03-04T09:30:09.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/384: write d1/d3/de/d20/f42 [9149793,76472] 0 2024-03-04T09:30:09.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/428: write d5/da/f24 [1284314,20021] 0 2024-03-04T09:30:09.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/429: chown d5/da/c27 16853092 1 2024-03-04T09:30:10.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/451: getdents da/d14/d1e/d27/d4b 0 2024-03-04T09:30:10.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/376: rmdir d10/d36 39 2024-03-04T09:30:10.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/377: chown d10/d12/d52/d5d/f69 2 1 2024-03-04T09:30:10.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/378: dread d10/d12/d52/d78/f3c [0,4194304] 0 2024-03-04T09:30:10.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/379: fdatasync d10/d12/d1f/d3f/d4b/f7f 0 2024-03-04T09:30:10.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/380: write d10/d36/f54 [735265,3945] 0 2024-03-04T09:30:10.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/434: link d0/d1f/d5b/f78 d0/d3/d3b/d8d/fa3 0 2024-03-04T09:30:10.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/385: getdents d1/d3/de/d1d 0 2024-03-04T09:30:10.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/430: creat d5/d84/d88/d3f/f8e x:0 0 0 2024-03-04T09:30:10.964 INFO:tasks.workunit.client.0.smithi046.stdout:1/345: write d1/f49 [121943,94057] 0 2024-03-04T09:30:10.964 INFO:tasks.workunit.client.0.smithi046.stdout:9/470: rename d1/l32 to d1/d11/d6/d8/d1d/d34/d46/l95 0 2024-03-04T09:30:10.992 INFO:tasks.workunit.client.0.smithi046.stdout:3/437: write d1/d1d/d31/f52 [4039581,26441] 0 2024-03-04T09:30:11.016 INFO:tasks.workunit.client.0.smithi046.stdout:6/452: creat da/d14/d1e/d2c/d34/d67/d64/d56/d86/f95 x:0 0 0 2024-03-04T09:30:11.087 INFO:tasks.workunit.client.0.smithi046.stdout:1/346: dwrite d1/f56 [4194304,4194304] 0 2024-03-04T09:30:11.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/471: dwrite d1/d11/d6/d8/d1d/f77 [0,4194304] 0 2024-03-04T09:30:11.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/472: fdatasync d1/d11/d6/d8/d12/f52 0 2024-03-04T09:30:11.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/386: readlink d1/d3/l14 0 2024-03-04T09:30:11.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/387: chown d1/d3/de/d1d 228950539 1 2024-03-04T09:30:11.834 INFO:tasks.workunit.client.0.smithi046.stdout:6/453: creat da/dd/f96 x:0 0 0 2024-03-04T09:30:11.986 INFO:tasks.workunit.client.0.smithi046.stdout:1/347: mknod d1/d28/d6f/c72 0 2024-03-04T09:30:11.986 INFO:tasks.workunit.client.0.smithi046.stdout:1/348: dread - d1/d28/f5b zero size 2024-03-04T09:30:12.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/473: creat d1/d11/d6/d8/d13/d92/f96 x:0 0 0 2024-03-04T09:30:12.769 INFO:tasks.workunit.client.0.smithi046.stdout:2/431: creat d5/d40/f8f x:0 0 0 2024-03-04T09:30:12.815 INFO:tasks.workunit.client.0.smithi046.stdout:3/438: rename d1/d21/d35/d2b/c4d to d1/d1d/d31/c94 0 2024-03-04T09:30:12.815 INFO:tasks.workunit.client.0.smithi046.stdout:3/439: readlink d1/d1d/d27/l57 0 2024-03-04T09:30:12.815 INFO:tasks.workunit.client.0.smithi046.stdout:3/440: chown d1/d1d/d31/f3e 66928 1 2024-03-04T09:30:12.918 INFO:tasks.workunit.client.0.smithi046.stdout:6/454: symlink da/d14/d1e/d2c/d34/d67/d64/d82/l97 0 2024-03-04T09:30:12.946 INFO:tasks.workunit.client.0.smithi046.stdout:6/455: dread f5 [0,4194304] 0 2024-03-04T09:30:13.135 INFO:tasks.workunit.client.0.smithi046.stdout:7/365: truncate d0/d4/db/d38/d64/f6d 1185300 0 2024-03-04T09:30:13.236 INFO:tasks.workunit.client.0.smithi046.stdout:1/349: symlink d1/d28/l73 0 2024-03-04T09:30:14.481 INFO:tasks.workunit.client.0.smithi046.stdout:5/388: unlink d1/d3/l2f 0 2024-03-04T09:30:14.658 INFO:tasks.workunit.client.0.smithi046.stdout:8/347: sync 2024-03-04T09:30:14.658 INFO:tasks.workunit.client.0.smithi046.stdout:8/348: chown d7/de/d13/d2c 348 1 2024-03-04T09:30:14.659 INFO:tasks.workunit.client.0.smithi046.stdout:8/349: chown d7/de/d13/d2c/c32 825 1 2024-03-04T09:30:14.905 INFO:tasks.workunit.client.0.smithi046.stdout:1/350: mkdir d1/d28/d6f/d74 0 2024-03-04T09:30:14.987 INFO:tasks.workunit.client.0.smithi046.stdout:1/351: dwrite d1/d28/f30 [0,4194304] 0 2024-03-04T09:30:15.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/381: dread d10/d12/d52/d78/f50 [0,4194304] 0 2024-03-04T09:30:15.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/382: readlink d10/d12/d1f/d3b/l57 0 2024-03-04T09:30:15.695 INFO:tasks.workunit.client.0.smithi046.stdout:2/432: creat d5/d38/f90 x:0 0 0 2024-03-04T09:30:15.695 INFO:tasks.workunit.client.0.smithi046.stdout:8/350: mkdir d7/de/d28/d36/d7c 0 2024-03-04T09:30:16.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/352: rename d1/d28/c29 to d1/d28/c75 0 2024-03-04T09:30:16.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/435: write d0/d3/d16/d1e/d73/f9a [2486050,29147] 0 2024-03-04T09:30:16.279 INFO:tasks.workunit.client.0.smithi046.stdout:0/383: creat d10/d12/d52/d5d/f8f x:0 0 0 2024-03-04T09:30:16.279 INFO:tasks.workunit.client.0.smithi046.stdout:0/384: dread - d10/d12/d52/f8c zero size 2024-03-04T09:30:16.443 INFO:tasks.workunit.client.0.smithi046.stdout:2/433: mkdir d5/d2c/d91 0 2024-03-04T09:30:16.467 INFO:tasks.workunit.client.0.smithi046.stdout:2/434: dread d5/d2c/f33 [4194304,4194304] 0 2024-03-04T09:30:16.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/351: mkdir d7/de/d28/d3a/d7d 0 2024-03-04T09:30:16.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/441: rename d1/d74/d82 to d1/d1d/d27/d40/d76/d8d/d95 0 2024-03-04T09:30:16.901 INFO:tasks.workunit.client.0.smithi046.stdout:2/435: mkdir d5/d2c/d51/d7f/d92 0 2024-03-04T09:30:16.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/436: chown d5/da/d1b/l3c 159772899 1 2024-03-04T09:30:17.166 INFO:tasks.workunit.client.0.smithi046.stdout:6/456: getdents da/d14/d1e/d2c/d34/d67/d64/d82 0 2024-03-04T09:30:17.359 INFO:tasks.workunit.client.0.smithi046.stdout:4/436: mknod d0/d1f/d25/d50/ca4 0 2024-03-04T09:30:17.359 INFO:tasks.workunit.client.0.smithi046.stdout:4/437: readlink d0/d3/d16/d1e/l55 0 2024-03-04T09:30:17.473 INFO:tasks.workunit.client.0.smithi046.stdout:7/366: rename d0/da/d4e/l5a to d0/d4/db/d3b/l76 0 2024-03-04T09:30:17.666 INFO:tasks.workunit.client.0.smithi046.stdout:3/442: creat d1/d1d/d27/d40/d76/f96 x:0 0 0 2024-03-04T09:30:17.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/443: dread d1/d1d/d27/f73 [0,4194304] 0 2024-03-04T09:30:17.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/444: dread - d1/d1d/d27/f53 zero size 2024-03-04T09:30:17.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/445: fsync d1/d21/d35/d43/f45 0 2024-03-04T09:30:17.857 INFO:tasks.workunit.client.0.smithi046.stdout:6/457: mkdir da/d4e/d98 0 2024-03-04T09:30:17.857 INFO:tasks.workunit.client.0.smithi046.stdout:4/438: creat d0/d3/d3b/d9d/fa5 x:0 0 0 2024-03-04T09:30:18.239 INFO:tasks.workunit.client.0.smithi046.stdout:9/474: sync 2024-03-04T09:30:18.243 INFO:tasks.workunit.client.0.smithi046.stdout:8/352: creat d7/de/f7e x:0 0 0 2024-03-04T09:30:18.245 INFO:tasks.workunit.client.0.smithi046.stdout:9/475: write d1/d11/d6/d8/d12/f52 [4596286,33127] 0 2024-03-04T09:30:18.245 INFO:tasks.workunit.client.0.smithi046.stdout:9/476: chown d1/d11/d6/d8/d1d/d34/d46 1 1 2024-03-04T09:30:18.245 INFO:tasks.workunit.client.0.smithi046.stdout:9/477: read - d1/d11/f75 zero size 2024-03-04T09:30:18.404 INFO:tasks.workunit.client.0.smithi046.stdout:3/446: unlink d1/d1d/d27/f58 0 2024-03-04T09:30:18.404 INFO:tasks.workunit.client.0.smithi046.stdout:3/447: chown d1/d1d 0 1 2024-03-04T09:30:18.405 INFO:tasks.workunit.client.0.smithi046.stdout:3/448: dread - d1/d21/d35/d43/f86 zero size 2024-03-04T09:30:18.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/458: mknod da/dd/d39/c99 0 2024-03-04T09:30:18.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/439: mkdir d0/d1f/d25/da6 0 2024-03-04T09:30:18.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/459: dwrite da/d14/f19 [0,4194304] 0 2024-03-04T09:30:18.649 INFO:tasks.workunit.client.0.smithi046.stdout:5/389: write d1/d3/de/f10 [1311129,108274] 0 2024-03-04T09:30:18.650 INFO:tasks.workunit.client.0.smithi046.stdout:5/390: creat d1/d3/de/d4f/f77 x:0 0 0 2024-03-04T09:30:18.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/440: dwrite d0/d3/d3b/d9d/fa5 [0,4194304] 0 2024-03-04T09:30:18.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/441: read d0/d1f/f2c [749445,79206] 0 2024-03-04T09:30:18.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/442: chown d0/d3/f57 54622 1 2024-03-04T09:30:18.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/443: chown d0/d3/d3b/d8d/l6a 2597 1 2024-03-04T09:30:18.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/444: write d0/d1f/f44 [2445757,119584] 0 2024-03-04T09:30:18.742 INFO:tasks.workunit.client.0.smithi046.stdout:4/445: dread d0/d1f/f48 [0,4194304] 0 2024-03-04T09:30:18.742 INFO:tasks.workunit.client.0.smithi046.stdout:4/446: fdatasync d0/d3/d3b/d8d/fa3 0 2024-03-04T09:30:18.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/447: dread d0/d1f/f2c [0,4194304] 0 2024-03-04T09:30:18.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/448: fdatasync d0/d3/d16/d1e/d73/f89 0 2024-03-04T09:30:18.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/353: rename d7/de/l69 to d7/de/d13/d2c/d62/l7f 0 2024-03-04T09:30:18.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/354: creat d7/de/d3e/f80 x:0 0 0 2024-03-04T09:30:18.818 INFO:tasks.workunit.client.0.smithi046.stdout:8/355: dread d7/de/d3e/f49 [0,4194304] 0 2024-03-04T09:30:18.838 INFO:tasks.workunit.client.0.smithi046.stdout:8/356: write d7/de/d28/f2b [2033491,47996] 0 2024-03-04T09:30:19.002 INFO:tasks.workunit.client.0.smithi046.stdout:9/478: unlink d1/f5b 0 2024-03-04T09:30:19.002 INFO:tasks.workunit.client.0.smithi046.stdout:9/479: chown d1/d11/d6/d8/d1d/d34/d46/l5c 226852873 1 2024-03-04T09:30:19.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/449: truncate d1/d21/d35/d43/f46 1466003 0 2024-03-04T09:30:19.003 INFO:tasks.workunit.client.0.smithi046.stdout:9/480: write d1/d11/d6/d8/d36/f65 [1533659,24958] 0 2024-03-04T09:30:19.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/450: truncate d1/d21/d35/d2b/f6a 401275 0 2024-03-04T09:30:19.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/481: dread d1/d11/d6/d8/d12/d1c/f41 [0,4194304] 0 2024-03-04T09:30:19.041 INFO:tasks.workunit.client.0.smithi046.stdout:9/482: readlink d1/d11/l7c 0 2024-03-04T09:30:19.143 INFO:tasks.workunit.client.0.smithi046.stdout:9/483: dwrite d1/d11/d6/d8/d13/d92/f96 [0,4194304] 0 2024-03-04T09:30:19.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/353: sync 2024-03-04T09:30:19.302 INFO:tasks.workunit.client.0.smithi046.stdout:0/385: sync 2024-03-04T09:30:19.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/354: chown d1/f61 1154002941 1 2024-03-04T09:30:19.716 INFO:tasks.workunit.client.0.smithi046.stdout:6/460: symlink da/dd/d39/d60/l9a 0 2024-03-04T09:30:19.724 INFO:tasks.workunit.client.0.smithi046.stdout:6/461: write da/d14/d1e/d27/d4a/f6f [324150,30876] 0 2024-03-04T09:30:19.724 INFO:tasks.workunit.client.0.smithi046.stdout:6/462: dread - da/d14/d1e/d2c/d34/d67/f8b zero size 2024-03-04T09:30:19.724 INFO:tasks.workunit.client.0.smithi046.stdout:6/463: truncate da/d14/f19 9957110 0 2024-03-04T09:30:19.724 INFO:tasks.workunit.client.0.smithi046.stdout:6/464: dread - da/d14/d1e/d2c/d34/f5a zero size 2024-03-04T09:30:20.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:30:20.188 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:30:20.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/437: sync 2024-03-04T09:30:20.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/438: fsync d5/d38/f85 0 2024-03-04T09:30:20.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/439: getdents d5/d84/d7c 0 2024-03-04T09:30:20.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/440: creat d5/d2c/f93 x:0 0 0 2024-03-04T09:30:20.746 INFO:tasks.workunit.client.0.smithi046.stdout:4/449: mkdir d0/d3/d20/d96/d6e/d85/da7 0 2024-03-04T09:30:21.088 INFO:tasks.workunit.client.0.smithi046.stdout:8/357: getdents d7/de/d28/d3a 0 2024-03-04T09:30:21.105 INFO:tasks.workunit.client.0.smithi046.stdout:8/358: dread d7/d53/f65 [0,4194304] 0 2024-03-04T09:30:21.106 INFO:tasks.workunit.client.0.smithi046.stdout:8/359: stat d7/f1a 0 2024-03-04T09:30:21.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/484: symlink d1/d11/d6/d8/d13/l97 0 2024-03-04T09:30:21.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/386: mknod d10/d12/d6e/c90 0 2024-03-04T09:30:21.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/387: dread - d10/d12/d52/f8c zero size 2024-03-04T09:30:21.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/388: readlink l5 0 2024-03-04T09:30:21.825 INFO:tasks.workunit.client.0.smithi046.stdout:0/389: dwrite d10/d12/f56 [0,4194304] 0 2024-03-04T09:30:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:0/390: write d10/f20 [2528181,93183] 0 2024-03-04T09:30:21.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/391: read d10/d12/d1f/d3f/f65 [2456190,8443] 0 2024-03-04T09:30:21.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/392: chown d10/d12/d1f/d3f/l68 78551883 1 2024-03-04T09:30:21.902 INFO:tasks.workunit.client.0.smithi046.stdout:1/355: truncate d1/d28/f60 1866239 0 2024-03-04T09:30:21.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/356: fsync d1/f44 0 2024-03-04T09:30:21.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/357: dread - d1/f2d zero size 2024-03-04T09:30:21.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/358: chown d1/f7 21 1 2024-03-04T09:30:21.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/359: write d1/f1d [8502433,100199] 0 2024-03-04T09:30:22.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/367: creat d0/d4/db/f77 x:0 0 0 2024-03-04T09:30:22.755 INFO:tasks.workunit.client.0.smithi046.stdout:2/441: creat d5/d2c/d91/f94 x:0 0 0 2024-03-04T09:30:23.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/360: mknod d7/de/d13/d2c/d62/c81 0 2024-03-04T09:30:23.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/361: fdatasync d7/de/d3e/f49 0 2024-03-04T09:30:23.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/362: truncate d7/de/f52 1217552 0 2024-03-04T09:30:23.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/485: link d1/d11/d6/d8/c2a d1/d11/d6/d8/d1d/d34/d46/c98 0 2024-03-04T09:30:23.660 INFO:tasks.workunit.client.0.smithi046.stdout:0/393: symlink d10/d12/d52/d78/l91 0 2024-03-04T09:30:23.693 INFO:tasks.workunit.client.0.smithi046.stdout:0/394: read d10/d12/f56 [1169620,66780] 0 2024-03-04T09:30:23.760 INFO:tasks.workunit.client.0.smithi046.stdout:0/395: dwrite d10/f26 [4194304,4194304] 0 2024-03-04T09:30:23.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/396: dread ff [0,4194304] 0 2024-03-04T09:30:23.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/397: chown d10/d12/d52/d78/f3c 3392901 1 2024-03-04T09:30:24.191 INFO:tasks.workunit.client.0.smithi046.stdout:1/360: rmdir d1 39 2024-03-04T09:30:24.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/368: symlink d0/da/l78 0 2024-03-04T09:30:24.372 INFO:tasks.workunit.client.0.smithi046.stdout:3/451: dwrite d1/d21/d35/d43/f64 [0,4194304] 0 2024-03-04T09:30:24.373 INFO:tasks.workunit.client.0.smithi046.stdout:3/452: stat d1/d1d/d27/d4a/c60 0 2024-03-04T09:30:24.373 INFO:tasks.workunit.client.0.smithi046.stdout:3/453: readlink d1/d21/l2f 0 2024-03-04T09:30:24.373 INFO:tasks.workunit.client.0.smithi046.stdout:3/454: chown d1/f3f 4 1 2024-03-04T09:30:24.387 INFO:tasks.workunit.client.0.smithi046.stdout:5/391: mknod d1/d3/de/c78 0 2024-03-04T09:30:24.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/442: creat d5/d38/d54/d8a/f95 x:0 0 0 2024-03-04T09:30:24.893 INFO:tasks.workunit.client.0.smithi046.stdout:9/486: symlink d1/d11/d6/l99 0 2024-03-04T09:30:24.985 INFO:tasks.workunit.client.0.smithi046.stdout:9/487: dwrite d1/d11/d6/d8/d1d/d34/d4d/f55 [0,4194304] 0 2024-03-04T09:30:24.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/398: mknod d10/d12/d6e/c92 0 2024-03-04T09:30:25.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/399: write d10/f14 [1133365,55271] 0 2024-03-04T09:30:25.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/400: chown d10/d36/d7a 128745 1 2024-03-04T09:30:25.011 INFO:tasks.workunit.client.0.smithi046.stdout:9/488: dread d1/d11/d6/d8/f33 [0,4194304] 0 2024-03-04T09:30:25.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/401: dwrite f7 [0,4194304] 0 2024-03-04T09:30:25.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/402: read d10/d12/d1f/d3f/f65 [3581735,109194] 0 2024-03-04T09:30:25.117 INFO:tasks.workunit.client.0.smithi046.stdout:0/403: dread d10/d12/f3d [0,4194304] 0 2024-03-04T09:30:25.117 INFO:tasks.workunit.client.0.smithi046.stdout:0/404: chown d10/f2e 1917 1 2024-03-04T09:30:25.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/361: link d1/l6b d1/d28/d6f/l76 0 2024-03-04T09:30:25.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/362: truncate d1/f33 239025 0 2024-03-04T09:30:25.174 INFO:tasks.workunit.client.0.smithi046.stdout:1/363: read d1/f21 [1670446,100557] 0 2024-03-04T09:30:25.174 INFO:tasks.workunit.client.0.smithi046.stdout:1/364: readlink d1/d28/l73 0 2024-03-04T09:30:25.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/369: rmdir d0/d58 39 2024-03-04T09:30:25.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/370: dread - d0/d4/db/d12/f75 zero size 2024-03-04T09:30:25.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/455: mknod d1/d1d/d27/d4a/d78/c97 0 2024-03-04T09:30:25.578 INFO:tasks.workunit.client.0.smithi046.stdout:4/450: dwrite d0/f41 [4194304,4194304] 0 2024-03-04T09:30:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/392: chown d1/d3/c17 740404975 1 2024-03-04T09:30:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/393: fdatasync d1/d3/de/d20/d5e/f74 0 2024-03-04T09:30:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/394: write d1/d5f/f60 [878704,15526] 0 2024-03-04T09:30:26.125 INFO:tasks.workunit.client.0.smithi046.stdout:8/363: link d7/de/d28/d36/c54 d7/c82 0 2024-03-04T09:30:26.142 INFO:tasks.workunit.client.0.smithi046.stdout:6/465: sync 2024-03-04T09:30:26.142 INFO:tasks.workunit.client.0.smithi046.stdout:6/466: getdents da/d14/d1e/d27/d4a/d94 0 2024-03-04T09:30:26.142 INFO:tasks.workunit.client.0.smithi046.stdout:6/467: read - da/d14/d1e/d27/d78/d6c/f73 zero size 2024-03-04T09:30:26.392 INFO:tasks.workunit.client.0.smithi046.stdout:9/489: stat d1/d11/d6/d8/d1d/d34/d4d/c7d 0 2024-03-04T09:30:26.631 INFO:tasks.workunit.client.0.smithi046.stdout:0/405: rename d10/d36/f54 to d10/d12/d6e/f93 0 2024-03-04T09:30:26.907 INFO:tasks.workunit.client.0.smithi046.stdout:7/371: creat d0/f79 x:0 0 0 2024-03-04T09:30:26.937 INFO:tasks.workunit.client.0.smithi046.stdout:7/372: dread d0/d4/db/f2b [0,4194304] 0 2024-03-04T09:30:27.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/456: unlink d1/d1d/d27/c2c 0 2024-03-04T09:30:27.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/457: dread - d1/d1d/f7a zero size 2024-03-04T09:30:27.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/451: dread - d0/f39 zero size 2024-03-04T09:30:27.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/452: write d0/d1f/d25/f9c [61154,35681] 0 2024-03-04T09:30:27.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/453: creat d0/d1f/d35/fa8 x:0 0 0 2024-03-04T09:30:27.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/454: dwrite d0/d3/f98 [0,4194304] 0 2024-03-04T09:30:27.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/455: write d0/d8e/f93 [17550,1170] 0 2024-03-04T09:30:27.253 INFO:tasks.workunit.client.0.smithi046.stdout:5/395: dread - d1/d3/de/d20/f3b zero size 2024-03-04T09:30:27.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/396: dwrite d1/d5f/f64 [0,4194304] 0 2024-03-04T09:30:27.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/397: readlink d1/d3/de/d4f/l6d 0 2024-03-04T09:30:27.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/364: mknod d7/d53/c83 0 2024-03-04T09:30:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/365: dwrite d7/de/d28/f37 [0,4194304] 0 2024-03-04T09:30:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/366: fdatasync d7/de/f1b 0 2024-03-04T09:30:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/367: dread - d7/de/f75 zero size 2024-03-04T09:30:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/368: write d7/de/d12/f43 [1955765,115802] 0 2024-03-04T09:30:27.614 INFO:tasks.workunit.client.0.smithi046.stdout:6/468: truncate da/d14/d1e/d27/f55 1456190 0 2024-03-04T09:30:27.677 INFO:tasks.workunit.client.0.smithi046.stdout:9/490: mkdir d1/d11/d6/d8/d6f/d8c/d9a 0 2024-03-04T09:30:27.922 INFO:tasks.workunit.client.0.smithi046.stdout:0/406: rename d10/d12/d6e/c92 to d10/d12/d52/d5d/d83/c94 0 2024-03-04T09:30:28.527 INFO:tasks.workunit.client.0.smithi046.stdout:7/373: symlink d0/d4/db/d3b/l7a 0 2024-03-04T09:30:28.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/458: creat d1/d74/f98 x:0 0 0 2024-03-04T09:30:29.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/456: getdents d0/d3/d16 0 2024-03-04T09:30:29.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/457: dwrite d0/d1f/d25/f9c [0,4194304] 0 2024-03-04T09:30:29.213 INFO:tasks.workunit.client.0.smithi046.stdout:4/458: dread d0/d1f/f77 [0,4194304] 0 2024-03-04T09:30:29.329 INFO:tasks.workunit.client.0.smithi046.stdout:5/398: write d1/d3/d3e/f46 [1222634,18825] 0 2024-03-04T09:30:29.834 INFO:tasks.workunit.client.0.smithi046.stdout:2/443: write d5/d84/d88/d3f/f45 [378151,25642] 0 2024-03-04T09:30:30.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/469: symlink da/d14/d1e/d27/d78/d6c/l9b 0 2024-03-04T09:30:30.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/365: dwrite d1/f17 [0,4194304] 0 2024-03-04T09:30:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:0/407: rename d10/d12/d1f/d3f/d4b/f62 to d10/d12/d52/d5d/d83/f95 0 2024-03-04T09:30:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:0/408: stat d10/d12/d52/d78 0 2024-03-04T09:30:30.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/374: truncate d0/da/d46/f5e 1667232 0 2024-03-04T09:30:31.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/459: read d0/d1f/d25/f26 [6570937,87146] 0 2024-03-04T09:30:31.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/460: getdents d0/d3/d20/d96/d6e/d85/da7 0 2024-03-04T09:30:31.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/444: rename d5/d38/l81 to d5/d38/l96 0 2024-03-04T09:30:31.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/445: write d5/d38/f8d [135191,62263] 0 2024-03-04T09:30:31.869 INFO:tasks.workunit.client.0.smithi046.stdout:2/446: dread - d5/d38/d54/f7a zero size 2024-03-04T09:30:32.112 INFO:tasks.workunit.client.0.smithi046.stdout:6/470: mknod da/d14/d1e/d27/d4b/c9c 0 2024-03-04T09:30:32.112 INFO:tasks.workunit.client.0.smithi046.stdout:1/366: symlink d1/d28/d6f/l77 0 2024-03-04T09:30:32.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/367: stat d1/l3f 0 2024-03-04T09:30:32.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/459: rename d1/d21/d35/d43/f86 to d1/d74/f99 0 2024-03-04T09:30:32.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/460: readlink d1/d21/d35/l72 0 2024-03-04T09:30:32.232 INFO:tasks.workunit.client.0.smithi046.stdout:7/375: mknod d0/da/d41/c7b 0 2024-03-04T09:30:32.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/447: rmdir d5/da 39 2024-03-04T09:30:32.408 INFO:tasks.workunit.client.0.smithi046.stdout:2/448: write d5/d2c/f71 [4993688,69657] 0 2024-03-04T09:30:32.488 INFO:tasks.workunit.client.0.smithi046.stdout:6/471: mknod da/dd/d39/c9d 0 2024-03-04T09:30:32.684 INFO:tasks.workunit.client.0.smithi046.stdout:8/369: write d7/fc [780966,91376] 0 2024-03-04T09:30:32.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/370: chown d7/de/d12/l5d 52572 1 2024-03-04T09:30:33.231 INFO:tasks.workunit.client.0.smithi046.stdout:9/491: unlink d1/d11/d6/d8/d13/f63 0 2024-03-04T09:30:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/376: unlink d0/da/f39 0 2024-03-04T09:30:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/377: creat d0/d4/db/d3b/f7c x:0 0 0 2024-03-04T09:30:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/378: dread - d0/d4/db/f77 zero size 2024-03-04T09:30:33.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/379: dwrite d0/d4/db/d12/d28/f56 [0,4194304] 0 2024-03-04T09:30:33.679 INFO:tasks.workunit.client.0.smithi046.stdout:2/449: symlink d5/d84/d7c/l97 0 2024-03-04T09:30:33.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/450: read - d5/d38/f66 zero size 2024-03-04T09:30:33.684 INFO:tasks.workunit.client.0.smithi046.stdout:6/472: link da/dd/d22/f70 da/d14/d1e/d8f/f9e 0 2024-03-04T09:30:33.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/473: read da/dd/f61 [4032156,52507] 0 2024-03-04T09:30:33.747 INFO:tasks.workunit.client.0.smithi046.stdout:2/451: dwrite d5/d84/d88/d3f/f4b [0,4194304] 0 2024-03-04T09:30:33.978 INFO:tasks.workunit.client.0.smithi046.stdout:8/371: mkdir d7/de/d28/d3a/d6f/d84 0 2024-03-04T09:30:34.104 INFO:tasks.workunit.client.0.smithi046.stdout:3/461: unlink d1/d21/d35/d2b/f47 0 2024-03-04T09:30:34.104 INFO:tasks.workunit.client.0.smithi046.stdout:3/462: chown d1/d74/f98 1 1 2024-03-04T09:30:35.246 INFO:tasks.workunit.client.0.smithi046.stdout:6/474: symlink da/d14/d1e/d27/d4b/l9f 0 2024-03-04T09:30:35.489 INFO:tasks.workunit.client.0.smithi046.stdout:4/461: rename d0/d3/d16/d17 to d0/d1f/d25/da9 0 2024-03-04T09:30:35.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/463: dread d1/d21/d35/d2b/f6a [0,4194304] 0 2024-03-04T09:30:35.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/464: read - d1/d21/d35/d43/f49 zero size 2024-03-04T09:30:35.823 INFO:tasks.workunit.client.0.smithi046.stdout:3/465: read d1/f59 [304358,64530] 0 2024-03-04T09:30:35.823 INFO:tasks.workunit.client.0.smithi046.stdout:3/466: readlink d1/d1d/d27/d40/d70/d7d/l7e 0 2024-03-04T09:30:35.823 INFO:tasks.workunit.client.0.smithi046.stdout:3/467: dread - d1/d21/d35/d43/f45 zero size 2024-03-04T09:30:35.838 INFO:tasks.workunit.client.0.smithi046.stdout:3/468: dread d1/d21/d35/f6c [0,4194304] 0 2024-03-04T09:30:35.838 INFO:tasks.workunit.client.0.smithi046.stdout:3/469: truncate d1/d1d/d27/d4a/f65 76040 0 2024-03-04T09:30:35.838 INFO:tasks.workunit.client.0.smithi046.stdout:3/470: fsync d1/d1d/d27/d4a/f65 0 2024-03-04T09:30:35.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/471: chown d1/d1d/d31/c34 4299864 1 2024-03-04T09:30:35.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/472: dwrite d1/d1d/d5e/f6e [0,4194304] 0 2024-03-04T09:30:36.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/452: rename d5/d84/d88/f6f to d5/d84/d88/d47/f98 0 2024-03-04T09:30:36.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/462: symlink d0/d3/laa 0 2024-03-04T09:30:36.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/463: dwrite d0/d3/d3b/d9d/fa5 [4194304,4194304] 0 2024-03-04T09:30:36.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/464: chown d0/d3/d20/d96/l8f 8177538 1 2024-03-04T09:30:36.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/465: fsync d0/d3/f57 0 2024-03-04T09:30:36.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/466: readlink d0/d3/d3b/d8d/l6a 0 2024-03-04T09:30:36.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/473: mkdir d1/d1d/d31/d9a 0 2024-03-04T09:30:36.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/453: dread d5/d84/d88/d47/f5c [0,4194304] 0 2024-03-04T09:30:36.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/454: fsync d5/d2c/f71 0 2024-03-04T09:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout:4/467: symlink d0/d5f/d6f/d8c/lab 0 2024-03-04T09:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout:4/468: stat d0/d3/d16/d1e/d73 0 2024-03-04T09:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout:4/469: write d0/d1f/d25/f49 [1003991,39451] 0 2024-03-04T09:30:37.218 INFO:tasks.workunit.client.0.smithi046.stdout:3/474: link d1/d1d/d31/c34 d1/d1d/d5e/c9b 0 2024-03-04T09:30:37.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/475: dread d1/d21/d35/f6c [0,4194304] 0 2024-03-04T09:30:37.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/476: read d1/f6f [96514,121516] 0 2024-03-04T09:30:37.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/477: truncate d1/d21/d35/d24/f18 5014638 0 2024-03-04T09:30:37.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/478: write d1/d21/f8b [773375,10559] 0 2024-03-04T09:30:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:3/479: dread d1/d1d/f6d [0,4194304] 0 2024-03-04T09:30:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:3/480: chown d1/c1a 22108433 1 2024-03-04T09:30:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:3/481: readlink d1/d21/d35/d24/l19 0 2024-03-04T09:30:37.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/482: dwrite d1/d1d/f37 [0,4194304] 0 2024-03-04T09:30:37.387 INFO:tasks.workunit.client.0.smithi046.stdout:6/475: rename da/d14/d1e/d2c/d34 to da/dd/d39/d60/da0 0 2024-03-04T09:30:37.678 INFO:tasks.workunit.client.0.smithi046.stdout:5/399: sync 2024-03-04T09:30:37.701 INFO:tasks.workunit.client.0.smithi046.stdout:5/400: dread d1/d3/de/d1d/f33 [0,4194304] 0 2024-03-04T09:30:38.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/470: rename d0/d1f/d25/da9/c3a to d0/d3/d16/d1e/cac 0 2024-03-04T09:30:38.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/476: link da/dd/d39/f45 da/d14/fa1 0 2024-03-04T09:30:38.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/368: write d1/f68 [573246,108640] 0 2024-03-04T09:30:38.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/455: truncate d5/f3b 1152474 0 2024-03-04T09:30:39.341 INFO:tasks.workunit.client.0.smithi046.stdout:6/477: mknod da/d4e/ca2 0 2024-03-04T09:30:39.341 INFO:tasks.workunit.client.0.smithi046.stdout:2/456: mkdir d5/d84/d88/d99 0 2024-03-04T09:30:39.341 INFO:tasks.workunit.client.0.smithi046.stdout:2/457: chown d5/d2c/f93 71055394 1 2024-03-04T09:30:39.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/409: creat d10/f96 x:0 0 0 2024-03-04T09:30:39.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/410: chown d10/d12/d1f/d3f/l68 10111 1 2024-03-04T09:30:39.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/411: write d10/f45 [1674788,77202] 0 2024-03-04T09:30:39.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/458: readlink d5/l86 0 2024-03-04T09:30:40.174 INFO:tasks.workunit.client.0.smithi046.stdout:0/412: symlink d10/l97 0 2024-03-04T09:30:40.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/413: getdents d10/d12/d6e 0 2024-03-04T09:30:41.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/483: rmdir d1/d74 39 2024-03-04T09:30:41.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/414: truncate f1 1134568 0 2024-03-04T09:30:41.918 INFO:tasks.workunit.client.0.smithi046.stdout:0/415: mknod d10/d12/d1f/d3f/d7e/c98 0 2024-03-04T09:30:41.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/380: sync 2024-03-04T09:30:41.919 INFO:tasks.workunit.client.0.smithi046.stdout:8/372: sync 2024-03-04T09:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:5/401: sync 2024-03-04T09:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/373: write d7/de/d3e/f51 [810800,15758] 0 2024-03-04T09:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/471: sync 2024-03-04T09:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/492: sync 2024-03-04T09:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/374: fsync d7/de/d4c/d50/f6e 0 2024-03-04T09:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:1/369: sync 2024-03-04T09:30:41.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/493: fdatasync d1/d11/d6/d8/d1d/d34/f3c 0 2024-03-04T09:30:41.921 INFO:tasks.workunit.client.0.smithi046.stdout:8/375: creat d7/de/d4c/d50/f85 x:0 0 0 2024-03-04T09:30:41.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/494: creat d1/d11/d6/d8/d6f/f9b x:0 0 0 2024-03-04T09:30:41.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/484: creat d1/d1d/d27/d40/d92/f9c x:0 0 0 2024-03-04T09:30:41.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/485: readlink d1/d1d/d27/d40/d70/d7d/l7e 0 2024-03-04T09:30:41.969 INFO:tasks.workunit.client.0.smithi046.stdout:6/478: dwrite da/d14/d1e/d2c/f5b [0,4194304] 0 2024-03-04T09:30:42.082 INFO:tasks.workunit.client.0.smithi046.stdout:0/416: mkdir d10/d12/d6e/d99 0 2024-03-04T09:30:42.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/402: read d1/d3/de/d20/d76/f48 [649109,105513] 0 2024-03-04T09:30:42.308 INFO:tasks.workunit.client.0.smithi046.stdout:5/403: write d1/d3/d3e/f3f [3406740,124587] 0 2024-03-04T09:30:42.368 INFO:tasks.workunit.client.0.smithi046.stdout:4/472: getdents d0/d1f/d25/d50 0 2024-03-04T09:30:42.368 INFO:tasks.workunit.client.0.smithi046.stdout:4/473: chown d0/d5f/da2 6407086 1 2024-03-04T09:30:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/370: link d1/fe d1/d28/d6a/f78 0 2024-03-04T09:30:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/371: chown d1/c5 3319144 1 2024-03-04T09:30:42.942 INFO:tasks.workunit.client.0.smithi046.stdout:9/495: link d1/d11/d6/d8/d12/f29 d1/d11/d6/d8/d6f/d8c/f9c 0 2024-03-04T09:30:43.103 INFO:tasks.workunit.client.0.smithi046.stdout:3/486: creat d1/d1d/d31/d51/f9d x:0 0 0 2024-03-04T09:30:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:0/417: mkdir d10/d12/d9a 0 2024-03-04T09:30:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:0/418: readlink d10/d12/l13 0 2024-03-04T09:30:43.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/479: dread da/dd/d39/d60/f71 [0,4194304] 0 2024-03-04T09:30:43.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/419: dwrite d10/d12/d52/d5d/f8f [0,4194304] 0 2024-03-04T09:30:43.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/420: write d10/d12/f1c [189106,15348] 0 2024-03-04T09:30:43.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/421: read - d10/d12/d1f/d3b/d6b/f72 zero size 2024-03-04T09:30:43.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/422: fsync d10/d12/d52/d78/f3c 0 2024-03-04T09:30:43.835 INFO:tasks.workunit.client.0.smithi046.stdout:4/474: mknod d0/d8e/cad 0 2024-03-04T09:30:44.223 INFO:tasks.workunit.client.0.smithi046.stdout:3/487: creat d1/d1d/d27/d40/d76/d8d/d95/f9e x:0 0 0 2024-03-04T09:30:44.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/381: write d0/d4/db/f3d [315706,29366] 0 2024-03-04T09:30:44.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/488: dwrite d1/d21/d35/d43/f64 [0,4194304] 0 2024-03-04T09:30:44.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/459: rename d5/d84/d88/d75 to d5/d84/d9a 0 2024-03-04T09:30:44.347 INFO:tasks.workunit.client.0.smithi046.stdout:2/460: stat d5/d2c/d51/d7f 0 2024-03-04T09:30:44.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/480: mkdir da/d14/d1e/d27/da3 0 2024-03-04T09:30:45.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/475: creat d0/d1f/d25/d50/fae x:0 0 0 2024-03-04T09:30:45.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/476: write d0/d1f/f45 [4820454,14188] 0 2024-03-04T09:30:45.218 INFO:tasks.workunit.client.0.smithi046.stdout:8/376: dwrite d7/de/d13/f35 [0,4194304] 0 2024-03-04T09:30:45.218 INFO:tasks.workunit.client.0.smithi046.stdout:8/377: truncate d7/de/f3f 428412 0 2024-03-04T09:30:45.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/372: getdents d1/d28/d6a 0 2024-03-04T09:30:45.867 INFO:tasks.workunit.client.0.smithi046.stdout:9/496: rename d1/d11/d6/d8/d12/d1c/f41 to d1/d11/d6/d8/d13/d92/f9d 0 2024-03-04T09:30:45.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/461: mknod d5/d2c/d51/c9b 0 2024-03-04T09:30:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:5/404: write d1/f5 [625075,75504] 0 2024-03-04T09:30:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:5/405: write d1/d3/d3e/f3f [820739,120258] 0 2024-03-04T09:30:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/477: mknod d0/d5f/caf 0 2024-03-04T09:30:47.022 INFO:tasks.workunit.client.0.smithi046.stdout:8/378: mkdir d7/de/d12/d86 0 2024-03-04T09:30:47.102 INFO:tasks.workunit.client.0.smithi046.stdout:1/373: creat d1/f79 x:0 0 0 2024-03-04T09:30:47.131 INFO:tasks.workunit.client.0.smithi046.stdout:1/374: dread d1/f19 [0,4194304] 0 2024-03-04T09:30:47.303 INFO:tasks.workunit.client.0.smithi046.stdout:3/489: rename d1/d21/d35/d43/f4f to d1/d88/f9f 0 2024-03-04T09:30:47.303 INFO:tasks.workunit.client.0.smithi046.stdout:3/490: fdatasync d1/d74/f98 0 2024-03-04T09:30:47.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/481: rmdir da/d14/d1e/d27/d78 39 2024-03-04T09:30:47.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/382: creat d0/da/f7d x:0 0 0 2024-03-04T09:30:47.913 INFO:tasks.workunit.client.0.smithi046.stdout:7/383: dwrite d0/d4/db/d12/f1d [0,4194304] 0 2024-03-04T09:30:47.997 INFO:tasks.workunit.client.0.smithi046.stdout:5/406: chown d1/d3/c12 1 1 2024-03-04T09:30:48.153 INFO:tasks.workunit.client.0.smithi046.stdout:4/478: link d0/d1f/f77 d0/d5f/da2/fb0 0 2024-03-04T09:30:48.262 INFO:tasks.workunit.client.0.smithi046.stdout:0/423: dwrite d10/d12/d52/d5d/f6f [0,4194304] 0 2024-03-04T09:30:48.269 INFO:tasks.workunit.client.0.smithi046.stdout:8/379: creat d7/de/d13/f87 x:0 0 0 2024-03-04T09:30:48.270 INFO:tasks.workunit.client.0.smithi046.stdout:8/380: write d7/de/d4c/d50/f6e [374618,60395] 0 2024-03-04T09:30:48.273 INFO:tasks.workunit.client.0.smithi046.stdout:8/381: read d7/de/d3e/f51 [345698,115992] 0 2024-03-04T09:30:48.365 INFO:tasks.workunit.client.0.smithi046.stdout:1/375: creat d1/d28/f7a x:0 0 0 2024-03-04T09:30:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:3/491: symlink d1/d1d/d27/d40/d76/d8d/la0 0 2024-03-04T09:30:48.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/497: getdents d1/d11/d6/d8/d1d/d34/d46/d5e 0 2024-03-04T09:30:48.776 INFO:tasks.workunit.client.0.smithi046.stdout:3/492: dwrite d1/f39 [0,4194304] 0 2024-03-04T09:30:49.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/384: unlink d0/da/d46/l70 0 2024-03-04T09:30:49.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/407: creat d1/f79 x:0 0 0 2024-03-04T09:30:49.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/408: getdents d1/d3/de/d1d/d72 0 2024-03-04T09:30:49.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/424: mknod d10/d12/d52/d78/c9b 0 2024-03-04T09:30:50.054 INFO:tasks.workunit.client.0.smithi046.stdout:8/382: creat d7/de/d13/f88 x:0 0 0 2024-03-04T09:30:50.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:30:50.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:30:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/376: mkdir d1/d28/d6a/d7b 0 2024-03-04T09:30:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:9/498: mkdir d1/d11/d6/d8/d1d/d34/d46/d5e/d9e 0 2024-03-04T09:30:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:9/499: chown d1/d11/d6/l73 31048 1 2024-03-04T09:30:50.640 INFO:tasks.workunit.client.0.smithi046.stdout:9/500: write d1/d11/d6/d8/d1d/d34/d46/d4c/f71 [29253,73887] 0 2024-03-04T09:30:50.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/501: dread d1/d11/d6/d8/d12/d1c/f6e [4194304,4194304] 0 2024-03-04T09:30:50.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/502: write d1/d11/d6/d8/d1d/d34/d4d/f55 [4471756,47425] 0 2024-03-04T09:30:50.755 INFO:tasks.workunit.client.0.smithi046.stdout:9/503: dread d1/d11/d6/d8/f62 [0,4194304] 0 2024-03-04T09:30:50.774 INFO:tasks.workunit.client.0.smithi046.stdout:2/462: dwrite d5/fd [0,4194304] 0 2024-03-04T09:30:50.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/504: write d1/d11/d6/d8/d12/f1e [2055494,98443] 0 2024-03-04T09:30:50.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/505: write d1/d11/d6/d8/d12/f30 [3330299,116469] 0 2024-03-04T09:30:50.783 INFO:tasks.workunit.client.0.smithi046.stdout:2/463: dread d5/d84/d88/d47/f5c [0,4194304] 0 2024-03-04T09:30:50.783 INFO:tasks.workunit.client.0.smithi046.stdout:2/464: truncate d5/d84/d88/d47/f98 810529 0 2024-03-04T09:30:50.913 INFO:tasks.workunit.client.0.smithi046.stdout:6/482: truncate da/d14/d17/f1b 903348 0 2024-03-04T09:30:50.913 INFO:tasks.workunit.client.0.smithi046.stdout:7/385: mkdir d0/d4/db/d38/d7e 0 2024-03-04T09:30:50.913 INFO:tasks.workunit.client.0.smithi046.stdout:7/386: dread - d0/da/f7d zero size 2024-03-04T09:30:51.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/383: unlink c0 0 2024-03-04T09:30:51.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/377: creat d1/f7c x:0 0 0 2024-03-04T09:30:51.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/378: dread - d1/d28/f6e zero size 2024-03-04T09:30:51.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/384: write d7/de/d28/f58 [919791,112014] 0 2024-03-04T09:30:51.785 INFO:tasks.workunit.client.0.smithi046.stdout:9/506: rename d1/d11/d6/d8/d1d/d34/f49 to d1/d11/d6/d8/d1d/d34/f9f 0 2024-03-04T09:30:51.785 INFO:tasks.workunit.client.0.smithi046.stdout:9/507: dread - d1/d11/d6/f83 zero size 2024-03-04T09:30:52.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/465: rename d5/da/f20 to d5/d2c/f9c 0 2024-03-04T09:30:52.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/466: chown d5/d84/d88/f3e 8759 1 2024-03-04T09:30:52.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/483: mknod da/dd/d39/ca4 0 2024-03-04T09:30:52.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/484: dread da/dd/d39/d60/da0/d67/d64/d82/d83/f8d [0,4194304] 0 2024-03-04T09:30:52.129 INFO:tasks.workunit.client.0.smithi046.stdout:2/467: write d5/d38/f76 [4115911,116445] 0 2024-03-04T09:30:52.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/425: getdents d10/d12/d1f/d3f 0 2024-03-04T09:30:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/385: getdents d7/de/d13/d2c 0 2024-03-04T09:30:52.262 INFO:tasks.workunit.client.0.smithi046.stdout:1/379: mknod d1/d28/d6f/c7d 0 2024-03-04T09:30:52.262 INFO:tasks.workunit.client.0.smithi046.stdout:1/380: fsync d1/f25 0 2024-03-04T09:30:52.262 INFO:tasks.workunit.client.0.smithi046.stdout:1/381: chown d1/f21 0 1 2024-03-04T09:30:52.425 INFO:tasks.workunit.client.0.smithi046.stdout:9/508: mknod d1/d11/d6/d8/d12/d1c/ca0 0 2024-03-04T09:30:52.754 INFO:tasks.workunit.client.0.smithi046.stdout:6/485: creat da/dd/d39/d60/da0/fa5 x:0 0 0 2024-03-04T09:30:53.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/493: symlink d1/d1d/la1 0 2024-03-04T09:30:53.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/509: truncate d1/d11/d6/d8/d36/f51 683849 0 2024-03-04T09:30:53.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/382: dread d1/f33 [0,4194304] 0 2024-03-04T09:30:53.867 INFO:tasks.workunit.client.0.smithi046.stdout:3/494: creat d1/d1d/d27/d4a/d78/fa2 x:0 0 0 2024-03-04T09:30:53.868 INFO:tasks.workunit.client.0.smithi046.stdout:3/495: fsync d1/d1d/d31/f3e 0 2024-03-04T09:30:53.868 INFO:tasks.workunit.client.0.smithi046.stdout:3/496: readlink d1/d1d/d27/d40/l4e 0 2024-03-04T09:30:53.868 INFO:tasks.workunit.client.0.smithi046.stdout:3/497: read d1/d21/d26/f30 [69886,97087] 0 2024-03-04T09:30:53.998 INFO:tasks.workunit.client.0.smithi046.stdout:4/479: sync 2024-03-04T09:30:54.353 INFO:tasks.workunit.client.0.smithi046.stdout:5/409: dwrite d1/f36 [0,4194304] 0 2024-03-04T09:30:54.353 INFO:tasks.workunit.client.0.smithi046.stdout:5/410: readlink d1/d3/l75 0 2024-03-04T09:30:54.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/387: write d0/da/d46/f5e [1982914,112709] 0 2024-03-04T09:30:54.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/388: creat d0/da/f7f x:0 0 0 2024-03-04T09:30:54.537 INFO:tasks.workunit.client.0.smithi046.stdout:7/389: dread d0/d4/db/f2b [0,4194304] 0 2024-03-04T09:30:54.537 INFO:tasks.workunit.client.0.smithi046.stdout:7/390: chown d0/d4/db/d38/d64 57616292 1 2024-03-04T09:30:54.537 INFO:tasks.workunit.client.0.smithi046.stdout:7/391: write d0/da/f29 [356700,43825] 0 2024-03-04T09:30:54.537 INFO:tasks.workunit.client.0.smithi046.stdout:7/392: readlink d0/d4/db/l1a 0 2024-03-04T09:30:54.663 INFO:tasks.workunit.client.0.smithi046.stdout:7/393: dwrite d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:30:54.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/498: mkdir d1/d1d/d31/d51/da3 0 2024-03-04T09:30:54.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/480: symlink d0/d3/lb1 0 2024-03-04T09:30:55.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/411: mknod d1/d44/d57/d70/c7a 0 2024-03-04T09:30:55.563 INFO:tasks.workunit.client.0.smithi046.stdout:1/383: mknod d1/c7e 0 2024-03-04T09:30:55.579 INFO:tasks.workunit.client.0.smithi046.stdout:5/412: dread d1/d44/f5a [0,4194304] 0 2024-03-04T09:30:55.652 INFO:tasks.workunit.client.0.smithi046.stdout:1/384: dwrite d1/d28/d6a/f78 [0,4194304] 0 2024-03-04T09:30:55.652 INFO:tasks.workunit.client.0.smithi046.stdout:1/385: creat d1/d28/f7f x:0 0 0 2024-03-04T09:30:55.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/394: symlink d0/da/d46/l80 0 2024-03-04T09:30:55.856 INFO:tasks.workunit.client.0.smithi046.stdout:7/395: fsync d0/d4/db/d12/f1d 0 2024-03-04T09:30:55.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/396: write d0/d4/db/d12/d28/f4b [2592356,50180] 0 2024-03-04T09:30:55.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/397: write d0/d3c/f69 [737826,57566] 0 2024-03-04T09:30:55.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/398: fdatasync d0/d4/db/d3b/f7c 0 2024-03-04T09:30:55.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/499: symlink d1/d21/d35/d24/la4 0 2024-03-04T09:30:56.001 INFO:tasks.workunit.client.0.smithi046.stdout:4/481: symlink d0/d1f/d35/lb2 0 2024-03-04T09:30:56.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/426: write d10/f26 [2452808,116275] 0 2024-03-04T09:30:56.531 INFO:tasks.workunit.client.0.smithi046.stdout:2/468: sync 2024-03-04T09:30:56.531 INFO:tasks.workunit.client.0.smithi046.stdout:8/386: sync 2024-03-04T09:30:56.531 INFO:tasks.workunit.client.0.smithi046.stdout:8/387: chown d7/d53 153565 1 2024-03-04T09:30:56.733 INFO:tasks.workunit.client.0.smithi046.stdout:1/386: rmdir d1/d28/d6a/d7b 0 2024-03-04T09:30:56.734 INFO:tasks.workunit.client.0.smithi046.stdout:3/500: symlink d1/d1d/la5 0 2024-03-04T09:30:56.836 INFO:tasks.workunit.client.0.smithi046.stdout:4/482: link d0/d1f/d5b/c80 d0/d3/d3b/d8d/cb3 0 2024-03-04T09:30:56.836 INFO:tasks.workunit.client.0.smithi046.stdout:4/483: write d0/d3/d20/d96/fa0 [722562,25400] 0 2024-03-04T09:30:57.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/388: mkdir d7/de/d28/d36/d7c/d89 0 2024-03-04T09:30:57.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/389: chown d7/de/d28/f58 42 1 2024-03-04T09:30:57.261 INFO:tasks.workunit.client.0.smithi046.stdout:1/387: creat d1/d28/d6f/f80 x:0 0 0 2024-03-04T09:30:57.313 INFO:tasks.workunit.client.0.smithi046.stdout:6/486: sync 2024-03-04T09:30:57.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/501: creat d1/d1d/d27/d40/d76/d8d/d95/fa6 x:0 0 0 2024-03-04T09:30:57.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/484: getdents d0/d3/d20/d96/d6e/d85 0 2024-03-04T09:30:57.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/485: fdatasync d0/d3/d16/f5a 0 2024-03-04T09:30:57.875 INFO:tasks.workunit.client.0.smithi046.stdout:5/413: rename d1/d3/de/d26 to d1/d3/de/d20/d76/d6c/d7b 0 2024-03-04T09:30:57.875 INFO:tasks.workunit.client.0.smithi046.stdout:7/399: rename d0/d4 to d0/d4/db/d81 22 2024-03-04T09:30:57.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/390: chown d7/de/d13/d3c/c55 464 1 2024-03-04T09:30:57.875 INFO:tasks.workunit.client.0.smithi046.stdout:7/400: write d0/d4/db/d38/f57 [1172682,2728] 0 2024-03-04T09:30:58.018 INFO:tasks.workunit.client.0.smithi046.stdout:1/388: symlink d1/d28/d6a/l81 0 2024-03-04T09:30:58.019 INFO:tasks.workunit.client.0.smithi046.stdout:1/389: stat d1/c3b 0 2024-03-04T09:30:58.019 INFO:tasks.workunit.client.0.smithi046.stdout:1/390: chown d1/c3b 2253 1 2024-03-04T09:30:58.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/502: link d1/d1d/d27/d40/d76/d8d/d95/f87 d1/d1d/fa7 0 2024-03-04T09:30:58.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/486: unlink d0/d3/d20/l3f 0 2024-03-04T09:30:58.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/487: fsync d0/d1f/d35/fa8 0 2024-03-04T09:30:58.376 INFO:tasks.workunit.client.0.smithi046.stdout:9/510: dwrite d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:30:58.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/511: dwrite d1/d11/d6/d8/d1d/d34/d4d/f55 [4194304,4194304] 0 2024-03-04T09:30:58.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/512: creat d1/d11/d6/d8/d1d/d34/d46/d4c/fa1 x:0 0 0 2024-03-04T09:30:58.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/503: dwrite d1/f89 [0,4194304] 0 2024-03-04T09:30:58.798 INFO:tasks.workunit.client.0.smithi046.stdout:5/414: creat d1/d5f/f7c x:0 0 0 2024-03-04T09:30:59.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/401: mknod d0/d4/db/d38/c82 0 2024-03-04T09:30:59.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/391: link d1/f7 d1/d28/d6f/d74/f82 0 2024-03-04T09:30:59.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/392: write d1/f5e [1012812,40263] 0 2024-03-04T09:30:59.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/393: dread - d1/d28/f41 zero size 2024-03-04T09:30:59.304 INFO:tasks.workunit.client.0.smithi046.stdout:1/394: write d1/f19 [2404640,108907] 0 2024-03-04T09:30:59.340 INFO:tasks.workunit.client.0.smithi046.stdout:1/395: dread d1/f19 [0,4194304] 0 2024-03-04T09:30:59.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/396: dread d1/d28/f69 [0,4194304] 0 2024-03-04T09:30:59.507 INFO:tasks.workunit.client.0.smithi046.stdout:2/469: rename d5/d84/f70 to d5/f9d 0 2024-03-04T09:31:00.515 INFO:tasks.workunit.client.0.smithi046.stdout:0/427: mknod d10/d12/c9c 0 2024-03-04T09:31:01.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/415: symlink d1/d44/d57/l7d 0 2024-03-04T09:31:01.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/416: chown d1/d3/de/c40 64 1 2024-03-04T09:31:01.558 INFO:tasks.workunit.client.0.smithi046.stdout:7/402: symlink d0/da/d46/l83 0 2024-03-04T09:31:01.574 INFO:tasks.workunit.client.0.smithi046.stdout:1/397: truncate d1/d28/f30 2023238 0 2024-03-04T09:31:01.575 INFO:tasks.workunit.client.0.smithi046.stdout:6/487: rename da/d14/d1e/c1f to da/d14/d1e/d27/d78/ca6 0 2024-03-04T09:31:01.575 INFO:tasks.workunit.client.0.smithi046.stdout:6/488: truncate da/dd/d22/f70 415169 0 2024-03-04T09:31:01.682 INFO:tasks.workunit.client.0.smithi046.stdout:1/398: dwrite d1/f7c [0,4194304] 0 2024-03-04T09:31:01.804 INFO:tasks.workunit.client.0.smithi046.stdout:0/428: mknod d10/d12/d52/d78/c9d 0 2024-03-04T09:31:01.804 INFO:tasks.workunit.client.0.smithi046.stdout:0/429: readlink d10/d12/d52/d78/l5a 0 2024-03-04T09:31:02.351 INFO:tasks.workunit.client.0.smithi046.stdout:2/470: rmdir d5/d84/d88/d3f 39 2024-03-04T09:31:02.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/471: dread d5/d2c/f71 [0,4194304] 0 2024-03-04T09:31:02.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/472: truncate d5/d2c/d91/f94 208653 0 2024-03-04T09:31:02.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/417: rename d1/f79 to d1/d3/de/d20/d5e/f7e 0 2024-03-04T09:31:02.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/399: getdents d1/d28/d6a 0 2024-03-04T09:31:02.694 INFO:tasks.workunit.client.0.smithi046.stdout:1/400: write d1/d28/f4e [2766777,80480] 0 2024-03-04T09:31:02.822 INFO:tasks.workunit.client.0.smithi046.stdout:7/403: getdents d0/da 0 2024-03-04T09:31:02.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/391: write d7/de/f3f [833035,1847] 0 2024-03-04T09:31:02.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/473: creat d5/d84/d9a/f9e x:0 0 0 2024-03-04T09:31:03.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/474: dwrite d5/d2c/f6a [0,4194304] 0 2024-03-04T09:31:03.088 INFO:tasks.workunit.client.0.smithi046.stdout:6/489: rename da/dd/d39/d60/da0/d67/d64/d56/d77 to da/dd/d22/da7 0 2024-03-04T09:31:03.186 INFO:tasks.workunit.client.0.smithi046.stdout:5/418: creat d1/f7f x:0 0 0 2024-03-04T09:31:03.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/401: rmdir d1/d28/d6f/d74 39 2024-03-04T09:31:03.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/402: fdatasync d1/d28/d6f/f80 0 2024-03-04T09:31:03.717 INFO:tasks.workunit.client.0.smithi046.stdout:8/392: creat d7/de/d4c/d5a/d74/f8a x:0 0 0 2024-03-04T09:31:03.717 INFO:tasks.workunit.client.0.smithi046.stdout:8/393: dread - d7/de/d13/f87 zero size 2024-03-04T09:31:03.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/394: dwrite d7/de/d4c/d5a/d74/f8a [0,4194304] 0 2024-03-04T09:31:03.856 INFO:tasks.workunit.client.0.smithi046.stdout:8/395: dwrite d7/f5f [0,4194304] 0 2024-03-04T09:31:03.856 INFO:tasks.workunit.client.0.smithi046.stdout:8/396: creat d7/de/d12/f8b x:0 0 0 2024-03-04T09:31:03.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/397: dwrite d7/de/d3e/f57 [0,4194304] 0 2024-03-04T09:31:04.067 INFO:tasks.workunit.client.0.smithi046.stdout:2/475: dread d5/f1f [0,4194304] 0 2024-03-04T09:31:04.158 INFO:tasks.workunit.client.0.smithi046.stdout:2/476: dwrite d5/d38/f76 [0,4194304] 0 2024-03-04T09:31:04.406 INFO:tasks.workunit.client.0.smithi046.stdout:5/419: mknod d1/d3/de/d1d/d63/c80 0 2024-03-04T09:31:04.406 INFO:tasks.workunit.client.0.smithi046.stdout:6/490: creat da/dd/d39/d60/da0/d67/fa8 x:0 0 0 2024-03-04T09:31:04.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/491: dread da/d14/d1e/d2c/f5b [0,4194304] 0 2024-03-04T09:31:05.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/513: write d1/d11/d6/d8/d36/f51 [1349534,13450] 0 2024-03-04T09:31:05.164 INFO:tasks.workunit.client.0.smithi046.stdout:4/488: sync 2024-03-04T09:31:05.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/398: unlink d7/de/d3e/f51 0 2024-03-04T09:31:05.484 INFO:tasks.workunit.client.0.smithi046.stdout:3/504: write d1/d21/d35/d24/f28 [3225710,96532] 0 2024-03-04T09:31:05.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/505: dread d1/d1d/d31/f52 [0,4194304] 0 2024-03-04T09:31:05.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/506: write d1/d1d/f5d [294743,96672] 0 2024-03-04T09:31:05.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/477: dread d5/f4e [0,4194304] 0 2024-03-04T09:31:05.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/420: fdatasync d1/f2 0 2024-03-04T09:31:05.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/421: readlink d1/d3/de/d1d/l2a 0 2024-03-04T09:31:06.101 INFO:tasks.workunit.client.0.smithi046.stdout:6/492: mkdir da/dd/d39/d60/da9 0 2024-03-04T09:31:06.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/493: chown da/dd/d39/d60/f71 7 1 2024-03-04T09:31:06.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/494: read da/d14/fa1 [2397545,73822] 0 2024-03-04T09:31:06.430 INFO:tasks.workunit.client.0.smithi046.stdout:4/489: symlink d0/d1f/d35/lb4 0 2024-03-04T09:31:06.511 INFO:tasks.workunit.client.0.smithi046.stdout:4/490: dwrite d0/f41 [0,4194304] 0 2024-03-04T09:31:06.539 INFO:tasks.workunit.client.0.smithi046.stdout:4/491: write d0/d3/f6 [2380927,117593] 0 2024-03-04T09:31:06.561 INFO:tasks.workunit.client.0.smithi046.stdout:8/399: unlink d7/de/d28/l4f 0 2024-03-04T09:31:06.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/507: creat d1/d1d/d27/d40/d70/fa8 x:0 0 0 2024-03-04T09:31:06.999 INFO:tasks.workunit.client.0.smithi046.stdout:3/508: dwrite d1/d21/d35/d43/f49 [0,4194304] 0 2024-03-04T09:31:07.876 INFO:tasks.workunit.client.0.smithi046.stdout:1/403: truncate d1/d28/f4e 3531567 0 2024-03-04T09:31:07.889 INFO:tasks.workunit.client.0.smithi046.stdout:1/404: dread d1/f33 [0,4194304] 0 2024-03-04T09:31:08.103 INFO:tasks.workunit.client.0.smithi046.stdout:8/400: chown d7/de/d13/d3c/c3d 548536534 1 2024-03-04T09:31:08.127 INFO:tasks.workunit.client.0.smithi046.stdout:7/404: dwrite d0/d59/f5b [0,4194304] 0 2024-03-04T09:31:08.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/401: dread d7/de/d3e/f57 [0,4194304] 0 2024-03-04T09:31:08.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/478: rmdir d5/da/d1b 39 2024-03-04T09:31:08.763 INFO:tasks.workunit.client.0.smithi046.stdout:6/495: creat da/d14/d1e/d27/d78/d66/faa x:0 0 0 2024-03-04T09:31:09.494 INFO:tasks.workunit.client.0.smithi046.stdout:7/405: creat d0/d4/d6e/f84 x:0 0 0 2024-03-04T09:31:09.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/479: dread f3 [0,4194304] 0 2024-03-04T09:31:09.913 INFO:tasks.workunit.client.0.smithi046.stdout:6/496: rmdir da/d14/d17/d84 0 2024-03-04T09:31:10.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/402: rename d7/de/d4c/d5a/d74/f8a to d7/de/d28/d36/d7c/d89/f8c 0 2024-03-04T09:31:10.396 INFO:tasks.workunit.client.0.smithi046.stdout:2/480: dwrite d5/da/f23 [4194304,4194304] 0 2024-03-04T09:31:10.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/481: creat d5/d2c/d51/d61/f9f x:0 0 0 2024-03-04T09:31:10.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/482: chown d5/da 1 1 2024-03-04T09:31:11.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/497: mkdir da/d14/d1e/d27/d4a/dab 0 2024-03-04T09:31:11.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/498: dwrite da/d14/d1e/d27/d4b/f75 [0,4194304] 0 2024-03-04T09:31:11.324 INFO:tasks.workunit.client.0.smithi046.stdout:2/483: link d5/f1d d5/d84/d9a/fa0 0 2024-03-04T09:31:11.324 INFO:tasks.workunit.client.0.smithi046.stdout:2/484: truncate d5/d84/d88/f44 299827 0 2024-03-04T09:31:11.588 INFO:tasks.workunit.client.0.smithi046.stdout:6/499: mkdir da/dd/d39/d60/dac 0 2024-03-04T09:31:11.588 INFO:tasks.workunit.client.0.smithi046.stdout:6/500: creat da/d14/d1e/d27/d78/d66/fad x:0 0 0 2024-03-04T09:31:11.669 INFO:tasks.workunit.client.0.smithi046.stdout:2/485: mknod d5/d38/d54/d8a/ca1 0 2024-03-04T09:31:11.865 INFO:tasks.workunit.client.0.smithi046.stdout:6/501: mknod da/d14/d1e/d2c/cae 0 2024-03-04T09:31:11.865 INFO:tasks.workunit.client.0.smithi046.stdout:6/502: chown da/dd/d22/f70 77 1 2024-03-04T09:31:11.865 INFO:tasks.workunit.client.0.smithi046.stdout:6/503: chown c3 0 1 2024-03-04T09:31:11.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/504: dread da/dd/d39/d60/da0/d67/f6d [0,4194304] 0 2024-03-04T09:31:12.020 INFO:tasks.workunit.client.0.smithi046.stdout:2/486: creat d5/d84/d88/fa2 x:0 0 0 2024-03-04T09:31:12.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/505: truncate da/dd/d39/d60/da0/f62 3276827 0 2024-03-04T09:31:12.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/506: dread da/d14/d1e/d27/f5e [0,4194304] 0 2024-03-04T09:31:12.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/507: chown da/dd/c1c 1418 1 2024-03-04T09:31:12.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/508: readlink da/dd/d39/d60/da0/d67/d64/d82/l97 0 2024-03-04T09:31:12.428 INFO:tasks.workunit.client.0.smithi046.stdout:2/487: dwrite d5/da/d1b/f36 [4194304,4194304] 0 2024-03-04T09:31:12.586 INFO:tasks.workunit.client.0.smithi046.stdout:6/509: mkdir da/dd/d39/d60/dac/daf 0 2024-03-04T09:31:12.586 INFO:tasks.workunit.client.0.smithi046.stdout:6/510: fdatasync da/dd/d39/d60/da0/f5a 0 2024-03-04T09:31:12.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/488: symlink d5/d2c/d51/d7f/d92/la3 0 2024-03-04T09:31:12.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/514: write d1/d11/d6/d8/d6f/d8c/f9c [936549,44611] 0 2024-03-04T09:31:12.925 INFO:tasks.workunit.client.0.smithi046.stdout:5/422: dwrite d1/d3/de/d20/d76/d6c/d7b/f28 [0,4194304] 0 2024-03-04T09:31:13.075 INFO:tasks.workunit.client.0.smithi046.stdout:6/511: creat da/d14/d1e/d27/d4b/fb0 x:0 0 0 2024-03-04T09:31:13.215 INFO:tasks.workunit.client.0.smithi046.stdout:2/489: link d5/d2c/f2e d5/d38/d54/fa4 0 2024-03-04T09:31:13.699 INFO:tasks.workunit.client.0.smithi046.stdout:9/515: mknod d1/d11/d6/d8/d12/d1c/d26/d91/ca2 0 2024-03-04T09:31:13.700 INFO:tasks.workunit.client.0.smithi046.stdout:9/516: chown d1/d11/d6/d8/d1d/d34/d46/l50 129822840 1 2024-03-04T09:31:13.850 INFO:tasks.workunit.client.0.smithi046.stdout:6/512: mkdir da/dd/d46/db1 0 2024-03-04T09:31:14.359 INFO:tasks.workunit.client.0.smithi046.stdout:9/517: mkdir d1/d11/d6/d8/d1d/d34/d46/d4c/da3 0 2024-03-04T09:31:14.388 INFO:tasks.workunit.client.0.smithi046.stdout:0/430: rmdir d10 39 2024-03-04T09:31:14.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/492: sync 2024-03-04T09:31:14.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/493: write d0/d1f/d35/f84 [63874,74320] 0 2024-03-04T09:31:14.411 INFO:tasks.workunit.client.0.smithi046.stdout:0/431: dread d10/d12/d1f/f27 [0,4194304] 0 2024-03-04T09:31:14.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/490: symlink d5/d84/d88/d3f/la5 0 2024-03-04T09:31:14.712 INFO:tasks.workunit.client.0.smithi046.stdout:9/518: truncate d1/d11/d6/d8/d1d/d34/d46/f5f 686008 0 2024-03-04T09:31:14.811 INFO:tasks.workunit.client.0.smithi046.stdout:0/432: mknod d10/d12/d1f/d3b/d6b/c9e 0 2024-03-04T09:31:14.870 INFO:tasks.workunit.client.0.smithi046.stdout:6/513: mkdir da/d14/d1e/d27/d4a/db2 0 2024-03-04T09:31:14.871 INFO:tasks.workunit.client.0.smithi046.stdout:6/514: creat da/d14/d1e/d27/d4b/fb3 x:0 0 0 2024-03-04T09:31:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:2/491: mknod d5/d38/d54/d8a/ca6 0 2024-03-04T09:31:15.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/405: dwrite d1/f4c [0,4194304] 0 2024-03-04T09:31:15.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/519: symlink d1/d11/d6/d8/d1d/d34/d4d/la4 0 2024-03-04T09:31:15.924 INFO:tasks.workunit.client.0.smithi046.stdout:0/433: mkdir d10/d12/d9f 0 2024-03-04T09:31:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:6/515: link f5 da/dd/d39/d60/da0/d67/d64/d56/fb4 0 2024-03-04T09:31:16.070 INFO:tasks.workunit.client.0.smithi046.stdout:2/492: rename d5/d84/d9a/f9e to d5/d38/fa7 0 2024-03-04T09:31:16.572 INFO:tasks.workunit.client.0.smithi046.stdout:0/434: creat d10/d12/d1f/d3b/d6b/fa0 x:0 0 0 2024-03-04T09:31:16.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/516: unlink da/d14/d1e/d27/l2e 0 2024-03-04T09:31:16.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/517: dread - da/dd/d39/d60/da0/d67/fa8 zero size 2024-03-04T09:31:16.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/518: chown da/dd/d39/d60/da0/d67/d64/c7c 0 1 2024-03-04T09:31:16.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/519: readlink da/d14/l3b 0 2024-03-04T09:31:16.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/493: mkdir d5/d40/da8 0 2024-03-04T09:31:16.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/494: fsync d5/fd 0 2024-03-04T09:31:16.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/495: chown d5/da/d1b/l4a 420 1 2024-03-04T09:31:16.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/496: chown d5/d84/d88/d3f/f41 3 1 2024-03-04T09:31:16.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/435: dwrite d10/f75 [0,4194304] 0 2024-03-04T09:31:16.654 INFO:tasks.workunit.client.0.smithi046.stdout:6/520: dwrite da/dd/d46/f72 [0,4194304] 0 2024-03-04T09:31:16.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/520: getdents d1/d11/d6/d8/d1d/d34/d4d/d7e 0 2024-03-04T09:31:16.821 INFO:tasks.workunit.client.0.smithi046.stdout:2/497: mknod d5/d38/d54/ca9 0 2024-03-04T09:31:16.856 INFO:tasks.workunit.client.0.smithi046.stdout:2/498: write d5/da/f23 [1903068,129878] 0 2024-03-04T09:31:16.894 INFO:tasks.workunit.client.0.smithi046.stdout:2/499: dread d5/d2c/f9c [0,4194304] 0 2024-03-04T09:31:16.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/509: mkdir d1/d1d/d27/da9 0 2024-03-04T09:31:16.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/510: readlink d1/d1d/la1 0 2024-03-04T09:31:16.996 INFO:tasks.workunit.client.0.smithi046.stdout:3/511: dread d1/d1d/f6d [0,4194304] 0 2024-03-04T09:31:16.996 INFO:tasks.workunit.client.0.smithi046.stdout:3/512: creat d1/d21/d35/d43/faa x:0 0 0 2024-03-04T09:31:17.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/436: symlink d10/d12/d6e/d99/la1 0 2024-03-04T09:31:17.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/437: chown d10/d12/d52/d5d/f69 1 1 2024-03-04T09:31:17.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/438: dread d10/d36/f40 [0,4194304] 0 2024-03-04T09:31:17.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/439: readlink d10/d12/l7d 0 2024-03-04T09:31:17.348 INFO:tasks.workunit.client.0.smithi046.stdout:6/521: creat da/dd/d39/d60/da0/d67/d64/d56/fb5 x:0 0 0 2024-03-04T09:31:17.501 INFO:tasks.workunit.client.0.smithi046.stdout:9/521: rename d1/d11/d6/d8/d1d/d34/d46/l50 to d1/d11/d3e/la5 0 2024-03-04T09:31:18.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/513: mknod d1/d1d/d27/cab 0 2024-03-04T09:31:18.069 INFO:tasks.workunit.client.0.smithi046.stdout:3/514: dread d1/d21/d35/d24/f1b [0,4194304] 0 2024-03-04T09:31:18.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/440: mkdir d10/d12/d52/d78/d8a/da2 0 2024-03-04T09:31:18.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/515: creat d1/d21/d35/d2b/fac x:0 0 0 2024-03-04T09:31:18.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/441: link d10/d12/d52/d5d/d83/f95 d10/d12/d6e/fa3 0 2024-03-04T09:31:19.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/516: rename d1/d21/d35/d43/f45 to d1/d1d/d27/d40/d70/fad 0 2024-03-04T09:31:19.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/442: mknod d10/d12/d52/d5d/ca4 0 2024-03-04T09:31:19.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/443: readlink d10/d12/l38 0 2024-03-04T09:31:19.414 INFO:tasks.workunit.client.0.smithi046.stdout:5/423: write d1/d3/de/d20/d76/f48 [1864803,1794] 0 2024-03-04T09:31:19.414 INFO:tasks.workunit.client.0.smithi046.stdout:5/424: fdatasync d1/d44/f71 0 2024-03-04T09:31:19.415 INFO:tasks.workunit.client.0.smithi046.stdout:5/425: readlink d1/d44/d69/l73 0 2024-03-04T09:31:19.415 INFO:tasks.workunit.client.0.smithi046.stdout:5/426: fdatasync d1/d44/f71 0 2024-03-04T09:31:19.437 INFO:tasks.workunit.client.0.smithi046.stdout:5/427: write d1/d3/de/f4c [1677670,87955] 0 2024-03-04T09:31:19.440 INFO:tasks.workunit.client.0.smithi046.stdout:5/428: write d1/d3/de/d20/d76/f48 [1422475,36225] 0 2024-03-04T09:31:19.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/429: read - d1/d44/f71 zero size 2024-03-04T09:31:19.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/430: readlink d1/d3/de/d4f/l6d 0 2024-03-04T09:31:19.765 INFO:tasks.workunit.client.0.smithi046.stdout:3/517: creat d1/d1d/d31/d51/da3/fae x:0 0 0 2024-03-04T09:31:19.811 INFO:tasks.workunit.client.0.smithi046.stdout:3/518: dwrite d1/d1d/d27/d4a/f7b [4194304,4194304] 0 2024-03-04T09:31:19.811 INFO:tasks.workunit.client.0.smithi046.stdout:3/519: write d1/d1d/d27/d4a/f65 [282262,104635] 0 2024-03-04T09:31:19.901 INFO:tasks.workunit.client.0.smithi046.stdout:9/522: dwrite d1/d11/d6/d8/d1d/d34/d46/f5f [0,4194304] 0 2024-03-04T09:31:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/500: getdents d5/d38/d54/d8a 0 2024-03-04T09:31:20.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/431: mkdir d1/d44/d81 0 2024-03-04T09:31:20.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:31:20.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:31:20.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/520: mknod d1/d88/caf 0 2024-03-04T09:31:20.804 INFO:tasks.workunit.client.0.smithi046.stdout:9/523: creat d1/d11/d3e/fa6 x:0 0 0 2024-03-04T09:31:20.804 INFO:tasks.workunit.client.0.smithi046.stdout:9/524: dread - d1/d11/d3e/fa6 zero size 2024-03-04T09:31:21.566 INFO:tasks.workunit.client.0.smithi046.stdout:9/525: truncate d1/d11/d6/d8/d1d/d34/d46/d5e/f6a 4073094 0 2024-03-04T09:31:21.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/526: rename d1/d11/d6/d8/d1d/l58 to d1/d11/d6/d8/d1d/d34/d46/la7 0 2024-03-04T09:31:22.095 INFO:tasks.workunit.client.0.smithi046.stdout:8/403: sync 2024-03-04T09:31:22.095 INFO:tasks.workunit.client.0.smithi046.stdout:7/406: sync 2024-03-04T09:31:22.133 INFO:tasks.workunit.client.0.smithi046.stdout:7/407: write d0/d4/db/d12/f1d [1470340,92859] 0 2024-03-04T09:31:22.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/527: link d1/d11/d6/l99 d1/d11/d6/d8/d1d/d34/d4d/la8 0 2024-03-04T09:31:22.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/528: chown d1/d11/d6/d8/d12/d1c/c4f 2424 1 2024-03-04T09:31:22.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/529: chown d1/d11/d6/d8/d36/c87 120855695 1 2024-03-04T09:31:22.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/530: readlink d1/d11/d6/d8/d1d/d34/d4d/la8 0 2024-03-04T09:31:22.664 INFO:tasks.workunit.client.0.smithi046.stdout:7/408: mkdir d0/d2d/d85 0 2024-03-04T09:31:22.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/531: mknod d1/d11/d6/d8/d6f/ca9 0 2024-03-04T09:31:22.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/409: creat d0/d4/f86 x:0 0 0 2024-03-04T09:31:22.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/410: creat d0/d4/db/d3b/f87 x:0 0 0 2024-03-04T09:31:22.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/411: chown d0/d4/d40 0 1 2024-03-04T09:31:22.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/412: chown d0/d3c/d5f 3130 1 2024-03-04T09:31:22.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/413: fsync d0/d3c/f69 0 2024-03-04T09:31:22.946 INFO:tasks.workunit.client.0.smithi046.stdout:7/414: fdatasync d0/d3c/f69 0 2024-03-04T09:31:23.139 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:42:33.946 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.154 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:42:33.961 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.207 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:34.078 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.210 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:34.081 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.247 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:42:34.117 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.249 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:42:34.120 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.250 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:34.121 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.263 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:42:34.071 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.286 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:42:34.157 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:31:23.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/404: link d7/de/d13/d2c/f45 d7/de/d13/d2c/d62/f8d 0 2024-03-04T09:31:24.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/415: creat d0/da/d4e/f88 x:0 0 0 2024-03-04T09:31:24.001 INFO:tasks.workunit.client.0.smithi046.stdout:7/416: write d0/d4/db/d3b/f7c [781242,54779] 0 2024-03-04T09:31:24.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/405: write d7/de/d13/d2c/f31 [3204516,121524] 0 2024-03-04T09:31:24.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/406: stat d7/de/d28/f37 0 2024-03-04T09:31:24.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/407: chown d7/de/d28/d36/d7c 1 1 2024-03-04T09:31:24.084 INFO:tasks.workunit.client.0.smithi046.stdout:8/408: dwrite d7/de/d12/f43 [0,4194304] 0 2024-03-04T09:31:24.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/494: mkdir d0/db5 0 2024-03-04T09:31:24.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/522: creat da/d14/d1e/fb6 x:0 0 0 2024-03-04T09:31:24.278 INFO:tasks.workunit.client.0.smithi046.stdout:4/495: dwrite d0/d5f/f86 [0,4194304] 0 2024-03-04T09:31:24.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/496: read d0/d3/d16/d1e/d73/f89 [3989323,88397] 0 2024-03-04T09:31:24.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/497: dread - d0/d3/d20/d96/d6e/f81 zero size 2024-03-04T09:31:24.335 INFO:tasks.workunit.client.0.smithi046.stdout:4/498: dread d0/d5f/d6f/f7f [0,4194304] 0 2024-03-04T09:31:24.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/499: dwrite d0/d3/d16/d1e/d73/f89 [0,4194304] 0 2024-03-04T09:31:24.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/500: fsync d0/d1f/d35/f84 0 2024-03-04T09:31:24.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/501: write d0/d3/d16/d1e/d73/f99 [926012,18011] 0 2024-03-04T09:31:24.715 INFO:tasks.workunit.client.0.smithi046.stdout:7/417: symlink d0/d2d/d85/l89 0 2024-03-04T09:31:24.715 INFO:tasks.workunit.client.0.smithi046.stdout:7/418: read d0/d4/d40/f49 [569433,3948] 0 2024-03-04T09:31:25.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/501: write d5/f13 [4205298,16108] 0 2024-03-04T09:31:25.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/409: link d7/de/f1b d7/de/d28/d3a/d6f/d84/f8e 0 2024-03-04T09:31:25.626 INFO:tasks.workunit.client.0.smithi046.stdout:4/502: creat d0/d1f/fb6 x:0 0 0 2024-03-04T09:31:25.701 INFO:tasks.workunit.client.0.smithi046.stdout:1/406: unlink d1/f4c 0 2024-03-04T09:31:25.703 INFO:tasks.workunit.client.0.smithi046.stdout:7/419: mknod d0/d3c/c8a 0 2024-03-04T09:31:25.703 INFO:tasks.workunit.client.0.smithi046.stdout:7/420: creat d0/da/d46/f8b x:0 0 0 2024-03-04T09:31:25.703 INFO:tasks.workunit.client.0.smithi046.stdout:7/421: write d0/d3c/d5f/f6c [1041563,7531] 0 2024-03-04T09:31:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:4/503: dwrite d0/d3/d20/d96/fa0 [0,4194304] 0 2024-03-04T09:31:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:4/504: fsync d0/d1f/d35/f6b 0 2024-03-04T09:31:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:4/505: chown d0/d1f/l47 0 1 2024-03-04T09:31:26.537 INFO:tasks.workunit.client.0.smithi046.stdout:3/521: mkdir d1/db0 0 2024-03-04T09:31:26.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/410: link d7/de/l47 d7/de/d28/d3a/d6f/l8f 0 2024-03-04T09:31:26.869 INFO:tasks.workunit.client.0.smithi046.stdout:2/502: getdents d5/d2c/d51/d7f 0 2024-03-04T09:31:26.956 INFO:tasks.workunit.client.0.smithi046.stdout:1/407: mknod d1/d28/c83 0 2024-03-04T09:31:27.275 INFO:tasks.workunit.client.0.smithi046.stdout:7/422: rmdir d0/d4/db 39 2024-03-04T09:31:27.511 INFO:tasks.workunit.client.0.smithi046.stdout:4/506: rename d0/d1f/l2a to d0/d1f/d25/da6/lb7 0 2024-03-04T09:31:27.562 INFO:tasks.workunit.client.0.smithi046.stdout:4/507: dwrite d0/d1f/d35/f84 [0,4194304] 0 2024-03-04T09:31:27.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/522: mknod d1/d21/cb1 0 2024-03-04T09:31:27.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/523: dwrite d1/f20 [0,4194304] 0 2024-03-04T09:31:27.788 INFO:tasks.workunit.client.0.smithi046.stdout:3/524: dwrite d1/d21/d35/d43/f63 [0,4194304] 0 2024-03-04T09:31:27.915 INFO:tasks.workunit.client.0.smithi046.stdout:2/503: mkdir d5/d84/d88/d99/daa 0 2024-03-04T09:31:27.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/411: rmdir d7/de/d12/d86 0 2024-03-04T09:31:28.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/423: link d0/c71 d0/d3c/d5f/c8c 0 2024-03-04T09:31:28.923 INFO:tasks.workunit.client.0.smithi046.stdout:2/504: getdents d5/d84 0 2024-03-04T09:31:28.923 INFO:tasks.workunit.client.0.smithi046.stdout:2/505: fdatasync d5/d84/d88/d47/f67 0 2024-03-04T09:31:28.938 INFO:tasks.workunit.client.0.smithi046.stdout:9/532: symlink d1/d11/d6/d8/laa 0 2024-03-04T09:31:28.938 INFO:tasks.workunit.client.0.smithi046.stdout:7/424: mknod d0/d4/db/d12/c8d 0 2024-03-04T09:31:28.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/425: write d0/d4/db/d3b/f7c [420565,98150] 0 2024-03-04T09:31:28.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/426: dread - d0/da/f7d zero size 2024-03-04T09:31:28.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/427: chown d0/d4/db/d3b/l7a 72 1 2024-03-04T09:31:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/444: sync 2024-03-04T09:31:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/445: truncate d10/d12/f82 303705 0 2024-03-04T09:31:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/446: chown d10/d12/f2a 8508 1 2024-03-04T09:31:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/447: chown d10/d12/c73 1003188 1 2024-03-04T09:31:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/448: dread - d10/f96 zero size 2024-03-04T09:31:29.277 INFO:tasks.workunit.client.0.smithi046.stdout:0/449: dwrite d10/d12/f21 [0,4194304] 0 2024-03-04T09:31:29.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/523: creat da/dd/d39/fb7 x:0 0 0 2024-03-04T09:31:29.752 INFO:tasks.workunit.client.0.smithi046.stdout:3/525: rmdir d1/d1d/d31/d51 39 2024-03-04T09:31:29.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/526: dwrite d1/d74/f99 [0,4194304] 0 2024-03-04T09:31:29.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/527: creat d1/d1d/d27/d4a/fb2 x:0 0 0 2024-03-04T09:31:30.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/428: rmdir d0/d4/db/d12/d28 39 2024-03-04T09:31:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:0/450: creat d10/d12/d6e/fa5 x:0 0 0 2024-03-04T09:31:30.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/528: creat d1/d21/d35/fb3 x:0 0 0 2024-03-04T09:31:30.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/529: creat d1/d1d/d27/d40/d76/fb4 x:0 0 0 2024-03-04T09:31:30.913 INFO:tasks.workunit.client.0.smithi046.stdout:1/408: dwrite d1/f33 [0,4194304] 0 2024-03-04T09:31:31.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/451: mkdir d10/d12/d9f/da6 0 2024-03-04T09:31:31.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/452: stat d10/d12/d1f/l37 0 2024-03-04T09:31:31.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/524: getdents da/d14/d1e 0 2024-03-04T09:31:31.603 INFO:tasks.workunit.client.0.smithi046.stdout:5/432: creat d1/f82 x:0 0 0 2024-03-04T09:31:31.933 INFO:tasks.workunit.client.0.smithi046.stdout:1/409: mknod d1/d28/d6f/c84 0 2024-03-04T09:31:32.466 INFO:tasks.workunit.client.0.smithi046.stdout:7/429: symlink d0/d58/l8e 0 2024-03-04T09:31:32.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/410: link d1/l20 d1/d28/d6a/l85 0 2024-03-04T09:31:32.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/453: truncate d10/d12/d52/d5d/d83/f95 1679087 0 2024-03-04T09:31:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/533: dwrite d1/d11/d6/d8/d1d/d34/d46/d5e/f8d [0,4194304] 0 2024-03-04T09:31:34.331 INFO:tasks.workunit.client.0.smithi046.stdout:4/508: sync 2024-03-04T09:31:34.331 INFO:tasks.workunit.client.0.smithi046.stdout:4/509: stat d0/d3/c82 0 2024-03-04T09:31:34.348 INFO:tasks.workunit.client.0.smithi046.stdout:4/510: dread d0/d8e/f93 [0,4194304] 0 2024-03-04T09:31:34.374 INFO:tasks.workunit.client.0.smithi046.stdout:1/411: rmdir d1/d28/d6f 39 2024-03-04T09:31:34.374 INFO:tasks.workunit.client.0.smithi046.stdout:6/525: write da/dd/d22/f70 [927289,8868] 0 2024-03-04T09:31:34.374 INFO:tasks.workunit.client.0.smithi046.stdout:1/412: write d1/f2d [125106,75926] 0 2024-03-04T09:31:34.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/433: write d1/d3/de/d20/f3b [68811,87643] 0 2024-03-04T09:31:34.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/434: fdatasync d1/d5f/f60 0 2024-03-04T09:31:34.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/412: rename d7/l3b to d7/de/d4c/d5a/l90 0 2024-03-04T09:31:34.407 INFO:tasks.workunit.client.0.smithi046.stdout:1/413: write d1/f25 [4011912,101545] 0 2024-03-04T09:31:34.439 INFO:tasks.workunit.client.0.smithi046.stdout:5/435: dwrite d1/d3/de/d4f/f77 [0,4194304] 0 2024-03-04T09:31:34.439 INFO:tasks.workunit.client.0.smithi046.stdout:5/436: dread - d1/d3/de/d20/d76/d6c/d7b/f43 zero size 2024-03-04T09:31:34.442 INFO:tasks.workunit.client.0.smithi046.stdout:6/526: dwrite da/dd/d39/d60/da0/d67/fa8 [0,4194304] 0 2024-03-04T09:31:34.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/437: write d1/d3/de/f49 [7996986,18383] 0 2024-03-04T09:31:34.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/438: dread d1/f5 [0,4194304] 0 2024-03-04T09:31:34.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/439: write d1/d3/de/d1d/f33 [92048,102044] 0 2024-03-04T09:31:34.489 INFO:tasks.workunit.client.0.smithi046.stdout:5/440: dread d1/d3/de/d1d/f33 [0,4194304] 0 2024-03-04T09:31:34.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/441: dread d1/d5f/f60 [0,4194304] 0 2024-03-04T09:31:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/413: link d7/fd d7/de/d3e/f91 0 2024-03-04T09:31:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/414: chown d7/de/d28/d36/l4b 60 1 2024-03-04T09:31:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/415: truncate d7/de/d12/f59 357284 0 2024-03-04T09:31:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/416: dread - d7/de/d4c/d50/f85 zero size 2024-03-04T09:31:35.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/530: sync 2024-03-04T09:31:35.182 INFO:tasks.workunit.client.0.smithi046.stdout:6/527: symlink da/d14/d1e/d27/d8c/lb8 0 2024-03-04T09:31:35.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/511: getdents d0/d1f 0 2024-03-04T09:31:35.454 INFO:tasks.workunit.client.0.smithi046.stdout:2/506: rename d5/d84/d88/f2f to d5/da/fab 0 2024-03-04T09:31:35.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/417: getdents d7/de/d28/d36/d7c/d89 0 2024-03-04T09:31:35.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/531: stat d1/d1d/d31/d51/l5f 0 2024-03-04T09:31:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:6/528: unlink da/dd/d39/c9d 0 2024-03-04T09:31:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:6/529: stat da/d14/l3b 0 2024-03-04T09:31:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:6/530: chown da/d14/l2d 2902101 1 2024-03-04T09:31:35.918 INFO:tasks.workunit.client.0.smithi046.stdout:4/512: creat d0/d3/d3b/d8d/fb8 x:0 0 0 2024-03-04T09:31:36.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/507: getdents d5/d84/d7c 0 2024-03-04T09:31:36.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/532: mknod d1/d21/d35/d43/cb5 0 2024-03-04T09:31:36.722 INFO:tasks.workunit.client.0.smithi046.stdout:6/531: creat da/d14/fb9 x:0 0 0 2024-03-04T09:31:36.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/532: dwrite da/dd/f36 [0,4194304] 0 2024-03-04T09:31:36.905 INFO:tasks.workunit.client.0.smithi046.stdout:6/533: dwrite da/d14/d1e/d27/d78/d66/fad [0,4194304] 0 2024-03-04T09:31:36.905 INFO:tasks.workunit.client.0.smithi046.stdout:6/534: write da/d14/d1e/d2c/f63 [118733,93828] 0 2024-03-04T09:31:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/508: symlink d5/d84/d88/lac 0 2024-03-04T09:31:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/509: fdatasync d5/d40/f72 0 2024-03-04T09:31:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/510: fdatasync d5/d84/d88/d3f/f52 0 2024-03-04T09:31:37.553 INFO:tasks.workunit.client.0.smithi046.stdout:8/418: truncate d7/f23 238598 0 2024-03-04T09:31:37.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/419: dwrite d7/de/d13/f35 [0,4194304] 0 2024-03-04T09:31:37.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/420: read d7/f46 [2935338,78962] 0 2024-03-04T09:31:37.875 INFO:tasks.workunit.client.0.smithi046.stdout:7/430: rename d0/d3c/d5f to d0/d8f 0 2024-03-04T09:31:37.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/431: read - d0/da/f7d zero size 2024-03-04T09:31:37.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/432: chown d0/d4/db/d12/f34 4979 1 2024-03-04T09:31:37.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/433: dread - d0/da/f7f zero size 2024-03-04T09:31:37.908 INFO:tasks.workunit.client.0.smithi046.stdout:7/434: read d0/d4/fd [422862,96908] 0 2024-03-04T09:31:37.985 INFO:tasks.workunit.client.0.smithi046.stdout:7/435: dwrite d0/f79 [0,4194304] 0 2024-03-04T09:31:38.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/513: mkdir d0/d1f/db9 0 2024-03-04T09:31:38.719 INFO:tasks.workunit.client.0.smithi046.stdout:6/535: creat da/d14/d1e/d27/d4a/fba x:0 0 0 2024-03-04T09:31:38.719 INFO:tasks.workunit.client.0.smithi046.stdout:2/511: read d5/da/d1b/f36 [196481,40598] 0 2024-03-04T09:31:38.719 INFO:tasks.workunit.client.0.smithi046.stdout:2/512: creat d5/d2c/d51/fad x:0 0 0 2024-03-04T09:31:38.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/513: dread d5/d38/f76 [0,4194304] 0 2024-03-04T09:31:39.011 INFO:tasks.workunit.client.0.smithi046.stdout:0/454: rename d10/f75 to d10/d36/d7a/fa7 0 2024-03-04T09:31:39.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/436: mknod d0/d2d/d85/c90 0 2024-03-04T09:31:39.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/437: dwrite d0/d3c/f69 [0,4194304] 0 2024-03-04T09:31:40.150 INFO:tasks.workunit.client.0.smithi046.stdout:2/514: truncate d5/da/d1b/f25 4027598 0 2024-03-04T09:31:40.150 INFO:tasks.workunit.client.0.smithi046.stdout:9/534: rename d1/d11/d6/d8/d36/l54 to d1/d11/d6/d8/d12/lab 0 2024-03-04T09:31:40.179 INFO:tasks.workunit.client.0.smithi046.stdout:7/438: symlink d0/d4/db/l91 0 2024-03-04T09:31:40.185 INFO:tasks.workunit.client.0.smithi046.stdout:0/455: truncate d10/d12/d1f/d3f/f65 203211 0 2024-03-04T09:31:40.194 INFO:tasks.workunit.client.0.smithi046.stdout:2/515: dread d5/fd [0,4194304] 0 2024-03-04T09:31:40.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/456: dwrite fe [0,4194304] 0 2024-03-04T09:31:40.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/535: dwrite d1/d11/d6/d8/d1d/d34/d46/f80 [0,4194304] 0 2024-03-04T09:31:40.578 INFO:tasks.workunit.client.0.smithi046.stdout:8/421: truncate d7/de/d12/f59 670966 0 2024-03-04T09:31:40.662 INFO:tasks.workunit.client.0.smithi046.stdout:8/422: dwrite d7/de/d3e/f91 [0,4194304] 0 2024-03-04T09:31:40.683 INFO:tasks.workunit.client.0.smithi046.stdout:8/423: write d7/de/f21 [4408206,9868] 0 2024-03-04T09:31:40.683 INFO:tasks.workunit.client.0.smithi046.stdout:8/424: truncate d7/de/d13/f35 4650953 0 2024-03-04T09:31:40.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/414: rename d1/d28/d6f/l77 to d1/d28/d6a/l86 0 2024-03-04T09:31:40.754 INFO:tasks.workunit.client.0.smithi046.stdout:1/415: dwrite d1/f68 [0,4194304] 0 2024-03-04T09:31:41.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/516: mkdir d5/d84/d7c/dae 0 2024-03-04T09:31:41.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/517: dwrite d5/d38/d54/f7a [0,4194304] 0 2024-03-04T09:31:41.217 INFO:tasks.workunit.client.0.smithi046.stdout:9/536: creat d1/d11/fac x:0 0 0 2024-03-04T09:31:41.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/425: mknod d7/de/d13/d2c/d62/c92 0 2024-03-04T09:31:41.693 INFO:tasks.workunit.client.0.smithi046.stdout:8/426: read d7/de/d28/f37 [2420122,118066] 0 2024-03-04T09:31:41.716 INFO:tasks.workunit.client.0.smithi046.stdout:3/533: sync 2024-03-04T09:31:41.954 INFO:tasks.workunit.client.0.smithi046.stdout:1/416: truncate d1/f23 2747420 0 2024-03-04T09:31:42.059 INFO:tasks.workunit.client.0.smithi046.stdout:7/439: creat d0/d4/db/d12/d28/f92 x:0 0 0 2024-03-04T09:31:42.220 INFO:tasks.workunit.client.0.smithi046.stdout:2/518: truncate d5/d84/d88/d47/f5c 965599 0 2024-03-04T09:31:42.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/427: mkdir d7/d53/d72/d93 0 2024-03-04T09:31:42.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/534: creat d1/d74/fb6 x:0 0 0 2024-03-04T09:31:42.942 INFO:tasks.workunit.client.0.smithi046.stdout:1/417: truncate d1/f48 908301 0 2024-03-04T09:31:42.942 INFO:tasks.workunit.client.0.smithi046.stdout:1/418: chown d1/f49 1 1 2024-03-04T09:31:42.942 INFO:tasks.workunit.client.0.smithi046.stdout:1/419: read d1/d28/f38 [1313460,94141] 0 2024-03-04T09:31:43.374 INFO:tasks.workunit.client.0.smithi046.stdout:3/535: symlink d1/d1d/d27/lb7 0 2024-03-04T09:31:43.464 INFO:tasks.workunit.client.0.smithi046.stdout:1/420: mknod d1/d28/d6f/d74/c87 0 2024-03-04T09:31:43.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/421: write d1/d28/d6a/f70 [732141,96348] 0 2024-03-04T09:31:43.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/422: fdatasync d1/d28/f37 0 2024-03-04T09:31:43.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/423: read d1/f21 [3240850,76594] 0 2024-03-04T09:31:43.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/440: link d0/d4/f36 d0/d4/db/d38/d64/f93 0 2024-03-04T09:31:43.816 INFO:tasks.workunit.client.0.smithi046.stdout:3/536: creat d1/d1d/fb8 x:0 0 0 2024-03-04T09:31:43.817 INFO:tasks.workunit.client.0.smithi046.stdout:3/537: chown d1/d1d/d27/d40/f5a 770 1 2024-03-04T09:31:43.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/424: creat d1/d28/d6f/d74/f88 x:0 0 0 2024-03-04T09:31:44.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/441: mkdir d0/d4/db/d38/d94 0 2024-03-04T09:31:44.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/442: chown d0/d4/db/d38/f57 4 1 2024-03-04T09:31:44.179 INFO:tasks.workunit.client.0.smithi046.stdout:7/443: dwrite d0/d4/d40/f49 [0,4194304] 0 2024-03-04T09:31:44.264 INFO:tasks.workunit.client.0.smithi046.stdout:3/538: mknod d1/d88/cb9 0 2024-03-04T09:31:44.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/444: truncate d0/d4/db/d38/f3f 751329 0 2024-03-04T09:31:44.813 INFO:tasks.workunit.client.0.smithi046.stdout:3/539: mknod d1/cba 0 2024-03-04T09:31:44.843 INFO:tasks.workunit.client.0.smithi046.stdout:3/540: dread d1/d21/d35/d43/f64 [0,4194304] 0 2024-03-04T09:31:44.843 INFO:tasks.workunit.client.0.smithi046.stdout:3/541: write d1/d1d/d27/d4a/fb2 [99229,89264] 0 2024-03-04T09:31:44.915 INFO:tasks.workunit.client.0.smithi046.stdout:3/542: dwrite d1/d1d/f37 [0,4194304] 0 2024-03-04T09:31:44.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/543: dread d1/f3f [0,4194304] 0 2024-03-04T09:31:45.185 INFO:tasks.workunit.client.0.smithi046.stdout:1/425: rename d1/f44 to d1/f89 0 2024-03-04T09:31:45.201 INFO:tasks.workunit.client.0.smithi046.stdout:1/426: dread d1/f2d [0,4194304] 0 2024-03-04T09:31:45.202 INFO:tasks.workunit.client.0.smithi046.stdout:6/536: sync 2024-03-04T09:31:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/445: creat d0/da/d41/f95 x:0 0 0 2024-03-04T09:31:45.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/457: sync 2024-03-04T09:31:45.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/544: truncate d1/d1d/d31/f52 29599 0 2024-03-04T09:31:46.420 INFO:tasks.workunit.client.0.smithi046.stdout:9/537: dwrite d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 [0,4194304] 0 2024-03-04T09:31:46.768 INFO:tasks.workunit.client.0.smithi046.stdout:6/537: rmdir da/dd/d39 39 2024-03-04T09:31:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/538: dread da/d14/d1e/d27/d4a/f6f [0,4194304] 0 2024-03-04T09:31:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/446: symlink d0/d58/l96 0 2024-03-04T09:31:47.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/458: creat d10/d12/d6e/d99/fa8 x:0 0 0 2024-03-04T09:31:47.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/459: fdatasync d10/d12/d52/d78/f6d 0 2024-03-04T09:31:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:0/460: dread d10/f22 [4194304,4194304] 0 2024-03-04T09:31:47.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/545: symlink d1/d1d/d5e/lbb 0 2024-03-04T09:31:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/546: chown d1/d1d/d27/d4a/f7b 18496 1 2024-03-04T09:31:47.258 INFO:tasks.workunit.client.0.smithi046.stdout:3/547: dread d1/d21/d35/d43/f62 [0,4194304] 0 2024-03-04T09:31:47.297 INFO:tasks.workunit.client.0.smithi046.stdout:8/428: truncate d7/de/d3e/f91 3112489 0 2024-03-04T09:31:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:8/429: write d7/de/f4a [1736039,53847] 0 2024-03-04T09:31:48.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/539: creat da/dd/d39/d60/da0/d67/d64/d82/fbb x:0 0 0 2024-03-04T09:31:48.184 INFO:tasks.workunit.client.0.smithi046.stdout:3/548: rmdir d1/d1d/d27/da9 0 2024-03-04T09:31:48.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/549: truncate d1/d1d/d31/d51/da3/fae 383961 0 2024-03-04T09:31:48.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/550: dread - d1/d1d/d31/d51/f9d zero size 2024-03-04T09:31:48.191 INFO:tasks.workunit.client.0.smithi046.stdout:3/551: write d1/d1d/fb8 [537375,130519] 0 2024-03-04T09:31:48.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/540: dwrite da/dd/d39/fb7 [0,4194304] 0 2024-03-04T09:31:48.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/541: dread da/dd/f2a [0,4194304] 0 2024-03-04T09:31:48.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/542: readlink da/dd/d39/d60/l9a 0 2024-03-04T09:31:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/430: symlink d7/d53/d72/l94 0 2024-03-04T09:31:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/431: readlink d7/de/d12/l5d 0 2024-03-04T09:31:48.636 INFO:tasks.workunit.client.0.smithi046.stdout:7/447: creat d0/d4/db/d3b/d6b/f97 x:0 0 0 2024-03-04T09:31:48.636 INFO:tasks.workunit.client.0.smithi046.stdout:3/552: mkdir d1/d1d/d31/d9a/dbc 0 2024-03-04T09:31:48.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/553: dwrite d1/d1d/d31/f3e [0,4194304] 0 2024-03-04T09:31:48.707 INFO:tasks.workunit.client.0.smithi046.stdout:6/543: symlink da/d14/d1e/d27/d78/d66/d81/lbc 0 2024-03-04T09:31:48.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/432: creat d7/de/d13/d3c/f95 x:0 0 0 2024-03-04T09:31:48.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/544: dwrite da/dd/d39/d60/da0/f5a [0,4194304] 0 2024-03-04T09:31:48.905 INFO:tasks.workunit.client.0.smithi046.stdout:7/448: mknod d0/da/d4e/c98 0 2024-03-04T09:31:49.810 INFO:tasks.workunit.client.0.smithi046.stdout:6/545: symlink da/dd/d39/d60/lbd 0 2024-03-04T09:31:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/449: mkdir d0/da/d46/d99 0 2024-03-04T09:31:49.881 INFO:tasks.workunit.client.0.smithi046.stdout:3/554: truncate d1/d1d/d27/f2d 919492 0 2024-03-04T09:31:49.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/555: dwrite d1/d1d/d31/d51/da3/fae [0,4194304] 0 2024-03-04T09:31:50.165 INFO:tasks.workunit.client.0.smithi046.stdout:1/427: dwrite d1/d28/f30 [0,4194304] 0 2024-03-04T09:31:50.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:31:50.575 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:31:51.818 INFO:tasks.workunit.client.0.smithi046.stdout:8/433: write d7/f23 [505117,41328] 0 2024-03-04T09:31:52.118 INFO:tasks.workunit.client.0.smithi046.stdout:5/442: rename d1/d3/c11 to d1/d44/c83 0 2024-03-04T09:31:52.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/443: dwrite d1/d5f/f60 [0,4194304] 0 2024-03-04T09:31:52.407 INFO:tasks.workunit.client.0.smithi046.stdout:4/514: rename d0/d5f/d6f/d8c to d0/d1f/d25/d50/dba 0 2024-03-04T09:31:52.407 INFO:tasks.workunit.client.0.smithi046.stdout:4/515: chown d0/d3/d20/d96/d6e/d85/l87 352794 1 2024-03-04T09:31:52.407 INFO:tasks.workunit.client.0.smithi046.stdout:4/516: dread - d0/d1f/d25/d50/fae zero size 2024-03-04T09:31:52.633 INFO:tasks.workunit.client.0.smithi046.stdout:5/444: mknod d1/d44/d57/c84 0 2024-03-04T09:31:52.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/519: rename d5/da/d1b/l3c to d5/d84/d7c/dae/laf 0 2024-03-04T09:31:52.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/520: chown d5/d84/d88/d99 29416 1 2024-03-04T09:31:52.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/521: write d5/d84/d88/d3f/f8e [418964,48562] 0 2024-03-04T09:31:52.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/522: dread - d5/d2c/d51/d61/f64 zero size 2024-03-04T09:31:52.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/523: dread - d5/d38/fa7 zero size 2024-03-04T09:31:52.832 INFO:tasks.workunit.client.0.smithi046.stdout:4/517: mknod d0/d5f/da2/cbb 0 2024-03-04T09:31:52.832 INFO:tasks.workunit.client.0.smithi046.stdout:4/518: fdatasync d0/d1f/d25/d50/fae 0 2024-03-04T09:31:52.832 INFO:tasks.workunit.client.0.smithi046.stdout:4/519: fsync d0/d3/d3b/d8d/fa3 0 2024-03-04T09:31:52.862 INFO:tasks.workunit.client.0.smithi046.stdout:4/520: dread d0/d1f/f48 [0,4194304] 0 2024-03-04T09:31:52.932 INFO:tasks.workunit.client.0.smithi046.stdout:4/521: dwrite d0/d1f/d25/f9c [4194304,4194304] 0 2024-03-04T09:31:53.031 INFO:tasks.workunit.client.0.smithi046.stdout:3/556: write d1/d21/d35/d43/f62 [1064459,46654] 0 2024-03-04T09:31:53.032 INFO:tasks.workunit.client.0.smithi046.stdout:5/445: symlink d1/d3/de/d20/d76/d6c/d7b/l85 0 2024-03-04T09:31:53.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/557: dwrite d1/d21/d35/d43/f64 [0,4194304] 0 2024-03-04T09:31:53.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/558: dread d1/d1d/d27/d40/d76/d8d/d95/f87 [0,4194304] 0 2024-03-04T09:31:53.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/559: write d1/d74/fb6 [1008212,112394] 0 2024-03-04T09:31:53.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/560: readlink d1/d1d/d27/d4a/d78/l80 0 2024-03-04T09:31:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/561: dwrite d1/d1d/d27/d40/f5a [0,4194304] 0 2024-03-04T09:31:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/562: truncate d1/d74/f98 81924 0 2024-03-04T09:31:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/563: creat d1/d21/d35/d43/fbd x:0 0 0 2024-03-04T09:31:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/564: readlink d1/d1d/d27/d40/d70/d7d/l7e 0 2024-03-04T09:31:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/565: truncate d1/d1d/f7a 496036 0 2024-03-04T09:31:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/566: creat d1/d1d/d5e/fbe x:0 0 0 2024-03-04T09:31:53.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/461: rename d10/d12/f2a to d10/d12/d52/d78/d8a/da2/fa9 0 2024-03-04T09:31:53.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/462: write d10/d12/f4f [8402979,23660] 0 2024-03-04T09:31:53.263 INFO:tasks.workunit.client.0.smithi046.stdout:4/522: truncate d0/d3/d20/f38 2597820 0 2024-03-04T09:31:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:0/463: dwrite d10/d12/d52/d78/f50 [0,4194304] 0 2024-03-04T09:31:53.370 INFO:tasks.workunit.client.0.smithi046.stdout:4/523: dwrite d0/d1f/d25/d7b/f92 [0,4194304] 0 2024-03-04T09:31:54.001 INFO:tasks.workunit.client.0.smithi046.stdout:1/428: sync 2024-03-04T09:31:54.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/538: sync 2024-03-04T09:31:54.036 INFO:tasks.workunit.client.0.smithi046.stdout:1/429: dread d1/f17 [0,4194304] 0 2024-03-04T09:31:54.102 INFO:tasks.workunit.client.0.smithi046.stdout:1/430: dwrite d1/f33 [0,4194304] 0 2024-03-04T09:31:54.103 INFO:tasks.workunit.client.0.smithi046.stdout:1/431: write d1/f25 [1068404,105187] 0 2024-03-04T09:31:54.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/567: dread d1/d1d/d27/f2e [0,4194304] 0 2024-03-04T09:31:54.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/568: readlink d1/d21/d35/d24/la4 0 2024-03-04T09:31:54.637 INFO:tasks.workunit.client.0.smithi046.stdout:6/546: rename da/d14/d1e/d27/d4a/fba to da/d14/d1e/d27/d4a/d94/fbe 0 2024-03-04T09:31:54.668 INFO:tasks.workunit.client.0.smithi046.stdout:6/547: write da/d14/d1e/d27/d4b/f75 [2074797,3902] 0 2024-03-04T09:31:55.093 INFO:tasks.workunit.client.0.smithi046.stdout:5/446: write d1/d3/f29 [2704125,81460] 0 2024-03-04T09:31:55.310 INFO:tasks.workunit.client.0.smithi046.stdout:0/464: mknod d10/caa 0 2024-03-04T09:31:55.310 INFO:tasks.workunit.client.0.smithi046.stdout:4/524: chown d0/c58 7 1 2024-03-04T09:31:55.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/539: mkdir d1/dad 0 2024-03-04T09:31:55.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/540: dread - d1/d11/d6/d8/d6f/f82 zero size 2024-03-04T09:31:55.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/525: dwrite d0/d1f/f45 [4194304,4194304] 0 2024-03-04T09:31:55.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/541: dwrite d1/d11/d6/d8/d12/f29 [0,4194304] 0 2024-03-04T09:31:55.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/542: stat d1/d11/d6/d8/d1d/d34/d46/l5c 0 2024-03-04T09:31:55.502 INFO:tasks.workunit.client.0.smithi046.stdout:1/432: mknod d1/d28/d6a/c8a 0 2024-03-04T09:31:55.502 INFO:tasks.workunit.client.0.smithi046.stdout:3/569: truncate d1/d1d/d27/d4a/f55 1662128 0 2024-03-04T09:31:55.946 INFO:tasks.workunit.client.0.smithi046.stdout:7/450: rename d0/da/f7f to d0/d2d/d85/f9a 0 2024-03-04T09:31:55.946 INFO:tasks.workunit.client.0.smithi046.stdout:7/451: fsync d0/f11 0 2024-03-04T09:31:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:6/548: mkdir da/d14/d1e/d27/d8c/dbf 0 2024-03-04T09:31:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/447: mkdir d1/d44/d57/d70/d86 0 2024-03-04T09:31:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/448: truncate d1/d44/f71 482364 0 2024-03-04T09:31:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/449: chown d1/d3/de/d20 0 1 2024-03-04T09:31:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/450: write d1/f7 [337002,72190] 0 2024-03-04T09:31:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/451: truncate d1/d3/de/d20/f3b 1085840 0 2024-03-04T09:31:56.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/543: mkdir d1/d11/d6/d8/d12/d1c/d26/dae 0 2024-03-04T09:31:56.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/544: read - d1/d11/d3e/fa6 zero size 2024-03-04T09:31:56.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/545: read d1/d11/d6/d8/d1d/d34/d46/d4c/f71 [328627,87270] 0 2024-03-04T09:31:56.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/546: fsync d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 0 2024-03-04T09:31:56.217 INFO:tasks.workunit.client.0.smithi046.stdout:9/547: dwrite d1/d11/d6/d8/d13/d21/f69 [4194304,4194304] 0 2024-03-04T09:31:56.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/434: rename d7/de/d4c/d50/l5e to d7/de/d28/d36/l96 0 2024-03-04T09:31:56.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/435: write d7/f46 [4284644,81611] 0 2024-03-04T09:31:57.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/549: symlink da/dd/d39/d60/dac/daf/lc0 0 2024-03-04T09:31:57.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/550: write da/d14/fb9 [414444,67829] 0 2024-03-04T09:31:57.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/452: unlink d1/d3/d3e/f3f 0 2024-03-04T09:31:57.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/453: fdatasync d1/d3/d3e/f66 0 2024-03-04T09:31:57.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/548: mkdir d1/d11/d6/d8/d1d/d34/d46/d4c/da3/daf 0 2024-03-04T09:31:57.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/549: truncate d1/d11/d6/d8/d1d/d34/d35/f5d 767795 0 2024-03-04T09:31:58.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/524: rename d5/d84/d88/l59 to d5/d38/d54/lb0 0 2024-03-04T09:31:58.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/525: fdatasync d5/f1d 0 2024-03-04T09:31:58.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/526: fdatasync d5/d38/f90 0 2024-03-04T09:31:58.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/436: mknod d7/de/d12/c97 0 2024-03-04T09:31:58.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/454: creat d1/f87 x:0 0 0 2024-03-04T09:31:58.595 INFO:tasks.workunit.client.0.smithi046.stdout:0/465: dwrite d10/d36/f40 [0,4194304] 0 2024-03-04T09:31:58.595 INFO:tasks.workunit.client.0.smithi046.stdout:0/466: creat d10/d12/d6e/fab x:0 0 0 2024-03-04T09:31:58.596 INFO:tasks.workunit.client.0.smithi046.stdout:0/467: fdatasync d10/f5c 0 2024-03-04T09:31:58.698 INFO:tasks.workunit.client.0.smithi046.stdout:9/550: getdents d1/d11/d6/d8/d12/d1c/d26/d91 0 2024-03-04T09:31:58.699 INFO:tasks.workunit.client.0.smithi046.stdout:9/551: write d1/d11/d6/d8/d1d/d34/d35/f76 [222995,77124] 0 2024-03-04T09:31:58.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/570: rename d1/d1d/d27/d40/d70/fad to d1/d74/fbf 0 2024-03-04T09:31:59.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/527: mknod d5/d2c/d51/d61/cb1 0 2024-03-04T09:31:59.201 INFO:tasks.workunit.client.0.smithi046.stdout:8/437: creat d7/de/d4c/f98 x:0 0 0 2024-03-04T09:31:59.201 INFO:tasks.workunit.client.0.smithi046.stdout:8/438: readlink d7/de/d28/d3a/d6f/l8f 0 2024-03-04T09:31:59.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/455: unlink d1/d3/f29 0 2024-03-04T09:31:59.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/456: read d1/d44/f5a [930920,124908] 0 2024-03-04T09:31:59.382 INFO:tasks.workunit.client.0.smithi046.stdout:5/457: dread d1/f5 [0,4194304] 0 2024-03-04T09:31:59.382 INFO:tasks.workunit.client.0.smithi046.stdout:5/458: stat d1/d44/d57/f35 0 2024-03-04T09:31:59.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/552: mknod d1/d11/d6/d8/d1d/d34/d46/d4c/da3/cb0 0 2024-03-04T09:31:59.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/468: truncate d10/d12/f56 409151 0 2024-03-04T09:31:59.895 INFO:tasks.workunit.client.0.smithi046.stdout:9/553: dread d1/d11/d6/d8/d12/d1c/f38 [0,4194304] 0 2024-03-04T09:32:00.031 INFO:tasks.workunit.client.0.smithi046.stdout:3/571: mknod d1/d1d/d31/d51/da3/cc0 0 2024-03-04T09:32:00.080 INFO:tasks.workunit.client.0.smithi046.stdout:2/528: stat d5/da/d1b/c42 0 2024-03-04T09:32:00.081 INFO:tasks.workunit.client.0.smithi046.stdout:4/526: sync 2024-03-04T09:32:00.081 INFO:tasks.workunit.client.0.smithi046.stdout:4/527: write d0/d3/d16/d1e/d73/f9a [3583618,104959] 0 2024-03-04T09:32:00.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/439: truncate f2 2547280 0 2024-03-04T09:32:00.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/440: truncate d7/de/d13/f38 4939187 0 2024-03-04T09:32:00.141 INFO:tasks.workunit.client.0.smithi046.stdout:8/441: chown d7/de/d13/d2c/d62 100 1 2024-03-04T09:32:00.406 INFO:tasks.workunit.client.0.smithi046.stdout:5/459: symlink d1/d3/de/d20/d76/d6c/l88 0 2024-03-04T09:32:00.407 INFO:tasks.workunit.client.0.smithi046.stdout:5/460: chown d1/f7f 19553 1 2024-03-04T09:32:00.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/469: getdents d10/d12/d52/d78/d8a 0 2024-03-04T09:32:00.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/554: rename d1/d11/d6/d8/d1d/d34/d46/d4c/l60 to d1/d11/d6/d8/d6f/d8c/lb1 0 2024-03-04T09:32:00.459 INFO:tasks.workunit.client.0.smithi046.stdout:2/529: chown d5/da/d1b/l32 1382 1 2024-03-04T09:32:00.460 INFO:tasks.workunit.client.0.smithi046.stdout:2/530: dread - d5/d38/f66 zero size 2024-03-04T09:32:00.460 INFO:tasks.workunit.client.0.smithi046.stdout:2/531: write d5/d38/f90 [788643,118594] 0 2024-03-04T09:32:00.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/433: dwrite d1/f19 [0,4194304] 0 2024-03-04T09:32:00.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/434: stat d1/l1c 0 2024-03-04T09:32:00.549 INFO:tasks.workunit.client.0.smithi046.stdout:2/532: dwrite d5/d2c/f93 [0,4194304] 0 2024-03-04T09:32:00.621 INFO:tasks.workunit.client.0.smithi046.stdout:1/435: dwrite d1/fd [0,4194304] 0 2024-03-04T09:32:00.685 INFO:tasks.workunit.client.0.smithi046.stdout:1/436: dwrite d1/f49 [0,4194304] 0 2024-03-04T09:32:00.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/528: getdents d0/d5f/d6f 0 2024-03-04T09:32:00.750 INFO:tasks.workunit.client.0.smithi046.stdout:4/529: write d0/d3/d20/d96/fa0 [3014682,52682] 0 2024-03-04T09:32:00.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/530: chown d0/d3/d16/f5a 4485 1 2024-03-04T09:32:00.947 INFO:tasks.workunit.client.0.smithi046.stdout:7/452: sync 2024-03-04T09:32:00.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/453: write d0/d4/d40/f49 [4998722,91865] 0 2024-03-04T09:32:01.414 INFO:tasks.workunit.client.0.smithi046.stdout:5/461: rename d1/d3/de/d20/d76/d6c/d7b/f28 to d1/d44/d69/f89 0 2024-03-04T09:32:01.415 INFO:tasks.workunit.client.0.smithi046.stdout:9/555: truncate d1/d11/d6/d8/d13/f24 2357815 0 2024-03-04T09:32:02.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/437: mknod d1/d28/d6f/d74/c8b 0 2024-03-04T09:32:02.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/438: creat d1/d28/d6f/d74/f8c x:0 0 0 2024-03-04T09:32:02.337 INFO:tasks.workunit.client.0.smithi046.stdout:4/531: link d0/d1f/d25/da6/lb7 d0/d1f/d25/da6/lbc 0 2024-03-04T09:32:02.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/462: mkdir d1/d5f/d8a 0 2024-03-04T09:32:02.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/463: write d1/d3/de/f10 [1209435,21423] 0 2024-03-04T09:32:03.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/551: write f9 [4995330,11515] 0 2024-03-04T09:32:04.063 INFO:tasks.workunit.client.0.smithi046.stdout:3/572: dwrite d1/d1d/f3a [0,4194304] 0 2024-03-04T09:32:04.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/442: dwrite d7/de/d3e/f91 [0,4194304] 0 2024-03-04T09:32:05.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/533: truncate d5/d2c/f93 1161136 0 2024-03-04T09:32:05.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/534: chown d5/da/d1b 38859 1 2024-03-04T09:32:05.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/439: truncate d1/f21 3862992 0 2024-03-04T09:32:06.244 INFO:tasks.workunit.client.0.smithi046.stdout:4/532: symlink d0/d5f/da2/lbd 0 2024-03-04T09:32:06.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/454: symlink d0/d4/db/d12/d28/l9b 0 2024-03-04T09:32:07.296 INFO:tasks.workunit.client.0.smithi046.stdout:2/535: chown d5/da/d1b/f25 49118 1 2024-03-04T09:32:07.344 INFO:tasks.workunit.client.0.smithi046.stdout:1/440: mkdir d1/d28/d8d 0 2024-03-04T09:32:07.344 INFO:tasks.workunit.client.0.smithi046.stdout:1/441: chown d1/f1d 0 1 2024-03-04T09:32:07.869 INFO:tasks.workunit.client.0.smithi046.stdout:7/455: dwrite d0/d4/db/f2b [4194304,4194304] 0 2024-03-04T09:32:08.188 INFO:tasks.workunit.client.0.smithi046.stdout:4/533: link d0/d3/d3b/l30 d0/d1f/d25/d7b/lbe 0 2024-03-04T09:32:08.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/456: mknod d0/d4/db/d3b/d6b/c9c 0 2024-03-04T09:32:08.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/457: dread d0/d4/db/d3b/f7c [0,4194304] 0 2024-03-04T09:32:08.525 INFO:tasks.workunit.client.0.smithi046.stdout:2/536: truncate d5/f6b 546672 0 2024-03-04T09:32:08.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/534: mknod d0/d3/d20/d96/d6e/d85/cbf 0 2024-03-04T09:32:08.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/535: fsync d0/d3/d16/d1e/d73/f9a 0 2024-03-04T09:32:08.748 INFO:tasks.workunit.client.0.smithi046.stdout:4/536: chown d0/d1f/d25/da9/l75 20 1 2024-03-04T09:32:09.137 INFO:tasks.workunit.client.0.smithi046.stdout:7/458: creat d0/d8f/f9d x:0 0 0 2024-03-04T09:32:09.137 INFO:tasks.workunit.client.0.smithi046.stdout:1/442: getdents d1/d28/d6f/d74 0 2024-03-04T09:32:09.137 INFO:tasks.workunit.client.0.smithi046.stdout:7/459: write d0/d4/db/d3b/d6b/f97 [586207,38762] 0 2024-03-04T09:32:09.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/443: dread d1/f17 [0,4194304] 0 2024-03-04T09:32:09.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/444: write d1/d28/d6a/f70 [136029,109412] 0 2024-03-04T09:32:09.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/537: truncate d5/fd 277073 0 2024-03-04T09:32:09.436 INFO:tasks.workunit.client.0.smithi046.stdout:4/537: creat d0/d1f/db9/fc0 x:0 0 0 2024-03-04T09:32:09.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/538: truncate d5/d2c/d51/d61/f64 107652 0 2024-03-04T09:32:09.519 INFO:tasks.workunit.client.0.smithi046.stdout:4/538: dwrite d0/d1f/d5b/f78 [0,4194304] 0 2024-03-04T09:32:09.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/539: dread d0/d3/f4 [0,4194304] 0 2024-03-04T09:32:09.722 INFO:tasks.workunit.client.0.smithi046.stdout:1/445: rename d1/d28/c62 to d1/d28/c8e 0 2024-03-04T09:32:09.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/446: dread d1/f24 [0,4194304] 0 2024-03-04T09:32:09.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/447: fdatasync d1/fe 0 2024-03-04T09:32:09.837 INFO:tasks.workunit.client.0.smithi046.stdout:1/448: dwrite d1/f79 [0,4194304] 0 2024-03-04T09:32:09.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/573: link d1/d1d/fa7 d1/d21/d35/fc1 0 2024-03-04T09:32:10.373 INFO:tasks.workunit.client.0.smithi046.stdout:4/540: mkdir d0/d3/d16/d1e/da1/dc1 0 2024-03-04T09:32:10.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/541: dread d0/d3/d16/d1e/f36 [0,4194304] 0 2024-03-04T09:32:10.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/574: creat d1/db0/fc2 x:0 0 0 2024-03-04T09:32:10.630 INFO:tasks.workunit.client.0.smithi046.stdout:3/575: write d1/d1d/d27/d40/f5a [4108351,92192] 0 2024-03-04T09:32:10.876 INFO:tasks.workunit.client.0.smithi046.stdout:6/552: write da/dd/f13 [7589954,35775] 0 2024-03-04T09:32:10.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/553: truncate da/dd/d39/d60/da0/d67/d64/d56/fb5 266395 0 2024-03-04T09:32:10.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/554: dread - da/d14/d1e/d27/d78/d66/faa zero size 2024-03-04T09:32:11.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/470: rename d10/f5c to d10/d12/d52/d5d/fac 0 2024-03-04T09:32:11.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/471: dread - d10/d12/d52/d5d/f64 zero size 2024-03-04T09:32:11.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/472: fdatasync d10/f22 0 2024-03-04T09:32:11.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/473: chown d10/d12/f21 2 1 2024-03-04T09:32:11.066 INFO:tasks.workunit.client.0.smithi046.stdout:4/542: link d0/f39 d0/d3/fc2 0 2024-03-04T09:32:11.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/555: unlink da/d14/d1e/d27/f5e 0 2024-03-04T09:32:11.481 INFO:tasks.workunit.client.0.smithi046.stdout:5/464: rename d1/d3/de/d20/d76/d6c/l88 to d1/d44/d57/d70/l8b 0 2024-03-04T09:32:11.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/576: rmdir d1/d1d/d27 39 2024-03-04T09:32:11.687 INFO:tasks.workunit.client.0.smithi046.stdout:0/474: creat d10/d12/d1f/d3f/d7e/fad x:0 0 0 2024-03-04T09:32:11.687 INFO:tasks.workunit.client.0.smithi046.stdout:0/475: stat d10/d12/l13 0 2024-03-04T09:32:11.712 INFO:tasks.workunit.client.0.smithi046.stdout:0/476: dread d10/d36/d7a/fa7 [0,4194304] 0 2024-03-04T09:32:11.712 INFO:tasks.workunit.client.0.smithi046.stdout:0/477: write d10/f26 [3248600,41601] 0 2024-03-04T09:32:12.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/556: mknod da/dd/d39/d60/da0/d67/d64/d56/d86/cc1 0 2024-03-04T09:32:12.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/557: dread - da/dd/d39/d60/da0/fa5 zero size 2024-03-04T09:32:12.342 INFO:tasks.workunit.client.0.smithi046.stdout:3/577: mknod d1/d1d/d31/d9a/cc3 0 2024-03-04T09:32:12.342 INFO:tasks.workunit.client.0.smithi046.stdout:3/578: creat d1/db0/fc4 x:0 0 0 2024-03-04T09:32:12.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/478: rmdir d10/d12/d52/d78/d8a 39 2024-03-04T09:32:12.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/479: dread d10/d36/f3a [0,4194304] 0 2024-03-04T09:32:12.630 INFO:tasks.workunit.client.0.smithi046.stdout:1/449: creat d1/f8f x:0 0 0 2024-03-04T09:32:12.725 INFO:tasks.workunit.client.0.smithi046.stdout:6/558: symlink da/d14/d1e/d8f/lc2 0 2024-03-04T09:32:13.039 INFO:tasks.workunit.client.0.smithi046.stdout:8/443: rename d7/de/f3f to d7/de/d13/f99 0 2024-03-04T09:32:13.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/465: rmdir d1/d3 39 2024-03-04T09:32:13.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/466: truncate d1/f7f 880978 0 2024-03-04T09:32:13.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/467: readlink d1/d3/de/d4f/l6d 0 2024-03-04T09:32:13.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/579: unlink d1/d21/d35/l72 0 2024-03-04T09:32:13.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/450: creat d1/d28/d6a/f90 x:0 0 0 2024-03-04T09:32:13.743 INFO:tasks.workunit.client.0.smithi046.stdout:6/559: mknod da/d4e/cc3 0 2024-03-04T09:32:14.124 INFO:tasks.workunit.client.0.smithi046.stdout:7/460: dwrite d0/d4/db/d38/f3f [0,4194304] 0 2024-03-04T09:32:14.392 INFO:tasks.workunit.client.0.smithi046.stdout:8/444: rename d7/de/d28/d3a/f61 to d7/d53/d72/f9a 0 2024-03-04T09:32:14.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/445: write d7/de/d28/f2b [3625173,21077] 0 2024-03-04T09:32:14.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/468: creat d1/d3/de/d20/d76/d6c/f8c x:0 0 0 2024-03-04T09:32:14.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/469: dread - d1/d5f/f7c zero size 2024-03-04T09:32:14.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/470: truncate d1/f82 740452 0 2024-03-04T09:32:14.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/471: write d1/f36 [4803092,112870] 0 2024-03-04T09:32:14.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/472: dread - d1/f87 zero size 2024-03-04T09:32:14.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/580: mknod d1/cc5 0 2024-03-04T09:32:14.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/539: dwrite d5/d84/d88/d47/f98 [0,4194304] 0 2024-03-04T09:32:15.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/446: creat d7/de/d28/f9b x:0 0 0 2024-03-04T09:32:15.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/447: read d7/de/d13/d2c/f31 [2363329,47402] 0 2024-03-04T09:32:15.248 INFO:tasks.workunit.client.0.smithi046.stdout:8/448: dwrite d7/de/f18 [0,4194304] 0 2024-03-04T09:32:15.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/473: creat d1/d3/de/d20/d76/d6c/d7b/f8d x:0 0 0 2024-03-04T09:32:15.520 INFO:tasks.workunit.client.0.smithi046.stdout:3/581: creat d1/d21/d35/d24/fc6 x:0 0 0 2024-03-04T09:32:15.999 INFO:tasks.workunit.client.0.smithi046.stdout:9/556: sync 2024-03-04T09:32:15.999 INFO:tasks.workunit.client.0.smithi046.stdout:9/557: write d1/d11/fac [538238,4595] 0 2024-03-04T09:32:15.999 INFO:tasks.workunit.client.0.smithi046.stdout:1/451: truncate d1/f23 2699307 0 2024-03-04T09:32:16.006 INFO:tasks.workunit.client.0.smithi046.stdout:9/558: dread d1/d11/d6/d8/d1d/d34/d35/f76 [0,4194304] 0 2024-03-04T09:32:16.007 INFO:tasks.workunit.client.0.smithi046.stdout:9/559: read d1/d11/d6/d8/d1d/d34/d46/f8a [35765,7975] 0 2024-03-04T09:32:16.826 INFO:tasks.workunit.client.0.smithi046.stdout:4/543: dwrite d0/f39 [0,4194304] 0 2024-03-04T09:32:16.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/544: dread d0/d3/d16/d1e/d73/f9a [0,4194304] 0 2024-03-04T09:32:17.077 INFO:tasks.workunit.client.0.smithi046.stdout:0/480: write d10/d12/d6e/fa3 [2071561,109775] 0 2024-03-04T09:32:17.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/540: fsync d5/da/f2b 0 2024-03-04T09:32:17.182 INFO:tasks.workunit.client.0.smithi046.stdout:6/560: rename da/d14/d1e/d27/d78/d6c/f73 to da/d4e/fc4 0 2024-03-04T09:32:17.239 INFO:tasks.workunit.client.0.smithi046.stdout:2/541: dwrite d5/d2c/d51/fad [0,4194304] 0 2024-03-04T09:32:17.272 INFO:tasks.workunit.client.0.smithi046.stdout:7/461: link d0/d4/db/f25 d0/d4/db/d3b/f9e 0 2024-03-04T09:32:17.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/582: creat d1/d1d/d27/fc7 x:0 0 0 2024-03-04T09:32:17.683 INFO:tasks.workunit.client.0.smithi046.stdout:9/560: symlink d1/d11/d6/d8/d12/lb2 0 2024-03-04T09:32:17.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/561: dwrite d1/d11/d6/d8/d6f/f82 [0,4194304] 0 2024-03-04T09:32:17.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/545: symlink d0/d3/d20/d96/d6e/lc3 0 2024-03-04T09:32:18.141 INFO:tasks.workunit.client.0.smithi046.stdout:0/481: link d10/d12/d1f/d3f/d4b/f7f d10/d12/d52/fae 0 2024-03-04T09:32:18.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/561: mknod da/d14/d1e/d27/d8c/dbf/cc5 0 2024-03-04T09:32:18.784 INFO:tasks.workunit.client.0.smithi046.stdout:2/542: link d5/d38/d54/d8a/f95 d5/d38/fb2 0 2024-03-04T09:32:18.784 INFO:tasks.workunit.client.0.smithi046.stdout:2/543: dread - d5/d2c/f7e zero size 2024-03-04T09:32:18.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/462: dwrite d0/d4/db/f3d [0,4194304] 0 2024-03-04T09:32:18.952 INFO:tasks.workunit.client.0.smithi046.stdout:3/583: symlink d1/d1d/d31/d51/lc8 0 2024-03-04T09:32:19.551 INFO:tasks.workunit.client.0.smithi046.stdout:9/562: mknod d1/d11/d6/d8/d6f/d8c/cb3 0 2024-03-04T09:32:19.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/546: truncate d0/d3/f98 3502684 0 2024-03-04T09:32:20.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:32:20.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:32:20.922 INFO:tasks.workunit.client.0.smithi046.stdout:0/482: creat d10/d12/d9a/faf x:0 0 0 2024-03-04T09:32:20.922 INFO:tasks.workunit.client.0.smithi046.stdout:0/483: write d10/d36/f3a [1347810,111658] 0 2024-03-04T09:32:20.929 INFO:tasks.workunit.client.0.smithi046.stdout:8/449: rename d7/de/d28/f9b to d7/de/d13/d3c/f9c 0 2024-03-04T09:32:20.929 INFO:tasks.workunit.client.0.smithi046.stdout:8/450: chown d7/de/d12/c97 11 1 2024-03-04T09:32:20.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/562: link da/dd/d39/d60/c65 da/d14/d1e/d2c/cc6 0 2024-03-04T09:32:21.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/563: dwrite da/dd/f13 [4194304,4194304] 0 2024-03-04T09:32:21.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/544: unlink d5/d84/d7c/l97 0 2024-03-04T09:32:21.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/545: dread - d5/d38/fb2 zero size 2024-03-04T09:32:21.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/546: creat d5/d2c/d51/d61/fb3 x:0 0 0 2024-03-04T09:32:21.711 INFO:tasks.workunit.client.0.smithi046.stdout:7/463: getdents d0/da 0 2024-03-04T09:32:21.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/584: creat d1/d1d/d27/d40/d76/d8d/d95/fc9 x:0 0 0 2024-03-04T09:32:21.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/585: truncate d1/d1d/d27/d40/d76/f96 358369 0 2024-03-04T09:32:21.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/586: creat d1/d74/fca x:0 0 0 2024-03-04T09:32:22.109 INFO:tasks.workunit.client.0.smithi046.stdout:9/563: mknod d1/d11/d6/d8/d6f/d8c/d9a/cb4 0 2024-03-04T09:32:22.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/484: creat d10/d12/d9f/fb0 x:0 0 0 2024-03-04T09:32:22.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/474: rename d1/d3/de/d1d to d1/d44/d81/d8e 0 2024-03-04T09:32:22.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/475: chown d1/d44/l62 107 1 2024-03-04T09:32:22.763 INFO:tasks.workunit.client.0.smithi046.stdout:8/451: mknod d7/de/d28/d71/c9d 0 2024-03-04T09:32:22.907 INFO:tasks.workunit.client.0.smithi046.stdout:6/564: creat da/d14/d1e/d27/d4a/db2/fc7 x:0 0 0 2024-03-04T09:32:23.207 INFO:tasks.workunit.client.0.smithi046.stdout:7/464: dread d0/d4/db/d3b/f9e [0,4194304] 0 2024-03-04T09:32:23.207 INFO:tasks.workunit.client.0.smithi046.stdout:7/465: getdents d0/da/d46/d99 0 2024-03-04T09:32:23.583 INFO:tasks.workunit.client.0.smithi046.stdout:5/476: mkdir d1/d3/de/d4f/d8f 0 2024-03-04T09:32:23.583 INFO:tasks.workunit.client.0.smithi046.stdout:5/477: fsync d1/d3/de/d20/d76/d6c/d7b/f61 0 2024-03-04T09:32:23.731 INFO:tasks.workunit.client.0.smithi046.stdout:6/565: mknod da/d4e/cc8 0 2024-03-04T09:32:23.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/466: symlink d0/d4/d40/l9f 0 2024-03-04T09:32:23.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/467: chown d0/d8f 269351902 1 2024-03-04T09:32:24.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/587: getdents d1/d21/d35/d43 0 2024-03-04T09:32:24.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/468: dwrite d0/d4/d40/f49 [0,4194304] 0 2024-03-04T09:32:24.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/469: creat d0/d4/d6e/fa0 x:0 0 0 2024-03-04T09:32:24.076 INFO:tasks.workunit.client.0.smithi046.stdout:7/470: dwrite d0/d4/db/d12/f75 [0,4194304] 0 2024-03-04T09:32:24.076 INFO:tasks.workunit.client.0.smithi046.stdout:7/471: read d0/f31 [12740,90973] 0 2024-03-04T09:32:24.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/588: dwrite d1/d1d/f5d [0,4194304] 0 2024-03-04T09:32:24.142 INFO:tasks.workunit.client.0.smithi046.stdout:1/452: rename d1/d28/d6f/d74/f82 to d1/f91 0 2024-03-04T09:32:24.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/453: dwrite d1/d28/f5b [0,4194304] 0 2024-03-04T09:32:24.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/478: creat d1/d3/de/d4f/d8f/f90 x:0 0 0 2024-03-04T09:32:24.276 INFO:tasks.workunit.client.0.smithi046.stdout:5/479: write d1/d5f/f64 [316052,97709] 0 2024-03-04T09:32:24.806 INFO:tasks.workunit.client.0.smithi046.stdout:6/566: unlink da/dd/f61 0 2024-03-04T09:32:25.377 INFO:tasks.workunit.client.0.smithi046.stdout:4/547: rename d0/d1f/d35/lb4 to d0/d3/d20/d96/lc4 0 2024-03-04T09:32:25.776 INFO:tasks.workunit.client.0.smithi046.stdout:5/480: rmdir d1/d3/de/d20/d76 39 2024-03-04T09:32:25.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/567: symlink da/d14/d1e/d27/d4a/d94/lc9 0 2024-03-04T09:32:26.214 INFO:tasks.workunit.client.0.smithi046.stdout:4/548: getdents d0/d5f/da2 0 2024-03-04T09:32:26.450 INFO:tasks.workunit.client.0.smithi046.stdout:1/454: mkdir d1/d92 0 2024-03-04T09:32:26.450 INFO:tasks.workunit.client.0.smithi046.stdout:6/568: chown da/d14/d1e/d27/d78/f3c 3009566 1 2024-03-04T09:32:26.450 INFO:tasks.workunit.client.0.smithi046.stdout:6/569: write da/dd/d22/f70 [1439350,15480] 0 2024-03-04T09:32:27.034 INFO:tasks.workunit.client.0.smithi046.stdout:2/547: rename d5/d84/d88/d3f/f52 to d5/fb4 0 2024-03-04T09:32:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:1/455: mknod d1/d28/d6f/c93 0 2024-03-04T09:32:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:1/456: chown d1/d28/d8d 7 1 2024-03-04T09:32:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:1/457: fdatasync d1/d28/f69 0 2024-03-04T09:32:27.463 INFO:tasks.workunit.client.0.smithi046.stdout:1/458: write d1/d28/f30 [3805880,103878] 0 2024-03-04T09:32:27.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/570: mknod da/d14/d1e/d27/d78/d6c/cca 0 2024-03-04T09:32:27.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/571: fsync da/dd/d39/d60/da0/f88 0 2024-03-04T09:32:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/472: dwrite d0/d3c/f69 [0,4194304] 0 2024-03-04T09:32:27.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/589: dwrite d1/d21/d35/d2b/f6a [0,4194304] 0 2024-03-04T09:32:27.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/590: dread d1/d21/d35/f13 [0,4194304] 0 2024-03-04T09:32:27.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/564: rename d1/d11/d6/d8/d1d/d34/d35/c74 to d1/d11/d6/d8/d13/d92/cb5 0 2024-03-04T09:32:27.936 INFO:tasks.workunit.client.0.smithi046.stdout:2/548: mkdir d5/d2c/d51/d61/db5 0 2024-03-04T09:32:27.936 INFO:tasks.workunit.client.0.smithi046.stdout:2/549: fsync d5/d84/d88/d3f/f45 0 2024-03-04T09:32:27.965 INFO:tasks.workunit.client.0.smithi046.stdout:7/473: symlink d0/d2d/d85/la1 0 2024-03-04T09:32:27.972 INFO:tasks.workunit.client.0.smithi046.stdout:1/459: dread d1/d28/d6a/f70 [0,4194304] 0 2024-03-04T09:32:27.973 INFO:tasks.workunit.client.0.smithi046.stdout:1/460: dread - d1/f61 zero size 2024-03-04T09:32:27.973 INFO:tasks.workunit.client.0.smithi046.stdout:1/461: creat d1/d28/d6a/f94 x:0 0 0 2024-03-04T09:32:27.973 INFO:tasks.workunit.client.0.smithi046.stdout:2/550: dread d5/d2c/f6a [0,4194304] 0 2024-03-04T09:32:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/551: chown d5/d2c/f71 173708 1 2024-03-04T09:32:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/552: fsync d5/fd 0 2024-03-04T09:32:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/565: dread d1/d11/d6/d8/d1d/d34/f9f [0,4194304] 0 2024-03-04T09:32:27.998 INFO:tasks.workunit.client.0.smithi046.stdout:9/566: dread d1/d11/d6/d8/d1d/d34/f9f [0,4194304] 0 2024-03-04T09:32:28.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/553: dwrite d5/d84/f62 [4194304,4194304] 0 2024-03-04T09:32:28.062 INFO:tasks.workunit.client.0.smithi046.stdout:9/567: dwrite d1/d11/d6/d8/d6f/d8c/f9c [4194304,4194304] 0 2024-03-04T09:32:28.099 INFO:tasks.workunit.client.0.smithi046.stdout:3/591: creat d1/d1d/d31/d9a/fcb x:0 0 0 2024-03-04T09:32:28.099 INFO:tasks.workunit.client.0.smithi046.stdout:3/592: chown d1/d1d/f4c 1083594 1 2024-03-04T09:32:28.912 INFO:tasks.workunit.client.0.smithi046.stdout:4/549: dwrite d0/d3/d16/d1e/f1c [4194304,4194304] 0 2024-03-04T09:32:28.998 INFO:tasks.workunit.client.0.smithi046.stdout:9/568: mknod d1/d11/d6/d8/d6f/d8c/cb6 0 2024-03-04T09:32:30.392 INFO:tasks.workunit.client.0.smithi046.stdout:9/569: mkdir d1/d11/d6/d8/d13/d85/db7 0 2024-03-04T09:32:30.392 INFO:tasks.workunit.client.0.smithi046.stdout:9/570: readlink d1/d11/d3e/l8f 0 2024-03-04T09:32:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/571: read d1/d11/fac [281019,117475] 0 2024-03-04T09:32:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/572: read - d1/d11/d6/f83 zero size 2024-03-04T09:32:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/573: stat d1/d11/d6/c2b 0 2024-03-04T09:32:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/574: readlink d1/d11/d6/d8/d13/l8b 0 2024-03-04T09:32:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/572: dwrite da/dd/d39/d60/f71 [0,4194304] 0 2024-03-04T09:32:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/573: chown da/d14/d1e/d27/d4b/fb0 7502 1 2024-03-04T09:32:30.833 INFO:tasks.workunit.client.0.smithi046.stdout:6/574: read da/d14/d1e/d27/d78/d66/fad [4160465,89521] 0 2024-03-04T09:32:30.944 INFO:tasks.workunit.client.0.smithi046.stdout:6/575: dwrite da/dd/d39/d60/da0/d67/fa8 [0,4194304] 0 2024-03-04T09:32:31.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/576: mkdir da/dd/d39/d60/dac/dcb 0 2024-03-04T09:32:31.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/577: chown da/d14/d1e/d27/d78/d66/faa 45381 1 2024-03-04T09:32:31.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/485: rename d10/d12/f8e to d10/d12/d52/d78/d8a/da2/fb1 0 2024-03-04T09:32:31.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/486: fsync d10/f20 0 2024-03-04T09:32:32.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/452: rename d7/de/d4c/d50/l42 to d7/de/d28/d71/l9e 0 2024-03-04T09:32:32.180 INFO:tasks.workunit.client.0.smithi046.stdout:8/453: chown d7/de/d28/f2b 62999 1 2024-03-04T09:32:32.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/487: unlink d10/d12/d6e/fa5 0 2024-03-04T09:32:32.396 INFO:tasks.workunit.client.0.smithi046.stdout:5/481: rename d1/d44/f5a to d1/d44/d81/f91 0 2024-03-04T09:32:32.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/474: rename d0/d4 to d0/d4/db/d3b/da2 22 2024-03-04T09:32:32.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/482: write d1/d5f/f60 [1121952,11345] 0 2024-03-04T09:32:32.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/483: chown d1/d3/de/d20/d76/d6c/f8c 1466 1 2024-03-04T09:32:32.506 INFO:tasks.workunit.client.0.smithi046.stdout:8/454: creat d7/de/d28/d36/d7c/f9f x:0 0 0 2024-03-04T09:32:32.842 INFO:tasks.workunit.client.0.smithi046.stdout:1/462: rename d1/l4b to d1/d28/d6f/d74/l95 0 2024-03-04T09:32:32.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/484: rmdir d1/d44/d57/d70 39 2024-03-04T09:32:32.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/475: mknod d0/da/d46/ca3 0 2024-03-04T09:32:32.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/485: getdents d1/d5f/d8a 0 2024-03-04T09:32:32.929 INFO:tasks.workunit.client.0.smithi046.stdout:8/455: dread d7/de/d13/f35 [0,4194304] 0 2024-03-04T09:32:32.938 INFO:tasks.workunit.client.0.smithi046.stdout:7/476: dwrite d0/d8f/f9d [0,4194304] 0 2024-03-04T09:32:32.938 INFO:tasks.workunit.client.0.smithi046.stdout:7/477: fsync d0/d4/db/d12/f1d 0 2024-03-04T09:32:33.230 INFO:tasks.workunit.client.0.smithi046.stdout:4/550: rename d0/d1f/d25/d50/dba to d0/d3/d20/d96/d6e/d85/dc5 0 2024-03-04T09:32:33.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/463: mkdir d1/d92/d96 0 2024-03-04T09:32:33.230 INFO:tasks.workunit.client.0.smithi046.stdout:4/551: write d0/d3/d16/f4b [997301,80439] 0 2024-03-04T09:32:33.230 INFO:tasks.workunit.client.0.smithi046.stdout:4/552: truncate d0/d3/d16/f66 57142 0 2024-03-04T09:32:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/456: symlink d7/d53/la0 0 2024-03-04T09:32:33.241 INFO:tasks.workunit.client.0.smithi046.stdout:8/457: truncate d7/de/d4c/f98 1008160 0 2024-03-04T09:32:33.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/478: rmdir d0/d4/db 39 2024-03-04T09:32:33.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/479: chown d0/d4/db/d12 6 1 2024-03-04T09:32:33.247 INFO:tasks.workunit.client.0.smithi046.stdout:8/458: write d7/d53/f65 [810400,32471] 0 2024-03-04T09:32:33.579 INFO:tasks.workunit.client.0.smithi046.stdout:6/578: rename da/d4e/f6a to da/d14/d1e/d27/da3/fcc 0 2024-03-04T09:32:33.595 INFO:tasks.workunit.client.0.smithi046.stdout:6/579: write da/dd/d39/d60/da0/f88 [1934666,99123] 0 2024-03-04T09:32:33.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/575: sync 2024-03-04T09:32:33.667 INFO:tasks.workunit.client.0.smithi046.stdout:2/554: sync 2024-03-04T09:32:33.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/593: sync 2024-03-04T09:32:33.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/594: fdatasync d1/d1d/d31/f3e 0 2024-03-04T09:32:33.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/576: truncate d1/d11/d6/d8/d1d/d34/d46/d4c/f71 1096135 0 2024-03-04T09:32:33.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/464: mkdir d1/d28/d6f/d74/d97 0 2024-03-04T09:32:33.745 INFO:tasks.workunit.client.0.smithi046.stdout:1/465: write d1/d28/f5b [1629318,50969] 0 2024-03-04T09:32:34.035 INFO:tasks.workunit.client.0.smithi046.stdout:7/480: getdents d0 0 2024-03-04T09:32:34.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/488: sync 2024-03-04T09:32:34.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/489: chown d10/d12/d52/d78/f33 3360528 1 2024-03-04T09:32:34.705 INFO:tasks.workunit.client.0.smithi046.stdout:4/553: rename d0/d1f/d35/f4a to d0/d1f/d25/fc6 0 2024-03-04T09:32:34.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/580: stat da/d14/d1e/d27/d78/c3e 0 2024-03-04T09:32:34.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/581: chown da/dd/d39/d60/da0/d67/d64/d56 737 1 2024-03-04T09:32:34.959 INFO:tasks.workunit.client.0.smithi046.stdout:5/486: dwrite d1/f7f [0,4194304] 0 2024-03-04T09:32:35.015 INFO:tasks.workunit.client.0.smithi046.stdout:2/555: unlink d5/d38/d54/d8a/ca6 0 2024-03-04T09:32:35.015 INFO:tasks.workunit.client.0.smithi046.stdout:2/556: write d5/d38/f66 [271643,65299] 0 2024-03-04T09:32:35.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/577: symlink d1/d11/d6/d8/d13/d92/lb8 0 2024-03-04T09:32:35.100 INFO:tasks.workunit.client.0.smithi046.stdout:2/557: dwrite d5/d38/f85 [0,4194304] 0 2024-03-04T09:32:35.209 INFO:tasks.workunit.client.0.smithi046.stdout:1/466: getdents d1/d92 0 2024-03-04T09:32:35.209 INFO:tasks.workunit.client.0.smithi046.stdout:1/467: fdatasync d1/d28/f7f 0 2024-03-04T09:32:35.209 INFO:tasks.workunit.client.0.smithi046.stdout:1/468: read d1/d28/d6a/f70 [744106,20452] 0 2024-03-04T09:32:35.281 INFO:tasks.workunit.client.0.smithi046.stdout:7/481: mknod d0/da/d41/ca4 0 2024-03-04T09:32:35.288 INFO:tasks.workunit.client.0.smithi046.stdout:7/482: dread d0/da/f42 [0,4194304] 0 2024-03-04T09:32:35.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/459: getdents d7/de/d13/d2c/d64 0 2024-03-04T09:32:35.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/460: chown d7/de/d13/f87 53356 1 2024-03-04T09:32:35.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/461: chown d7/d53/la0 20942510 1 2024-03-04T09:32:35.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/595: rename d1/d21/d35/d43/f49 to d1/d1d/d31/d51/da3/fcc 0 2024-03-04T09:32:35.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/554: rename d0/d3/d16 to d0/d3/d16/d1e/da1/dc1/dc7 22 2024-03-04T09:32:36.029 INFO:tasks.workunit.client.0.smithi046.stdout:6/582: symlink da/dd/d39/d60/da9/lcd 0 2024-03-04T09:32:36.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/487: mkdir d1/d44/d57/d70/d86/d92 0 2024-03-04T09:32:36.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/578: creat d1/d11/d6/d8/d12/d1c/d26/fb9 x:0 0 0 2024-03-04T09:32:36.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/579: fsync d1/d11/d6/d8/f33 0 2024-03-04T09:32:36.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/580: write d1/d11/d6/f4e [3858948,112369] 0 2024-03-04T09:32:36.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/581: dwrite d1/d11/d6/d8/d12/d1c/f6e [8388608,4194304] 0 2024-03-04T09:32:36.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/558: chown d5/l8 23795 1 2024-03-04T09:32:37.348 INFO:tasks.workunit.client.0.smithi046.stdout:7/483: symlink d0/d4/db/d38/d94/la5 0 2024-03-04T09:32:37.458 INFO:tasks.workunit.client.0.smithi046.stdout:8/462: mkdir d7/de/d3e/da1 0 2024-03-04T09:32:37.458 INFO:tasks.workunit.client.0.smithi046.stdout:8/463: read d7/de/f4a [1976783,80350] 0 2024-03-04T09:32:37.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/596: mknod d1/d1d/d5e/ccd 0 2024-03-04T09:32:37.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/597: write d1/d1d/d27/d40/d76/d8d/d95/f87 [594433,116579] 0 2024-03-04T09:32:37.641 INFO:tasks.workunit.client.0.smithi046.stdout:4/555: symlink d0/d1f/d25/d50/lc8 0 2024-03-04T09:32:38.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/490: dwrite d10/d12/f1b [4194304,4194304] 0 2024-03-04T09:32:38.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/491: chown d10/d12/f4f 1735 1 2024-03-04T09:32:38.148 INFO:tasks.workunit.client.0.smithi046.stdout:9/582: stat d1/d11/d6/d8/d1d/d34/d46/d5e/c7a 0 2024-03-04T09:32:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/559: symlink d5/d84/d88/d99/lb6 0 2024-03-04T09:32:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/560: fdatasync d5/d38/f90 0 2024-03-04T09:32:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/561: fdatasync d5/d84/f62 0 2024-03-04T09:32:38.519 INFO:tasks.workunit.client.0.smithi046.stdout:8/464: rename d7/de/d3e/c44 to d7/de/d28/d3a/d6f/ca2 0 2024-03-04T09:32:38.519 INFO:tasks.workunit.client.0.smithi046.stdout:7/484: creat d0/d4/db/fa6 x:0 0 0 2024-03-04T09:32:38.519 INFO:tasks.workunit.client.0.smithi046.stdout:8/465: fsync d7/de/f75 0 2024-03-04T09:32:38.519 INFO:tasks.workunit.client.0.smithi046.stdout:8/466: write d7/de/d13/d2c/f31 [4037018,63472] 0 2024-03-04T09:32:39.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/556: creat d0/d3/d20/fc9 x:0 0 0 2024-03-04T09:32:39.422 INFO:tasks.workunit.client.0.smithi046.stdout:0/492: dread d10/d12/d1f/d3b/d6b/f89 [0,4194304] 0 2024-03-04T09:32:39.426 INFO:tasks.workunit.client.0.smithi046.stdout:0/493: write d10/d12/d52/d5d/f61 [461333,43195] 0 2024-03-04T09:32:39.426 INFO:tasks.workunit.client.0.smithi046.stdout:0/494: chown d10/d12/d1f/d3f/d7e/c98 0 1 2024-03-04T09:32:39.432 INFO:tasks.workunit.client.0.smithi046.stdout:3/598: dread d1/d1d/f3a [0,4194304] 0 2024-03-04T09:32:39.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/583: creat d1/d11/d6/d8/d1d/d34/d46/fba x:0 0 0 2024-03-04T09:32:39.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/584: chown d1/d11/d6/d8/d1d/f77 21 1 2024-03-04T09:32:39.433 INFO:tasks.workunit.client.0.smithi046.stdout:9/585: write d1/d11/d6/d8/d1d/d34/d46/d4c/fa1 [1021717,124778] 0 2024-03-04T09:32:39.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/586: dread d1/d11/d6/d8/d13/d92/f9d [0,4194304] 0 2024-03-04T09:32:39.454 INFO:tasks.workunit.client.0.smithi046.stdout:7/485: stat d0/d4/db/d12/c32 0 2024-03-04T09:32:39.454 INFO:tasks.workunit.client.0.smithi046.stdout:2/562: creat d5/d84/fb7 x:0 0 0 2024-03-04T09:32:39.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/587: write d1/d11/d6/f83 [292364,118321] 0 2024-03-04T09:32:39.514 INFO:tasks.workunit.client.0.smithi046.stdout:9/588: dwrite d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 [0,4194304] 0 2024-03-04T09:32:39.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/469: creat d1/f98 x:0 0 0 2024-03-04T09:32:39.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/470: truncate d1/d28/d6a/f90 846217 0 2024-03-04T09:32:39.795 INFO:tasks.workunit.client.0.smithi046.stdout:4/557: mknod d0/d8e/cca 0 2024-03-04T09:32:39.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/495: creat d10/d12/d52/d78/d8a/fb2 x:0 0 0 2024-03-04T09:32:40.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/563: getdents d5 0 2024-03-04T09:32:40.078 INFO:tasks.workunit.client.0.smithi046.stdout:7/486: rename d0/d4/db/d12/f48 to d0/d4/db/d3b/d6b/fa7 0 2024-03-04T09:32:40.078 INFO:tasks.workunit.client.0.smithi046.stdout:8/467: getdents d7/d53 0 2024-03-04T09:32:40.088 INFO:tasks.workunit.client.0.smithi046.stdout:3/599: read d1/d1d/d31/d51/da3/fcc [1285783,128233] 0 2024-03-04T09:32:40.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/487: dread d0/da/f2a [0,4194304] 0 2024-03-04T09:32:40.944 INFO:tasks.workunit.client.0.smithi046.stdout:6/583: dwrite da/d14/d1e/d27/d78/f7b [0,4194304] 0 2024-03-04T09:32:40.950 INFO:tasks.workunit.client.0.smithi046.stdout:5/488: dwrite d1/d3/de/d20/d76/f48 [0,4194304] 0 2024-03-04T09:32:40.950 INFO:tasks.workunit.client.0.smithi046.stdout:5/489: write d1/d3/de/d20/d76/d6c/d7b/f3d [4385939,46232] 0 2024-03-04T09:32:40.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/490: dwrite d1/d5f/f64 [0,4194304] 0 2024-03-04T09:32:41.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/558: symlink d0/d3/d16/d1e/d73/lcb 0 2024-03-04T09:32:41.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/468: getdents d7/de 0 2024-03-04T09:32:42.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/488: creat d0/d4/db/d38/d94/fa8 x:0 0 0 2024-03-04T09:32:42.871 INFO:tasks.workunit.client.0.smithi046.stdout:6/584: symlink da/dd/d46/lce 0 2024-03-04T09:32:42.871 INFO:tasks.workunit.client.0.smithi046.stdout:6/585: chown da/d14/d1e/d27/d78/d66/fad 692452 1 2024-03-04T09:32:43.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/491: rmdir d1/d44/d57/d70/d86 39 2024-03-04T09:32:43.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/492: chown d1/d3/d1f/c58 121 1 2024-03-04T09:32:43.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/493: write d1/d3/de/d20/d5e/f74 [150262,38597] 0 2024-03-04T09:32:43.322 INFO:tasks.workunit.client.0.smithi046.stdout:4/559: mkdir d0/d3/d16/d1e/da1/dcc 0 2024-03-04T09:32:43.570 INFO:tasks.workunit.client.0.smithi046.stdout:8/469: creat d7/de/d13/d2c/fa3 x:0 0 0 2024-03-04T09:32:43.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/489: creat d0/d2d/d85/fa9 x:0 0 0 2024-03-04T09:32:43.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/586: mkdir da/dd/d39/d60/da0/d67/dcf 0 2024-03-04T09:32:43.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/587: readlink da/d14/d1e/d27/d78/d6c/l9b 0 2024-03-04T09:32:43.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/490: fsync d0/d4/db/d12/f75 0 2024-03-04T09:32:43.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/491: chown d0/d4/db/d3b/f9e 59878 1 2024-03-04T09:32:43.831 INFO:tasks.workunit.client.0.smithi046.stdout:6/588: dread da/d14/d1e/d27/d78/f3c [0,4194304] 0 2024-03-04T09:32:43.866 INFO:tasks.workunit.client.0.smithi046.stdout:6/589: dread da/d14/d1e/d2c/f5b [0,4194304] 0 2024-03-04T09:32:44.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/492: link d0/d59/f5b d0/d4/db/d38/d64/faa 0 2024-03-04T09:32:44.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/493: fsync d0/d4/db/d3b/f87 0 2024-03-04T09:32:44.659 INFO:tasks.workunit.client.0.smithi046.stdout:5/494: getdents d1/d3/de/d4f/d8f 0 2024-03-04T09:32:44.721 INFO:tasks.workunit.client.0.smithi046.stdout:5/495: dwrite d1/d44/d81/f91 [0,4194304] 0 2024-03-04T09:32:44.882 INFO:tasks.workunit.client.0.smithi046.stdout:7/494: truncate d0/d4/db/d3b/f53 873087 0 2024-03-04T09:32:44.940 INFO:tasks.workunit.client.0.smithi046.stdout:6/590: truncate da/dd/fe 200142 0 2024-03-04T09:32:44.940 INFO:tasks.workunit.client.0.smithi046.stdout:6/591: truncate da/dd/f2a 1211332 0 2024-03-04T09:32:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:6/592: dwrite da/dd/f2a [0,4194304] 0 2024-03-04T09:32:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:6/593: creat da/dd/d46/fd0 x:0 0 0 2024-03-04T09:32:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:6/594: readlink da/dd/d39/d60/l80 0 2024-03-04T09:32:45.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/470: symlink d7/de/d28/la4 0 2024-03-04T09:32:45.261 INFO:tasks.workunit.client.0.smithi046.stdout:8/471: dread d7/de/f1b [0,4194304] 0 2024-03-04T09:32:45.320 INFO:tasks.workunit.client.0.smithi046.stdout:8/472: dwrite d7/de/f1b [0,4194304] 0 2024-03-04T09:32:45.360 INFO:tasks.workunit.client.0.smithi046.stdout:8/473: write d7/de/d3e/f57 [1380527,6113] 0 2024-03-04T09:32:45.992 INFO:tasks.workunit.client.0.smithi046.stdout:6/595: creat da/d14/d1e/d27/da3/fd1 x:0 0 0 2024-03-04T09:32:45.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/596: write da/dd/d39/d60/da0/d67/f6d [4965856,26055] 0 2024-03-04T09:32:46.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/589: rmdir d1/dad 0 2024-03-04T09:32:46.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/600: dwrite d1/d1d/d27/d4a/f7b [8388608,4194304] 0 2024-03-04T09:32:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/601: creat d1/d74/fce x:0 0 0 2024-03-04T09:32:46.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/602: dwrite d1/f59 [0,4194304] 0 2024-03-04T09:32:46.478 INFO:tasks.workunit.client.0.smithi046.stdout:0/496: rename d10/d12/d6e/fab to d10/d12/fb3 0 2024-03-04T09:32:46.498 INFO:tasks.workunit.client.0.smithi046.stdout:0/497: dread d10/d12/f3d [0,4194304] 0 2024-03-04T09:32:47.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/603: mkdir d1/d1d/d27/d40/d76/d8d/d95/dcf 0 2024-03-04T09:32:47.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/496: rename d1/d44/d57/l7d to d1/d44/d81/d8e/l93 0 2024-03-04T09:32:47.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/498: mkdir d10/d12/d52/d78/d8a/db4 0 2024-03-04T09:32:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/590: link d1/d11/d6/d8/d1d/d34/d46/d4c/da3/cb0 d1/d11/d6/d8/d1d/d34/d46/d5e/cbb 0 2024-03-04T09:32:47.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/604: creat d1/d21/fd0 x:0 0 0 2024-03-04T09:32:47.959 INFO:tasks.workunit.client.0.smithi046.stdout:7/495: rename d0/d4/db/d12/c32 to d0/d4/db/d38/cab 0 2024-03-04T09:32:47.959 INFO:tasks.workunit.client.0.smithi046.stdout:7/496: truncate d0/d4/db/fa6 797783 0 2024-03-04T09:32:48.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/499: symlink d10/d36/d87/lb5 0 2024-03-04T09:32:48.378 INFO:tasks.workunit.client.0.smithi046.stdout:9/591: mknod d1/d11/d6/d8/d13/d21/cbc 0 2024-03-04T09:32:48.378 INFO:tasks.workunit.client.0.smithi046.stdout:4/560: creat d0/d1f/fcd x:0 0 0 2024-03-04T09:32:48.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/561: dread d0/d1f/d5b/f78 [0,4194304] 0 2024-03-04T09:32:48.411 INFO:tasks.workunit.client.0.smithi046.stdout:9/592: dread d1/d11/d6/d8/f62 [0,4194304] 0 2024-03-04T09:32:48.411 INFO:tasks.workunit.client.0.smithi046.stdout:9/593: chown d1/d11/d6/d8/d13/d92 18446 1 2024-03-04T09:32:48.466 INFO:tasks.workunit.client.0.smithi046.stdout:3/605: link d1/d1d/d5e/lbb d1/d1d/d27/ld1 0 2024-03-04T09:32:48.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/497: unlink d0/d4/db/d12/d28/f92 0 2024-03-04T09:32:48.770 INFO:tasks.workunit.client.0.smithi046.stdout:0/500: rmdir d10/d12/d52/d78/d8a/da2 39 2024-03-04T09:32:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/594: rename d1/d11/d6/d8/d12/d1c/d26/l94 to d1/d11/d6/d8/lbd 0 2024-03-04T09:32:49.023 INFO:tasks.workunit.client.0.smithi046.stdout:9/595: dwrite d1/d11/d6/d8/d1d/d34/f93 [0,4194304] 0 2024-03-04T09:32:49.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/501: creat d10/d12/d1f/fb6 x:0 0 0 2024-03-04T09:32:49.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/502: symlink d10/d12/d6e/lb7 0 2024-03-04T09:32:49.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/474: getdents d7/de/d28 0 2024-03-04T09:32:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:6/597: creat da/dd/d39/fd2 x:0 0 0 2024-03-04T09:32:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:6/598: readlink da/dd/d39/d60/da0/d67/d64/d56/l7a 0 2024-03-04T09:32:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:6/599: fsync da/d14/d1e/d27/da3/fcc 0 2024-03-04T09:32:50.114 INFO:tasks.workunit.client.0.smithi046.stdout:1/471: sync 2024-03-04T09:32:50.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/564: sync 2024-03-04T09:32:50.487 INFO:tasks.workunit.client.0.smithi046.stdout:3/606: rename d1/d1d/d31 to d1/d21/d35/d43/dd2 0 2024-03-04T09:32:50.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/503: getdents d10/d12/d52/d78/d8a/da2 0 2024-03-04T09:32:50.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/504: chown d10/d12/d1f/d3f/d7e/c98 1155865 1 2024-03-04T09:32:50.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/505: dread d10/d12/d6e/f93 [0,4194304] 0 2024-03-04T09:32:50.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/506: chown d10/d12/d1f/l34 0 1 2024-03-04T09:32:50.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/507: chown d10/l51 211058272 1 2024-03-04T09:32:50.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:32:50.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:32:50.851 INFO:tasks.workunit.client.0.smithi046.stdout:8/475: dread f2 [0,4194304] 0 2024-03-04T09:32:50.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/476: write d7/de/d28/f2e [3820978,41609] 0 2024-03-04T09:32:50.924 INFO:tasks.workunit.client.0.smithi046.stdout:8/477: dwrite d7/de/f6b [0,4194304] 0 2024-03-04T09:32:51.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/600: mkdir da/d14/d17/dd3 0 2024-03-04T09:32:51.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/472: rmdir d1 39 2024-03-04T09:32:51.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/473: truncate d1/d28/f7f 699547 0 2024-03-04T09:32:51.298 INFO:tasks.workunit.client.0.smithi046.stdout:1/474: dwrite d1/f61 [0,4194304] 0 2024-03-04T09:32:51.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/497: dwrite d1/d3/fc [0,4194304] 0 2024-03-04T09:32:51.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/565: mkdir d5/d84/d88/d99/daa/db8 0 2024-03-04T09:32:51.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/566: chown d5/d38/d54/c80 46765 1 2024-03-04T09:32:51.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/567: chown d5/d84/d88/f44 460291 1 2024-03-04T09:32:51.618 INFO:tasks.workunit.client.0.smithi046.stdout:7/498: rename d0/d4/db/d12/f1d to d0/da/fac 0 2024-03-04T09:32:51.847 INFO:tasks.workunit.client.0.smithi046.stdout:0/508: mknod d10/d12/d52/d5d/d83/cb8 0 2024-03-04T09:32:51.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/509: write d10/d12/d52/d5d/f8f [3043281,50291] 0 2024-03-04T09:32:51.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/510: readlink d10/d36/d87/lb5 0 2024-03-04T09:32:52.568 INFO:tasks.workunit.client.0.smithi046.stdout:8/478: dread - d7/de/d13/d2c/f45 zero size 2024-03-04T09:32:52.568 INFO:tasks.workunit.client.0.smithi046.stdout:8/479: write d7/de/d4c/d50/f85 [477514,53790] 0 2024-03-04T09:32:53.217 INFO:tasks.workunit.client.0.smithi046.stdout:3/607: creat d1/fd3 x:0 0 0 2024-03-04T09:32:53.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/475: getdents d1 0 2024-03-04T09:32:53.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/499: mknod d0/d4/d40/cad 0 2024-03-04T09:32:53.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/500: chown d0/d4/db/f3d 273 1 2024-03-04T09:32:53.766 INFO:tasks.workunit.client.0.smithi046.stdout:0/511: mknod d10/d12/d52/d5d/cb9 0 2024-03-04T09:32:53.766 INFO:tasks.workunit.client.0.smithi046.stdout:0/512: write d10/d12/d52/d78/f33 [506335,23643] 0 2024-03-04T09:32:54.220 INFO:tasks.workunit.client.0.smithi046.stdout:1/476: link d1/d28/c36 d1/d92/c99 0 2024-03-04T09:32:54.995 INFO:tasks.workunit.client.0.smithi046.stdout:7/501: link d0/da/d41/c7b d0/da/d46/d99/cae 0 2024-03-04T09:32:54.995 INFO:tasks.workunit.client.0.smithi046.stdout:4/562: rmdir d0/db5 0 2024-03-04T09:32:54.996 INFO:tasks.workunit.client.0.smithi046.stdout:4/563: chown d0/d1f/f48 13 1 2024-03-04T09:32:55.271 INFO:tasks.workunit.client.0.smithi046.stdout:8/480: rmdir d7/de/d3e 39 2024-03-04T09:32:56.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/601: rmdir da/d14/d1e/d27/d78 39 2024-03-04T09:32:56.585 INFO:tasks.workunit.client.0.smithi046.stdout:3/608: rmdir d1 39 2024-03-04T09:32:56.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/609: dwrite d1/f3f [0,4194304] 0 2024-03-04T09:32:56.713 INFO:tasks.workunit.client.0.smithi046.stdout:9/596: rename d1/d11/d6/d8/d1d/d34/f93 to d1/d11/d6/d8/d1d/d34/d46/d5e/fbe 0 2024-03-04T09:32:56.781 INFO:tasks.workunit.client.0.smithi046.stdout:1/477: truncate d1/d28/f5b 1057953 0 2024-03-04T09:32:57.127 INFO:tasks.workunit.client.0.smithi046.stdout:7/502: symlink d0/d8f/laf 0 2024-03-04T09:32:57.191 INFO:tasks.workunit.client.0.smithi046.stdout:4/564: creat d0/d3/d16/d1e/da1/fce x:0 0 0 2024-03-04T09:32:57.191 INFO:tasks.workunit.client.0.smithi046.stdout:4/565: readlink d0/d3/d16/le 0 2024-03-04T09:32:57.774 INFO:tasks.workunit.client.0.smithi046.stdout:6/602: symlink da/dd/d46/db1/ld4 0 2024-03-04T09:32:57.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/603: dwrite da/d14/d1e/d27/d78/d66/d81/f93 [0,4194304] 0 2024-03-04T09:32:58.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/568: mkdir d5/db9 0 2024-03-04T09:32:58.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/569: fsync d5/d84/d88/d3f/f41 0 2024-03-04T09:32:58.196 INFO:tasks.workunit.client.0.smithi046.stdout:3/610: creat d1/d88/fd4 x:0 0 0 2024-03-04T09:32:58.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/570: fsync d5/d84/d88/d47/f98 0 2024-03-04T09:32:58.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/571: write d5/da/f2b [1822892,66749] 0 2024-03-04T09:32:58.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/513: write d10/d12/d52/d5d/f69 [684413,70897] 0 2024-03-04T09:32:58.468 INFO:tasks.workunit.client.0.smithi046.stdout:5/498: rename d1/d44/d81/d8e/l2a to d1/d44/d57/d70/l94 0 2024-03-04T09:32:58.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/514: rename d10/d12/d1f/d3b/d6b to d10/d12/d1f/d3b/d6b/dba 22 2024-03-04T09:32:58.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/515: write d10/d12/d1f/d3b/d6b/fa0 [228882,106390] 0 2024-03-04T09:32:58.654 INFO:tasks.workunit.client.0.smithi046.stdout:9/597: creat d1/d11/d6/d8/d1d/d34/d7f/fbf x:0 0 0 2024-03-04T09:32:58.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/598: chown d1/d11/d6/c9 94161 1 2024-03-04T09:32:58.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/599: chown d1/d11/d6/d8/d1d/d34/d4d/f55 3579457 1 2024-03-04T09:32:59.025 INFO:tasks.workunit.client.0.smithi046.stdout:1/478: unlink d1/d28/d6a/f70 0 2024-03-04T09:32:59.246 INFO:tasks.workunit.client.0.smithi046.stdout:4/566: truncate d0/d1f/f2c 262495 0 2024-03-04T09:32:59.246 INFO:tasks.workunit.client.0.smithi046.stdout:4/567: chown d0/d3/d20/d96/d6e/c70 3293775 1 2024-03-04T09:32:59.246 INFO:tasks.workunit.client.0.smithi046.stdout:4/568: stat d0/d3/c40 0 2024-03-04T09:32:59.392 INFO:tasks.workunit.client.0.smithi046.stdout:8/481: mkdir d7/de/d13/d3c/da5 0 2024-03-04T09:32:59.421 INFO:tasks.workunit.client.0.smithi046.stdout:8/482: write d7/de/d28/d3a/d6f/d84/f8e [2383857,74368] 0 2024-03-04T09:32:59.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/604: mkdir da/dd/d39/d60/da0/d67/d64/d82/d83/dd5 0 2024-03-04T09:33:00.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/611: link d1/d21/d35/d43/f62 d1/d88/fd5 0 2024-03-04T09:33:00.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/612: read - d1/d1d/d27/fc7 zero size 2024-03-04T09:33:00.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/613: readlink d1/d1d/d27/l57 0 2024-03-04T09:33:00.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/499: unlink d1/d3/de/d20/d76/d6c/d7b/f43 0 2024-03-04T09:33:00.855 INFO:tasks.workunit.client.0.smithi046.stdout:0/516: creat d10/d12/d9f/da6/fbb x:0 0 0 2024-03-04T09:33:00.855 INFO:tasks.workunit.client.0.smithi046.stdout:9/600: symlink d1/d11/d6/d8/d36/lc0 0 2024-03-04T09:33:00.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/517: dread fc [4194304,4194304] 0 2024-03-04T09:33:00.949 INFO:tasks.workunit.client.0.smithi046.stdout:1/479: truncate d1/f68 1880784 0 2024-03-04T09:33:00.950 INFO:tasks.workunit.client.0.smithi046.stdout:1/480: write d1/f25 [1913381,93125] 0 2024-03-04T09:33:01.262 INFO:tasks.workunit.client.0.smithi046.stdout:4/569: creat d0/d3/d16/d1e/da1/dc1/fcf x:0 0 0 2024-03-04T09:33:01.498 INFO:tasks.workunit.client.0.smithi046.stdout:8/483: creat d7/de/d3e/da1/fa6 x:0 0 0 2024-03-04T09:33:02.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/572: unlink d5/da/l15 0 2024-03-04T09:33:03.002 INFO:tasks.workunit.client.0.smithi046.stdout:5/500: dread d1/d3/fc [0,4194304] 0 2024-03-04T09:33:03.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/601: rename d1/d11/d6/d8/d36/c87 to d1/d11/d6/d8/d1d/d34/d46/cc1 0 2024-03-04T09:33:03.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/602: fdatasync d1/d11/d6/d8/d1d/d34/f3c 0 2024-03-04T09:33:03.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/518: link d10/d12/d52/fae d10/d12/fbc 0 2024-03-04T09:33:03.410 INFO:tasks.workunit.client.0.smithi046.stdout:4/570: symlink d0/d1f/d35/ld0 0 2024-03-04T09:33:03.668 INFO:tasks.workunit.client.0.smithi046.stdout:8/484: symlink d7/de/d13/d3c/da5/la7 0 2024-03-04T09:33:03.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/573: mkdir d5/d2c/d51/d61/db5/dba 0 2024-03-04T09:33:03.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/574: stat d5/fd 0 2024-03-04T09:33:03.851 INFO:tasks.workunit.client.0.smithi046.stdout:7/503: rmdir d0/d58 39 2024-03-04T09:33:03.851 INFO:tasks.workunit.client.0.smithi046.stdout:7/504: dread - d0/d4/db/d38/d94/fa8 zero size 2024-03-04T09:33:03.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/501: creat d1/d3/f95 x:0 0 0 2024-03-04T09:33:04.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/603: creat d1/d11/d6/d8/d12/fc2 x:0 0 0 2024-03-04T09:33:04.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/604: chown d1/d11/d6/d8/d1d/d34/d7f 11759087 1 2024-03-04T09:33:04.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/605: chown d1/d11/d6/d8/d12/lab 489132 1 2024-03-04T09:33:04.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/606: chown d1/d11/fac 65149 1 2024-03-04T09:33:04.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/607: truncate d1/d11/d6/d8/d6f/f9b 344995 0 2024-03-04T09:33:04.518 INFO:tasks.workunit.client.0.smithi046.stdout:0/519: creat d10/d12/d1f/d3b/fbd x:0 0 0 2024-03-04T09:33:04.757 INFO:tasks.workunit.client.0.smithi046.stdout:4/571: rename d0/d3/f98 to d0/d3/d16/d1e/d73/fd1 0 2024-03-04T09:33:04.757 INFO:tasks.workunit.client.0.smithi046.stdout:4/572: write d0/d1f/f44 [4225430,10911] 0 2024-03-04T09:33:04.758 INFO:tasks.workunit.client.0.smithi046.stdout:4/573: creat d0/d3/d20/d96/fd2 x:0 0 0 2024-03-04T09:33:04.789 INFO:tasks.workunit.client.0.smithi046.stdout:4/574: dread d0/d1f/d25/d7b/f92 [0,4194304] 0 2024-03-04T09:33:05.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/505: mknod d0/d4/db/d38/cb0 0 2024-03-04T09:33:05.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/502: unlink d1/d3/de/c40 0 2024-03-04T09:33:05.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/503: write d1/d3/de/d20/d5e/f74 [604333,13068] 0 2024-03-04T09:33:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/605: write da/dd/d39/d60/da0/f62 [3101241,32497] 0 2024-03-04T09:33:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:6/606: write da/d14/d1e/d8f/f9e [138116,67129] 0 2024-03-04T09:33:05.947 INFO:tasks.workunit.client.0.smithi046.stdout:6/607: write da/d14/d1e/d27/da3/fcc [555126,22526] 0 2024-03-04T09:33:06.064 INFO:tasks.workunit.client.0.smithi046.stdout:4/575: creat d0/d3/d20/d96/d6e/d85/da7/fd3 x:0 0 0 2024-03-04T09:33:06.241 INFO:tasks.workunit.client.0.smithi046.stdout:8/485: rmdir d7/de/d13/d2c 39 2024-03-04T09:33:06.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/575: mknod d5/da/cbb 0 2024-03-04T09:33:06.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/506: getdents d0/d4/db 0 2024-03-04T09:33:06.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/520: getdents d10/d12/d9f 0 2024-03-04T09:33:06.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/608: creat da/dd/d39/d60/fd6 x:0 0 0 2024-03-04T09:33:06.925 INFO:tasks.workunit.client.0.smithi046.stdout:6/609: dwrite da/d14/d1e/fb6 [0,4194304] 0 2024-03-04T09:33:06.968 INFO:tasks.workunit.client.0.smithi046.stdout:4/576: symlink d0/d1f/d25/da6/ld4 0 2024-03-04T09:33:07.258 INFO:tasks.workunit.client.0.smithi046.stdout:8/486: creat d7/d53/d72/fa8 x:0 0 0 2024-03-04T09:33:07.258 INFO:tasks.workunit.client.0.smithi046.stdout:8/487: dread - d7/de/f7e zero size 2024-03-04T09:33:07.287 INFO:tasks.workunit.client.0.smithi046.stdout:7/507: stat d0/d4/db/d3b/d6b/fa7 0 2024-03-04T09:33:07.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/614: sync 2024-03-04T09:33:07.772 INFO:tasks.workunit.client.0.smithi046.stdout:4/577: symlink d0/d5f/d6f/ld5 0 2024-03-04T09:33:07.854 INFO:tasks.workunit.client.0.smithi046.stdout:4/578: dwrite d0/d3/fc2 [0,4194304] 0 2024-03-04T09:33:08.133 INFO:tasks.workunit.client.0.smithi046.stdout:2/576: mkdir d5/da/dbc 0 2024-03-04T09:33:08.315 INFO:tasks.workunit.client.0.smithi046.stdout:8/488: mkdir d7/de/d12/da9 0 2024-03-04T09:33:08.782 INFO:tasks.workunit.client.0.smithi046.stdout:4/579: symlink d0/d3/d20/ld6 0 2024-03-04T09:33:08.782 INFO:tasks.workunit.client.0.smithi046.stdout:3/615: creat d1/d1d/d27/d40/d76/d8d/fd6 x:0 0 0 2024-03-04T09:33:08.882 INFO:tasks.workunit.client.0.smithi046.stdout:2/577: fsync d5/da/f65 0 2024-03-04T09:33:08.882 INFO:tasks.workunit.client.0.smithi046.stdout:8/489: link d7/de/d3e/f91 d7/de/d28/d71/faa 0 2024-03-04T09:33:08.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/608: dread d1/d11/d6/d8/d12/f1e [0,4194304] 0 2024-03-04T09:33:09.000 INFO:tasks.workunit.client.0.smithi046.stdout:9/609: dread d1/d11/d6/d8/d1d/d34/d46/f80 [0,4194304] 0 2024-03-04T09:33:09.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/504: rename d1/d3/de to d1/d44/d81/d96 0 2024-03-04T09:33:09.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/505: dread d1/f2 [0,4194304] 0 2024-03-04T09:33:09.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/506: fdatasync d1/f87 0 2024-03-04T09:33:09.743 INFO:tasks.workunit.client.0.smithi046.stdout:4/580: creat d0/d5f/d6f/fd7 x:0 0 0 2024-03-04T09:33:09.877 INFO:tasks.workunit.client.0.smithi046.stdout:3/616: mknod d1/d1d/d27/d4a/d78/cd7 0 2024-03-04T09:33:10.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/481: rmdir d1 39 2024-03-04T09:33:10.041 INFO:tasks.workunit.client.0.smithi046.stdout:1/482: fsync d1/d28/f40 0 2024-03-04T09:33:10.041 INFO:tasks.workunit.client.0.smithi046.stdout:1/483: stat d1/c58 0 2024-03-04T09:33:10.041 INFO:tasks.workunit.client.0.smithi046.stdout:1/484: stat d1/d28/d6f/d74/c8b 0 2024-03-04T09:33:10.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/521: rename d10/d12/d52/d5d/cb9 to d10/d12/d52/d78/d8a/da2/cbe 0 2024-03-04T09:33:10.541 INFO:tasks.workunit.client.0.smithi046.stdout:0/522: dwrite d10/d36/f85 [0,4194304] 0 2024-03-04T09:33:10.645 INFO:tasks.workunit.client.0.smithi046.stdout:4/581: symlink d0/d3/d20/d96/ld8 0 2024-03-04T09:33:10.645 INFO:tasks.workunit.client.0.smithi046.stdout:4/582: read d0/d3/d16/d1e/d73/f9a [1990024,60805] 0 2024-03-04T09:33:10.753 INFO:tasks.workunit.client.0.smithi046.stdout:3/617: unlink d1/d21/d35/c79 0 2024-03-04T09:33:11.037 INFO:tasks.workunit.client.0.smithi046.stdout:2/578: mkdir d5/da/dbd 0 2024-03-04T09:33:11.037 INFO:tasks.workunit.client.0.smithi046.stdout:1/485: mkdir d1/d92/d9a 0 2024-03-04T09:33:11.464 INFO:tasks.workunit.client.0.smithi046.stdout:4/583: creat d0/d3/d3b/fd9 x:0 0 0 2024-03-04T09:33:11.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/584: write d0/d5f/da2/fb0 [3975514,89119] 0 2024-03-04T09:33:11.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/585: chown d0/d3/d20/d96/ld8 0 1 2024-03-04T09:33:11.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/586: dread d0/d3/d20/d96/fa0 [0,4194304] 0 2024-03-04T09:33:11.566 INFO:tasks.workunit.client.0.smithi046.stdout:3/618: symlink d1/d1d/d5e/ld8 0 2024-03-04T09:33:11.593 INFO:tasks.workunit.client.0.smithi046.stdout:3/619: write d1/d74/f99 [889324,73166] 0 2024-03-04T09:33:11.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/620: write d1/d21/d35/d43/dd2/d51/f9d [323597,61980] 0 2024-03-04T09:33:11.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/621: chown d1/d21/d35/d43/dd2/f52 11 1 2024-03-04T09:33:11.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/622: write d1/d21/d35/d43/fbd [998124,53972] 0 2024-03-04T09:33:11.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/623: chown d1/d88/fd5 27598 1 2024-03-04T09:33:11.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/624: chown d1/c6 0 1 2024-03-04T09:33:11.616 INFO:tasks.workunit.client.0.smithi046.stdout:3/625: dread d1/d21/d35/d43/dd2/d51/da3/fcc [0,4194304] 0 2024-03-04T09:33:11.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/486: creat d1/d92/f9b x:0 0 0 2024-03-04T09:33:11.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/487: chown d1/c15 95 1 2024-03-04T09:33:12.558 INFO:tasks.workunit.client.0.smithi046.stdout:3/626: getdents d1/d21/d26 0 2024-03-04T09:33:12.558 INFO:tasks.workunit.client.0.smithi046.stdout:3/627: truncate d1/d21/d35/f6c 1459861 0 2024-03-04T09:33:12.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/508: sync 2024-03-04T09:33:12.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/610: sync 2024-03-04T09:33:12.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/611: dread - da/dd/d39/fd2 zero size 2024-03-04T09:33:12.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/509: dread d0/d4/f1f [0,4194304] 0 2024-03-04T09:33:12.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/510: chown d0/d4/db/d3b/f7c 107 1 2024-03-04T09:33:12.712 INFO:tasks.workunit.client.0.smithi046.stdout:1/488: unlink d1/d28/d6a/l81 0 2024-03-04T09:33:12.712 INFO:tasks.workunit.client.0.smithi046.stdout:1/489: write d1/d28/d6f/f80 [457377,75581] 0 2024-03-04T09:33:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/579: truncate d5/d84/d88/d47/f5c 975808 0 2024-03-04T09:33:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/580: chown d5/da/dbc 360500968 1 2024-03-04T09:33:12.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/610: sync 2024-03-04T09:33:13.010 INFO:tasks.workunit.client.0.smithi046.stdout:4/587: rmdir d0/d3/d20/d96/d6e 39 2024-03-04T09:33:13.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/628: symlink d1/d1d/ld9 0 2024-03-04T09:33:13.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/511: mkdir d0/d59/db1 0 2024-03-04T09:33:13.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/512: write d0/f11 [5807321,100243] 0 2024-03-04T09:33:13.520 INFO:tasks.workunit.client.0.smithi046.stdout:7/513: dread d0/d4/f36 [0,4194304] 0 2024-03-04T09:33:13.578 INFO:tasks.workunit.client.0.smithi046.stdout:7/514: dwrite d0/d4/d6e/fa0 [0,4194304] 0 2024-03-04T09:33:13.629 INFO:tasks.workunit.client.0.smithi046.stdout:5/507: write d1/f7 [4633758,31781] 0 2024-03-04T09:33:13.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/508: dread d1/d44/d81/d96/d20/f5d [0,4194304] 0 2024-03-04T09:33:13.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/581: dread d5/da/f21 [0,4194304] 0 2024-03-04T09:33:13.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/582: write d5/da/fab [1846188,75516] 0 2024-03-04T09:33:13.979 INFO:tasks.workunit.client.0.smithi046.stdout:9/611: rmdir d1/d11/d6/d8/d13/d85/db7 0 2024-03-04T09:33:14.261 INFO:tasks.workunit.client.0.smithi046.stdout:3/629: symlink d1/d1d/d27/d40/d76/lda 0 2024-03-04T09:33:14.270 INFO:tasks.workunit.client.0.smithi046.stdout:3/630: write d1/d21/d35/d43/fbd [703806,27057] 0 2024-03-04T09:33:14.270 INFO:tasks.workunit.client.0.smithi046.stdout:3/631: truncate d1/d1d/d27/d40/d76/d8d/d95/fa6 80948 0 2024-03-04T09:33:14.270 INFO:tasks.workunit.client.0.smithi046.stdout:3/632: chown d1/db0/fc4 266116699 1 2024-03-04T09:33:14.459 INFO:tasks.workunit.client.0.smithi046.stdout:7/515: creat d0/da/d46/d99/fb2 x:0 0 0 2024-03-04T09:33:14.460 INFO:tasks.workunit.client.0.smithi046.stdout:7/516: truncate d0/da/d46/d99/fb2 235662 0 2024-03-04T09:33:14.666 INFO:tasks.workunit.client.0.smithi046.stdout:5/509: symlink d1/d44/d81/d96/d20/d76/d6c/l97 0 2024-03-04T09:33:14.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/510: fdatasync d1/d44/d81/d96/d20/d76/f48 0 2024-03-04T09:33:14.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/511: write d1/d44/d81/d96/d4f/d8f/f90 [633092,11392] 0 2024-03-04T09:33:14.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/523: dwrite d10/f45 [0,4194304] 0 2024-03-04T09:33:14.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/524: write d10/d12/d1f/d3b/fbd [928618,61671] 0 2024-03-04T09:33:15.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/612: unlink d1/d11/d6/d8/d12/f52 0 2024-03-04T09:33:15.227 INFO:tasks.workunit.client.0.smithi046.stdout:4/588: symlink d0/d3/d3b/lda 0 2024-03-04T09:33:15.259 INFO:tasks.workunit.client.0.smithi046.stdout:4/589: write d0/f39 [213660,9318] 0 2024-03-04T09:33:15.259 INFO:tasks.workunit.client.0.smithi046.stdout:3/633: creat d1/fdb x:0 0 0 2024-03-04T09:33:15.282 INFO:tasks.workunit.client.0.smithi046.stdout:8/490: rename d7/de/d13 to d7/de/d28/dab 0 2024-03-04T09:33:15.282 INFO:tasks.workunit.client.0.smithi046.stdout:5/512: mknod d1/d44/d81/d96/d20/d76/c98 0 2024-03-04T09:33:15.282 INFO:tasks.workunit.client.0.smithi046.stdout:2/583: link d5/f1d d5/da/fbe 0 2024-03-04T09:33:15.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/525: rmdir d10/d12/d52/d78/d8a/da2 39 2024-03-04T09:33:15.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/491: dread d7/de/d28/d3a/d6f/d84/f8e [0,4194304] 0 2024-03-04T09:33:15.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/492: readlink d7/de/d4c/d5a/l90 0 2024-03-04T09:33:15.313 INFO:tasks.workunit.client.0.smithi046.stdout:0/526: dread d10/d12/fbc [0,4194304] 0 2024-03-04T09:33:15.313 INFO:tasks.workunit.client.0.smithi046.stdout:0/527: creat d10/d12/d52/d78/d8a/fbf x:0 0 0 2024-03-04T09:33:15.593 INFO:tasks.workunit.client.0.smithi046.stdout:9/613: creat d1/d11/d6/d8/d1d/fc3 x:0 0 0 2024-03-04T09:33:15.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/614: write d1/d11/d6/d8/f62 [1747211,98015] 0 2024-03-04T09:33:15.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/615: chown d1/d11/d6/l73 91 1 2024-03-04T09:33:15.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/616: fsync d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 0 2024-03-04T09:33:15.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/617: write d1/d11/d6/d8/d13/d92/f9d [4988948,42843] 0 2024-03-04T09:33:15.652 INFO:tasks.workunit.client.0.smithi046.stdout:9/618: dread d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 [0,4194304] 0 2024-03-04T09:33:15.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/619: dread d1/d11/d6/d8/fd [0,4194304] 0 2024-03-04T09:33:15.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/590: mkdir d0/d1f/d25/d50/ddb 0 2024-03-04T09:33:15.977 INFO:tasks.workunit.client.0.smithi046.stdout:3/634: link d1/d21/d35/d43/dd2/c94 d1/d88/cdc 0 2024-03-04T09:33:15.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/591: chown d0/d1f/f79 14 1 2024-03-04T09:33:15.977 INFO:tasks.workunit.client.0.smithi046.stdout:3/635: fdatasync d1/f1e 0 2024-03-04T09:33:16.055 INFO:tasks.workunit.client.0.smithi046.stdout:5/513: chown d1/d44/d81/d96/d20/c25 1908 1 2024-03-04T09:33:16.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/514: dwrite d1/d3/d3e/f46 [0,4194304] 0 2024-03-04T09:33:16.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/515: stat d1/d5f/f60 0 2024-03-04T09:33:16.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/493: rename d7/de/f6b to d7/de/d12/fac 0 2024-03-04T09:33:17.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/620: creat d1/d11/d6/d8/d1d/d34/d4d/fc4 x:0 0 0 2024-03-04T09:33:17.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/621: write d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 [5134777,87040] 0 2024-03-04T09:33:17.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/592: stat d0/d3/d16/d1e/l54 0 2024-03-04T09:33:17.697 INFO:tasks.workunit.client.0.smithi046.stdout:4/593: dread d0/d1f/f77 [0,4194304] 0 2024-03-04T09:33:17.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/636: link d1/d74/fce d1/d1d/d27/d4a/d78/fdd 0 2024-03-04T09:33:18.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/490: write d1/d28/f5b [1290047,43523] 0 2024-03-04T09:33:18.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/491: chown d1/fd 398790 1 2024-03-04T09:33:18.459 INFO:tasks.workunit.client.0.smithi046.stdout:9/622: rename d1/d11/d6/d8/d1d/d34/f9f to d1/fc5 0 2024-03-04T09:33:18.524 INFO:tasks.workunit.client.0.smithi046.stdout:4/594: mkdir d0/d3/d16/ddc 0 2024-03-04T09:33:18.765 INFO:tasks.workunit.client.0.smithi046.stdout:3/637: symlink d1/d21/d35/d43/dd2/d51/lde 0 2024-03-04T09:33:19.045 INFO:tasks.workunit.client.0.smithi046.stdout:5/516: rename d1/d3/d3e/c45 to d1/d44/d81/d96/d20/d76/d6c/d7b/c99 0 2024-03-04T09:33:19.045 INFO:tasks.workunit.client.0.smithi046.stdout:5/517: write d1/d5f/f7c [356552,9349] 0 2024-03-04T09:33:19.045 INFO:tasks.workunit.client.0.smithi046.stdout:4/595: mkdir d0/d1f/db9/ddd 0 2024-03-04T09:33:19.045 INFO:tasks.workunit.client.0.smithi046.stdout:4/596: chown d0/d3/f4 648745 1 2024-03-04T09:33:19.235 INFO:tasks.workunit.client.0.smithi046.stdout:3/638: truncate d1/d1d/d27/f2e 1519408 0 2024-03-04T09:33:19.235 INFO:tasks.workunit.client.0.smithi046.stdout:3/639: read - d1/fdb zero size 2024-03-04T09:33:19.474 INFO:tasks.workunit.client.0.smithi046.stdout:9/623: rename d1/d11/d6/d8/d1d/fc3 to d1/d11/d6/d8/d6f/d8c/d9a/fc6 0 2024-03-04T09:33:19.474 INFO:tasks.workunit.client.0.smithi046.stdout:9/624: dread - d1/d11/d6/d8/d12/d1c/d26/fb9 zero size 2024-03-04T09:33:19.699 INFO:tasks.workunit.client.0.smithi046.stdout:5/518: mkdir d1/d44/d81/d96/d9a 0 2024-03-04T09:33:19.699 INFO:tasks.workunit.client.0.smithi046.stdout:5/519: chown d1/f1b 2 1 2024-03-04T09:33:19.699 INFO:tasks.workunit.client.0.smithi046.stdout:5/520: write d1/f2 [1284958,3789] 0 2024-03-04T09:33:19.944 INFO:tasks.workunit.client.0.smithi046.stdout:6/612: sync 2024-03-04T09:33:19.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/517: sync 2024-03-04T09:33:19.944 INFO:tasks.workunit.client.0.smithi046.stdout:6/613: dread - da/dd/d39/d60/da0/fa5 zero size 2024-03-04T09:33:20.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/625: symlink d1/d11/d6/d8/d12/lc7 0 2024-03-04T09:33:20.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/626: fdatasync d1/d11/d6/d8/f33 0 2024-03-04T09:33:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:5/521: mkdir d1/d5f/d9b 0 2024-03-04T09:33:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:5/522: stat d1/d44/d57/d70 0 2024-03-04T09:33:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:9/627: dwrite d1/d11/f75 [0,4194304] 0 2024-03-04T09:33:20.118 INFO:tasks.workunit.client.0.smithi046.stdout:9/628: dread d1/d11/d6/d8/fd [0,4194304] 0 2024-03-04T09:33:20.509 INFO:tasks.workunit.client.0.smithi046.stdout:7/518: getdents d0/d4 0 2024-03-04T09:33:20.509 INFO:tasks.workunit.client.0.smithi046.stdout:7/519: fsync d0/d3c/f69 0 2024-03-04T09:33:20.694 INFO:tasks.workunit.client.0.smithi046.stdout:6/614: rename da/d14/d1e/d27/d78/c3e to da/d14/d1e/d27/d8c/dbf/cd7 0 2024-03-04T09:33:20.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/615: write da/d14/d1e/d27/d4a/d94/fbe [541651,105358] 0 2024-03-04T09:33:20.803 INFO:tasks.workunit.client.0.smithi046.stdout:5/523: truncate d1/f7f 2254838 0 2024-03-04T09:33:20.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:33:20.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:33:21.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/584: write d5/f4e [3718918,125518] 0 2024-03-04T09:33:21.645 INFO:tasks.workunit.client.0.smithi046.stdout:7/520: creat d0/d4/db/d12/d28/fb3 x:0 0 0 2024-03-04T09:33:21.645 INFO:tasks.workunit.client.0.smithi046.stdout:0/528: sync 2024-03-04T09:33:21.713 INFO:tasks.workunit.client.0.smithi046.stdout:0/529: dwrite d10/d12/d1f/d3b/fbd [0,4194304] 0 2024-03-04T09:33:21.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/530: dread f1 [0,4194304] 0 2024-03-04T09:33:21.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/531: chown d10/d36 6404 1 2024-03-04T09:33:21.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/629: rename d1/d11/d6/d8/d12/lc7 to d1/d11/d6/d8/d1d/d34/d35/lc8 0 2024-03-04T09:33:21.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/630: dwrite d1/d11/d6/d8/d1d/d34/d46/fba [0,4194304] 0 2024-03-04T09:33:21.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/631: write d1/d11/d6/d8/d12/fc2 [461357,54173] 0 2024-03-04T09:33:21.996 INFO:tasks.workunit.client.0.smithi046.stdout:6/616: mkdir da/dd8 0 2024-03-04T09:33:22.027 INFO:tasks.workunit.client.0.smithi046.stdout:6/617: read da/d14/d1e/d27/f43 [3558908,69984] 0 2024-03-04T09:33:22.027 INFO:tasks.workunit.client.0.smithi046.stdout:6/618: chown da/d14/d1e/f30 1313658 1 2024-03-04T09:33:22.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/585: creat d5/da/fbf x:0 0 0 2024-03-04T09:33:22.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/586: write d5/d84/d88/f55 [1009911,75137] 0 2024-03-04T09:33:22.307 INFO:tasks.workunit.client.0.smithi046.stdout:7/521: link d0/d4/db/d12/c22 d0/d59/db1/cb4 0 2024-03-04T09:33:22.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/532: rename d10/d12/d52/d5d/c60 to d10/d36/d87/cc0 0 2024-03-04T09:33:22.586 INFO:tasks.workunit.client.0.smithi046.stdout:0/533: dread d10/d12/d1f/d3b/d6b/f72 [0,4194304] 0 2024-03-04T09:33:22.904 INFO:tasks.workunit.client.0.smithi046.stdout:9/632: unlink d1/d11/d6/d8/d1d/d34/f3c 0 2024-03-04T09:33:22.904 INFO:tasks.workunit.client.0.smithi046.stdout:8/494: sync 2024-03-04T09:33:22.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/495: dread d7/de/f18 [0,4194304] 0 2024-03-04T09:33:22.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/619: mknod da/dd/d39/cd9 0 2024-03-04T09:33:22.964 INFO:tasks.workunit.client.0.smithi046.stdout:9/633: dwrite d1/d11/d6/f83 [0,4194304] 0 2024-03-04T09:33:23.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/496: dwrite d7/fc [4194304,4194304] 0 2024-03-04T09:33:23.140 INFO:tasks.workunit.client.0.smithi046.stdout:2/587: mknod d5/d84/d88/cc0 0 2024-03-04T09:33:23.434 INFO:tasks.workunit.client.0.smithi046.stdout:7/522: creat d0/d59/db1/fb5 x:0 0 0 2024-03-04T09:33:23.434 INFO:tasks.workunit.client.0.smithi046.stdout:7/523: creat d0/d4/d6e/fb6 x:0 0 0 2024-03-04T09:33:23.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/534: dread d10/d36/f3a [0,4194304] 0 2024-03-04T09:33:23.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/620: dread - da/d14/d1e/d27/d78/d66/faa zero size 2024-03-04T09:33:23.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/621: chown da/dd/d39/d60/c65 0 1 2024-03-04T09:33:23.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/634: symlink d1/d11/d6/d8/d12/d1c/lc9 0 2024-03-04T09:33:23.993 INFO:tasks.workunit.client.0.smithi046.stdout:1/492: write d1/f24 [1608419,48462] 0 2024-03-04T09:33:24.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/635: dwrite d1/d11/d6/d8/d12/f30 [0,4194304] 0 2024-03-04T09:33:24.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/636: fsync d1/d11/d6/d8/d1d/d34/d46/d5e/fbe 0 2024-03-04T09:33:24.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/637: chown d1/d11/d6/d8/d1d/d34/d7f 2907182 1 2024-03-04T09:33:24.400 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:44:35.207 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.412 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:44:35.283 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.415 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:44:35.286 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.425 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:44:35.233 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.430 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:44:35.300 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.432 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:44:35.303 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.482 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:44:35.352 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.509 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:44:35.316 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.513 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:44:35.384 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:33:24.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/640: write d1/d1d/d27/d4a/f55 [3196836,98782] 0 2024-03-04T09:33:25.187 INFO:tasks.workunit.client.0.smithi046.stdout:2/588: creat d5/d84/d88/fc1 x:0 0 0 2024-03-04T09:33:25.544 INFO:tasks.workunit.client.0.smithi046.stdout:0/535: creat d10/d12/d1f/d3f/fc1 x:0 0 0 2024-03-04T09:33:25.544 INFO:tasks.workunit.client.0.smithi046.stdout:0/536: fdatasync d10/d12/d52/d5d/f69 0 2024-03-04T09:33:25.599 INFO:tasks.workunit.client.0.smithi046.stdout:6/622: creat da/dd/d22/da7/fda x:0 0 0 2024-03-04T09:33:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:5/524: dread d1/f7f [0,4194304] 0 2024-03-04T09:33:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/493: mknod d1/d92/d9a/c9c 0 2024-03-04T09:33:25.860 INFO:tasks.workunit.client.0.smithi046.stdout:9/638: truncate d1/d11/d6/d8/d13/d21/f69 7670418 0 2024-03-04T09:33:25.860 INFO:tasks.workunit.client.0.smithi046.stdout:9/639: truncate d1/d11/d6/d8/d12/fc2 1023547 0 2024-03-04T09:33:25.860 INFO:tasks.workunit.client.0.smithi046.stdout:9/640: read d1/d11/d6/d8/fd [1865581,124149] 0 2024-03-04T09:33:26.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/641: link d1/d21/d35/d43/dd2/c34 d1/d1d/d27/d40/d76/cdf 0 2024-03-04T09:33:26.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/589: symlink d5/d2c/d51/d61/db5/lc2 0 2024-03-04T09:33:26.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/590: fsync d5/da/fab 0 2024-03-04T09:33:26.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/591: dread d5/f6b [0,4194304] 0 2024-03-04T09:33:26.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/524: getdents d0/da/d4e 0 2024-03-04T09:33:26.927 INFO:tasks.workunit.client.0.smithi046.stdout:6/623: dread - da/d14/d1e/d27/d78/f5f zero size 2024-03-04T09:33:27.123 INFO:tasks.workunit.client.0.smithi046.stdout:1/494: creat d1/d92/d96/f9d x:0 0 0 2024-03-04T09:33:27.303 INFO:tasks.workunit.client.0.smithi046.stdout:3/642: mkdir d1/d1d/d27/d4a/d78/de0 0 2024-03-04T09:33:27.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/597: rmdir d0/d1f/d5b 39 2024-03-04T09:33:27.668 INFO:tasks.workunit.client.0.smithi046.stdout:6/624: getdents da/dd/d39/d60/dac/daf 0 2024-03-04T09:33:27.751 INFO:tasks.workunit.client.0.smithi046.stdout:6/625: dwrite da/dd/d22/da7/fda [0,4194304] 0 2024-03-04T09:33:27.836 INFO:tasks.workunit.client.0.smithi046.stdout:6/626: dwrite da/dd/d39/d60/da0/f62 [0,4194304] 0 2024-03-04T09:33:27.836 INFO:tasks.workunit.client.0.smithi046.stdout:6/627: chown da/dd/d46/fd0 49 1 2024-03-04T09:33:27.901 INFO:tasks.workunit.client.0.smithi046.stdout:3/643: symlink d1/d1d/d27/d40/d76/le1 0 2024-03-04T09:33:27.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/525: symlink d0/d4/db/d12/d28/lb7 0 2024-03-04T09:33:27.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/526: truncate d0/d4/f86 481091 0 2024-03-04T09:33:27.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/527: write d0/d4/db/d12/f30 [9043193,124400] 0 2024-03-04T09:33:27.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/528: creat d0/da/d46/d99/fb8 x:0 0 0 2024-03-04T09:33:28.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/529: dwrite d0/d4/db/d38/d64/faa [0,4194304] 0 2024-03-04T09:33:28.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/530: write d0/d4/db/d38/d64/faa [4364850,85601] 0 2024-03-04T09:33:28.284 INFO:tasks.workunit.client.0.smithi046.stdout:4/598: mknod d0/d1f/cde 0 2024-03-04T09:33:28.497 INFO:tasks.workunit.client.0.smithi046.stdout:6/628: getdents da/d14/d1e/d27/d78/d66/d81 0 2024-03-04T09:33:28.798 INFO:tasks.workunit.client.0.smithi046.stdout:7/531: mknod d0/d4/d6e/cb9 0 2024-03-04T09:33:29.115 INFO:tasks.workunit.client.0.smithi046.stdout:6/629: creat da/dd/d39/fdb x:0 0 0 2024-03-04T09:33:29.452 INFO:tasks.workunit.client.0.smithi046.stdout:4/599: rmdir d0/d3/d16/d1e/da1 39 2024-03-04T09:33:29.567 INFO:tasks.workunit.client.0.smithi046.stdout:6/630: mkdir da/d14/d1e/d27/d4a/dab/ddc 0 2024-03-04T09:33:29.972 INFO:tasks.workunit.client.0.smithi046.stdout:4/600: truncate d0/d3/d3b/d8d/fa3 1495251 0 2024-03-04T09:33:29.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/601: creat d0/d1f/d25/d50/fdf x:0 0 0 2024-03-04T09:33:30.106 INFO:tasks.workunit.client.0.smithi046.stdout:6/631: mkdir da/dd/d39/d60/da0/ddd 0 2024-03-04T09:33:30.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/632: dwrite da/dd/d22/f70 [0,4194304] 0 2024-03-04T09:33:30.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/633: symlink da/d14/d1e/d27/d4a/d94/lde 0 2024-03-04T09:33:31.105 INFO:tasks.workunit.client.0.smithi046.stdout:8/497: write d7/de/f18 [767643,112507] 0 2024-03-04T09:33:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:6/634: mkdir da/d14/d1e/d8f/ddf 0 2024-03-04T09:33:32.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/635: dread da/d14/d1e/d27/d4a/d94/fbe [0,4194304] 0 2024-03-04T09:33:32.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/636: dread - da/dd/f7f zero size 2024-03-04T09:33:32.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/537: rename d10/d12/d52/d78/d8a/db4 to d10/dc2 0 2024-03-04T09:33:32.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/538: fsync d10/d12/f56 0 2024-03-04T09:33:32.633 INFO:tasks.workunit.client.0.smithi046.stdout:6/637: mkdir da/d14/de0 0 2024-03-04T09:33:32.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/532: write d0/d4/db/d12/d28/f4b [6906306,50868] 0 2024-03-04T09:33:32.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/533: creat d0/d59/fba x:0 0 0 2024-03-04T09:33:32.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/534: fdatasync d0/da/d41/f95 0 2024-03-04T09:33:32.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/535: chown d0/da/d41/c6a 908630 1 2024-03-04T09:33:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:0/539: truncate d10/d12/d6e/f93 180010 0 2024-03-04T09:33:33.106 INFO:tasks.workunit.client.0.smithi046.stdout:6/638: symlink da/d14/d1e/d27/d4a/dab/le1 0 2024-03-04T09:33:33.388 INFO:tasks.workunit.client.0.smithi046.stdout:5/525: mknod d1/d44/d81/d96/d20/c9c 0 2024-03-04T09:33:33.657 INFO:tasks.workunit.client.0.smithi046.stdout:0/540: mkdir d10/d12/d9f/da6/dc3 0 2024-03-04T09:33:33.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/541: dread d10/d12/d52/d5d/d83/f95 [0,4194304] 0 2024-03-04T09:33:33.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/542: write d10/d12/d52/d5d/f61 [267376,47283] 0 2024-03-04T09:33:33.679 INFO:tasks.workunit.client.0.smithi046.stdout:0/543: write d10/d36/f76 [454607,59861] 0 2024-03-04T09:33:33.679 INFO:tasks.workunit.client.0.smithi046.stdout:0/544: fsync d10/d12/d1f/d3f/d7e/fad 0 2024-03-04T09:33:33.754 INFO:tasks.workunit.client.0.smithi046.stdout:0/545: dwrite d10/d12/d1f/fb6 [0,4194304] 0 2024-03-04T09:33:33.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/546: chown d10/d12/d1f/d3f/f66 9 1 2024-03-04T09:33:33.766 INFO:tasks.workunit.client.0.smithi046.stdout:6/639: mknod da/dd/d39/d60/da0/d67/d64/ce2 0 2024-03-04T09:33:33.867 INFO:tasks.workunit.client.0.smithi046.stdout:7/536: truncate d0/d4/db/d3b/f53 1423760 0 2024-03-04T09:33:34.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/537: truncate d0/da/d46/f5e 1632474 0 2024-03-04T09:33:35.132 INFO:tasks.workunit.client.0.smithi046.stdout:7/538: unlink d0/d4/db/d3b/l4d 0 2024-03-04T09:33:35.132 INFO:tasks.workunit.client.0.smithi046.stdout:7/539: write d0/f11 [5741264,82479] 0 2024-03-04T09:33:35.232 INFO:tasks.workunit.client.0.smithi046.stdout:2/592: rename d5/d84/l5d to d5/d40/lc3 0 2024-03-04T09:33:35.232 INFO:tasks.workunit.client.0.smithi046.stdout:2/593: chown d5/da/d1b/l32 494159861 1 2024-03-04T09:33:35.548 INFO:tasks.workunit.client.0.smithi046.stdout:1/495: rename d1/c5 to d1/d28/c9e 0 2024-03-04T09:33:35.942 INFO:tasks.workunit.client.0.smithi046.stdout:2/594: dread d5/f3b [0,4194304] 0 2024-03-04T09:33:36.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/540: creat d0/d58/fbb x:0 0 0 2024-03-04T09:33:36.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/644: rename d1/d21/d35/d24/f1b to d1/d1d/d5e/fe2 0 2024-03-04T09:33:36.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/645: dread d1/d74/fb6 [0,4194304] 0 2024-03-04T09:33:36.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/646: chown d1/d1d/d5e/lbb 483602 1 2024-03-04T09:33:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/595: mknod d5/d2c/d51/d61/cc4 0 2024-03-04T09:33:37.283 INFO:tasks.workunit.client.0.smithi046.stdout:3/647: rmdir d1/d1d/d27/d4a/d78 39 2024-03-04T09:33:37.283 INFO:tasks.workunit.client.0.smithi046.stdout:3/648: dread - d1/d74/fbf zero size 2024-03-04T09:33:37.283 INFO:tasks.workunit.client.0.smithi046.stdout:1/496: rmdir d1/d92/d96 39 2024-03-04T09:33:37.660 INFO:tasks.workunit.client.0.smithi046.stdout:9/641: unlink d1/d11/d6/f83 0 2024-03-04T09:33:38.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/596: link d5/d84/d88/d47/f67 d5/d84/d7c/fc5 0 2024-03-04T09:33:38.282 INFO:tasks.workunit.client.0.smithi046.stdout:3/649: mkdir d1/d1d/d5e/de3 0 2024-03-04T09:33:38.584 INFO:tasks.workunit.client.0.smithi046.stdout:7/541: symlink d0/d4/db/d12/lbc 0 2024-03-04T09:33:38.584 INFO:tasks.workunit.client.0.smithi046.stdout:7/542: fsync d0/d59/fba 0 2024-03-04T09:33:38.629 INFO:tasks.workunit.client.0.smithi046.stdout:9/642: mknod d1/d11/d6/d8/cca 0 2024-03-04T09:33:39.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/597: symlink d5/d84/d88/d47/lc6 0 2024-03-04T09:33:39.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/650: symlink d1/d1d/d27/d40/d70/le4 0 2024-03-04T09:33:39.501 INFO:tasks.workunit.client.0.smithi046.stdout:3/651: dread d1/d21/d35/f13 [4194304,4194304] 0 2024-03-04T09:33:39.741 INFO:tasks.workunit.client.0.smithi046.stdout:7/543: getdents d0/da 0 2024-03-04T09:33:39.757 INFO:tasks.workunit.client.0.smithi046.stdout:7/544: dread d0/d4/f1f [4194304,4194304] 0 2024-03-04T09:33:39.757 INFO:tasks.workunit.client.0.smithi046.stdout:7/545: fsync d0/d4/db/d38/d64/f93 0 2024-03-04T09:33:39.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/602: rename d0/c65 to d0/d3/d16/ddc/ce0 0 2024-03-04T09:33:40.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/498: sync 2024-03-04T09:33:40.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/499: dread - d7/de/d12/f8b zero size 2024-03-04T09:33:40.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/500: write d7/f5f [4982361,125419] 0 2024-03-04T09:33:40.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/501: creat d7/de/d12/fad x:0 0 0 2024-03-04T09:33:40.367 INFO:tasks.workunit.client.0.smithi046.stdout:3/652: rmdir d1/d21/d26 39 2024-03-04T09:33:40.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/598: sync 2024-03-04T09:33:40.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/599: creat d5/d2c/d51/fc7 x:0 0 0 2024-03-04T09:33:40.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/600: dread d5/da/fab [0,4194304] 0 2024-03-04T09:33:40.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/546: dread d0/d4/db/d12/f34 [0,4194304] 0 2024-03-04T09:33:40.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/603: mknod d0/d1f/d25/d50/d63/ce1 0 2024-03-04T09:33:41.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/502: creat d7/de/d28/dab/d2c/fae x:0 0 0 2024-03-04T09:33:41.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/653: link d1/d21/d26/l71 d1/d1d/le5 0 2024-03-04T09:33:41.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/654: truncate d1/d74/fca 528709 0 2024-03-04T09:33:41.501 INFO:tasks.workunit.client.0.smithi046.stdout:3/655: chown d1/d1d/c5b 28 1 2024-03-04T09:33:41.501 INFO:tasks.workunit.client.0.smithi046.stdout:3/656: stat d1/d21/d35/d43/dd2/d51/l5f 0 2024-03-04T09:33:41.507 INFO:tasks.workunit.client.0.smithi046.stdout:8/503: dwrite d7/de/d28/f2e [0,4194304] 0 2024-03-04T09:33:41.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/601: chown d5/da/l39 5 1 2024-03-04T09:33:41.587 INFO:tasks.workunit.client.0.smithi046.stdout:7/547: creat d0/da/fbd x:0 0 0 2024-03-04T09:33:42.250 INFO:tasks.workunit.client.0.smithi046.stdout:4/604: creat d0/d3/d20/d96/d6e/fe2 x:0 0 0 2024-03-04T09:33:42.451 INFO:tasks.workunit.client.0.smithi046.stdout:3/657: creat d1/d21/d35/d24/fe6 x:0 0 0 2024-03-04T09:33:42.451 INFO:tasks.workunit.client.0.smithi046.stdout:3/658: fsync d1/d21/d35/d24/fc6 0 2024-03-04T09:33:42.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/659: dwrite d1/d1d/d27/d4a/fb2 [0,4194304] 0 2024-03-04T09:33:42.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/660: dwrite d1/d21/d35/d43/f62 [0,4194304] 0 2024-03-04T09:33:42.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/661: fsync d1/d1d/d27/d40/d76/d8d/d95/f87 0 2024-03-04T09:33:42.788 INFO:tasks.workunit.client.0.smithi046.stdout:8/504: mknod d7/d53/d72/caf 0 2024-03-04T09:33:43.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/526: rename d1/d3 to d1/d5f/d9b/d9d 0 2024-03-04T09:33:43.698 INFO:tasks.workunit.client.0.smithi046.stdout:4/605: dread d0/d3/f6 [0,4194304] 0 2024-03-04T09:33:43.698 INFO:tasks.workunit.client.0.smithi046.stdout:4/606: write d0/d3/f4 [1339301,29955] 0 2024-03-04T09:33:43.832 INFO:tasks.workunit.client.0.smithi046.stdout:3/662: mkdir d1/d21/de7 0 2024-03-04T09:33:43.885 INFO:tasks.workunit.client.0.smithi046.stdout:2/602: dwrite d5/d84/d88/d47/f5c [0,4194304] 0 2024-03-04T09:33:44.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/505: link d7/de/d12/f59 d7/d53/d72/fb0 0 2024-03-04T09:33:44.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/506: dread - d7/de/d4c/d50/f7a zero size 2024-03-04T09:33:44.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/507: fdatasync d7/de/d28/dab/f38 0 2024-03-04T09:33:44.268 INFO:tasks.workunit.client.0.smithi046.stdout:7/548: symlink d0/d4/db/d12/lbe 0 2024-03-04T09:33:44.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/547: rename d10/l28 to d10/d12/d52/d78/lc4 0 2024-03-04T09:33:44.496 INFO:tasks.workunit.client.0.smithi046.stdout:0/548: write d10/d12/d52/d78/f33 [325149,8347] 0 2024-03-04T09:33:44.497 INFO:tasks.workunit.client.0.smithi046.stdout:0/549: creat d10/d12/d1f/d3f/fc5 x:0 0 0 2024-03-04T09:33:45.101 INFO:tasks.workunit.client.0.smithi046.stdout:6/640: rename da/dd/d46/db1 to da/d14/d17/dd3/de3 0 2024-03-04T09:33:45.250 INFO:tasks.workunit.client.0.smithi046.stdout:0/550: symlink d10/d12/d1f/d3f/d7e/lc6 0 2024-03-04T09:33:45.250 INFO:tasks.workunit.client.0.smithi046.stdout:0/551: chown d10/d12/d1f/d3f/d7e 114643719 1 2024-03-04T09:33:45.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/552: fdatasync d10/d12/d52/d78/f33 0 2024-03-04T09:33:45.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/553: truncate d10/d12/fb3 699436 0 2024-03-04T09:33:45.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/554: dwrite d10/d12/d52/d78/f3c [0,4194304] 0 2024-03-04T09:33:45.328 INFO:tasks.workunit.client.0.smithi046.stdout:2/603: unlink d5/da/c27 0 2024-03-04T09:33:45.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/508: truncate d7/de/d28/d71/faa 224217 0 2024-03-04T09:33:45.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/509: getdents d7/de/d28/dab/d2c/d64 0 2024-03-04T09:33:45.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/510: dread - d7/de/d4c/d50/f7a zero size 2024-03-04T09:33:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/511: dread d7/d53/f65 [0,4194304] 0 2024-03-04T09:33:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/512: chown d7 1572670 1 2024-03-04T09:33:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/513: chown d7/de/d4c/c6a 83 1 2024-03-04T09:33:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:8/514: dread d7/de/d28/f37 [0,4194304] 0 2024-03-04T09:33:45.644 INFO:tasks.workunit.client.0.smithi046.stdout:1/497: rename d1/d28/d6f/c84 to d1/d92/d9a/c9f 0 2024-03-04T09:33:45.723 INFO:tasks.workunit.client.0.smithi046.stdout:1/498: dwrite d1/f56 [4194304,4194304] 0 2024-03-04T09:33:45.723 INFO:tasks.workunit.client.0.smithi046.stdout:1/499: fsync d1/f5e 0 2024-03-04T09:33:45.846 INFO:tasks.workunit.client.0.smithi046.stdout:6/641: truncate da/dd/d39/d60/da0/d67/fa8 73096 0 2024-03-04T09:33:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:1/500: mknod d1/d92/ca0 0 2024-03-04T09:33:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:1/501: write d1/d28/f6e [51860,56033] 0 2024-03-04T09:33:46.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/502: fsync d1/f25 0 2024-03-04T09:33:46.265 INFO:tasks.workunit.client.0.smithi046.stdout:7/549: dwrite d0/d4/f86 [0,4194304] 0 2024-03-04T09:33:46.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/642: creat da/dd/d39/d60/da0/ddd/fe4 x:0 0 0 2024-03-04T09:33:46.657 INFO:tasks.workunit.client.0.smithi046.stdout:0/555: rmdir d10/d12/d9f/da6 39 2024-03-04T09:33:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/643: rename d1/d11/d6/d8/d6f/f9b to d1/d11/d6/d8/d1d/d34/d46/d5e/fcb 0 2024-03-04T09:33:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/644: stat d1/d11/d6/d8/d12/d1c/lc9 0 2024-03-04T09:33:47.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/503: mknod d1/d28/d6f/d74/d97/ca1 0 2024-03-04T09:33:47.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/504: fsync d1/d28/d6f/d74/f88 0 2024-03-04T09:33:47.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/550: symlink d0/d4/db/d38/d94/lbf 0 2024-03-04T09:33:47.614 INFO:tasks.workunit.client.0.smithi046.stdout:6/643: unlink da/dd/d39/d60/l90 0 2024-03-04T09:33:48.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/556: mknod d10/d12/cc7 0 2024-03-04T09:33:48.715 INFO:tasks.workunit.client.0.smithi046.stdout:7/551: mkdir d0/d4/db/d38/dc0 0 2024-03-04T09:33:48.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/644: truncate da/dd/f36 1841971 0 2024-03-04T09:33:48.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/645: truncate da/d4e/fc4 947009 0 2024-03-04T09:33:49.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/557: mkdir d10/d12/d52/d78/d8a/da2/dc8 0 2024-03-04T09:33:49.102 INFO:tasks.workunit.client.0.smithi046.stdout:0/558: chown d10/d12/f1b 1894 1 2024-03-04T09:33:49.275 INFO:tasks.workunit.client.0.smithi046.stdout:5/527: rename d1/d5f/d9b/d9d/d3e/c6a to d1/d5f/d9b/d9d/c9e 0 2024-03-04T09:33:49.275 INFO:tasks.workunit.client.0.smithi046.stdout:4/607: rename d0/d1f to d0/d1f/de3 22 2024-03-04T09:33:49.343 INFO:tasks.workunit.client.0.smithi046.stdout:8/515: write d7/de/d28/dab/d2c/f45 [672009,40795] 0 2024-03-04T09:33:49.632 INFO:tasks.workunit.client.0.smithi046.stdout:5/528: mknod d1/d44/d57/d70/c9f 0 2024-03-04T09:33:49.633 INFO:tasks.workunit.client.0.smithi046.stdout:0/559: truncate d10/d12/f1b 1289659 0 2024-03-04T09:33:49.648 INFO:tasks.workunit.client.0.smithi046.stdout:5/529: dread d1/d5f/f7c [0,4194304] 0 2024-03-04T09:33:49.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/530: dread d1/f36 [0,4194304] 0 2024-03-04T09:33:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:5/531: dwrite d1/d44/d81/d96/d20/f42 [4194304,4194304] 0 2024-03-04T09:33:49.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/532: dread d1/d44/d81/d96/d20/d76/d6c/d7b/f4d [0,4194304] 0 2024-03-04T09:33:49.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/533: read - d1/d5f/d9b/d9d/d1f/f37 zero size 2024-03-04T09:33:49.790 INFO:tasks.workunit.client.0.smithi046.stdout:3/663: rename d1/d21/d35/d43/c85 to d1/d1d/d27/d40/ce8 0 2024-03-04T09:33:49.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/534: dread d1/f7f [0,4194304] 0 2024-03-04T09:33:50.202 INFO:tasks.workunit.client.0.smithi046.stdout:6/646: mknod da/d14/d1e/d27/d78/ce5 0 2024-03-04T09:33:50.226 INFO:tasks.workunit.client.0.smithi046.stdout:6/647: dread da/d14/d1e/d27/da3/fcc [0,4194304] 0 2024-03-04T09:33:50.915 INFO:tasks.workunit.client.0.smithi046.stdout:0/560: mknod d10/d12/d52/d78/d8a/da2/cc9 0 2024-03-04T09:33:50.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/561: dwrite d10/d12/d52/d5d/f61 [0,4194304] 0 2024-03-04T09:33:51.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:33:51.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:33:51.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/664: link d1/d21/d35/d43/fbd d1/d21/d35/d43/dd2/fe9 0 2024-03-04T09:33:51.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/665: dread d1/d21/d35/d43/f63 [0,4194304] 0 2024-03-04T09:33:51.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/666: chown d1/d21/d35/d43/dd2 26741063 1 2024-03-04T09:33:51.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/535: mkdir d1/d44/d81/d96/d9a/da0 0 2024-03-04T09:33:51.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/536: read d1/d44/d81/d96/d20/d5e/f74 [611354,68772] 0 2024-03-04T09:33:51.287 INFO:tasks.workunit.client.0.smithi046.stdout:5/537: dwrite d1/d44/d81/f91 [0,4194304] 0 2024-03-04T09:33:51.827 INFO:tasks.workunit.client.0.smithi046.stdout:1/505: dwrite d1/d28/f60 [0,4194304] 0 2024-03-04T09:33:52.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/562: mkdir d10/d12/d9f/dca 0 2024-03-04T09:33:52.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/563: chown d10/d36/d87 13012642 1 2024-03-04T09:33:52.153 INFO:tasks.workunit.client.0.smithi046.stdout:0/564: write d10/d12/d52/d78/f3c [2001521,23118] 0 2024-03-04T09:33:52.153 INFO:tasks.workunit.client.0.smithi046.stdout:0/565: creat d10/d12/d52/d5d/fcb x:0 0 0 2024-03-04T09:33:52.379 INFO:tasks.workunit.client.0.smithi046.stdout:2/604: rename d5/da/c83 to d5/d2c/cc8 0 2024-03-04T09:33:52.429 INFO:tasks.workunit.client.0.smithi046.stdout:3/667: getdents d1/d21/d35/d43/dd2/d51 0 2024-03-04T09:33:52.429 INFO:tasks.workunit.client.0.smithi046.stdout:3/668: write d1/fdb [143322,72752] 0 2024-03-04T09:33:52.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/538: symlink d1/d44/d81/d96/d4f/d8f/la1 0 2024-03-04T09:33:53.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/506: creat d1/d28/d6f/fa2 x:0 0 0 2024-03-04T09:33:54.052 INFO:tasks.workunit.client.0.smithi046.stdout:9/645: rename d1/d11/d6/d8/d1d/d34/d35/c61 to d1/d11/d6/ccc 0 2024-03-04T09:33:54.053 INFO:tasks.workunit.client.0.smithi046.stdout:8/516: sync 2024-03-04T09:33:54.053 INFO:tasks.workunit.client.0.smithi046.stdout:8/517: write d7/de/f75 [1035799,816] 0 2024-03-04T09:33:54.135 INFO:tasks.workunit.client.0.smithi046.stdout:8/518: dwrite d7/de/d28/f58 [0,4194304] 0 2024-03-04T09:33:54.135 INFO:tasks.workunit.client.0.smithi046.stdout:8/519: truncate d7/de/d12/fad 144950 0 2024-03-04T09:33:54.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/669: mknod d1/d1d/d5e/de3/cea 0 2024-03-04T09:33:54.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/670: fsync d1/d21/d35/d24/f18 0 2024-03-04T09:33:54.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/671: write d1/d1d/f3a [2080720,92536] 0 2024-03-04T09:33:54.222 INFO:tasks.workunit.client.0.smithi046.stdout:8/520: dwrite d7/de/d4c/d50/f7a [0,4194304] 0 2024-03-04T09:33:54.222 INFO:tasks.workunit.client.0.smithi046.stdout:8/521: chown d7/de/d28/d3a/d7d 25 1 2024-03-04T09:33:54.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/507: creat d1/d28/fa3 x:0 0 0 2024-03-04T09:33:54.664 INFO:tasks.workunit.client.0.smithi046.stdout:6/648: sync 2024-03-04T09:33:54.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/649: dread da/d14/d1e/d27/d78/d66/fad [0,4194304] 0 2024-03-04T09:33:54.957 INFO:tasks.workunit.client.0.smithi046.stdout:9/646: truncate d1/d11/d6/d8/fd 4379209 0 2024-03-04T09:33:55.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/672: mknod d1/d74/ceb 0 2024-03-04T09:33:55.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/673: truncate d1/d74/fbf 501410 0 2024-03-04T09:33:55.524 INFO:tasks.workunit.client.0.smithi046.stdout:8/522: creat d7/de/d28/dab/d3c/fb1 x:0 0 0 2024-03-04T09:33:55.616 INFO:tasks.workunit.client.0.smithi046.stdout:8/523: dwrite d7/de/d28/dab/f99 [0,4194304] 0 2024-03-04T09:33:55.617 INFO:tasks.workunit.client.0.smithi046.stdout:8/524: creat d7/de/d3e/da1/fb2 x:0 0 0 2024-03-04T09:33:55.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/508: symlink d1/d92/la4 0 2024-03-04T09:33:55.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/509: write d1/f98 [266796,67241] 0 2024-03-04T09:33:55.745 INFO:tasks.workunit.client.0.smithi046.stdout:6/650: unlink da/d14/l89 0 2024-03-04T09:33:55.859 INFO:tasks.workunit.client.0.smithi046.stdout:7/552: rename d0/d4/db/d38/d64 to d0/d4/db/d12/dc1 0 2024-03-04T09:33:55.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/553: dread - d0/d2d/d85/f9a zero size 2024-03-04T09:33:56.541 INFO:tasks.workunit.client.0.smithi046.stdout:4/608: rename d0/d3/d20/d96/d6e/d85/dc5/lab to d0/d1f/d5b/le4 0 2024-03-04T09:33:56.541 INFO:tasks.workunit.client.0.smithi046.stdout:4/609: fdatasync d0/d3/f57 0 2024-03-04T09:33:57.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/566: rename l5 to d10/d12/d1f/d3f/d4b/lcc 0 2024-03-04T09:33:57.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/567: fsync d10/d12/f1c 0 2024-03-04T09:33:57.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/568: chown d10/f20 157543203 1 2024-03-04T09:33:57.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/569: truncate d10/d12/f56 655098 0 2024-03-04T09:33:57.164 INFO:tasks.workunit.client.0.smithi046.stdout:4/610: mkdir d0/d3/d16/de5 0 2024-03-04T09:33:57.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/570: readlink d10/d12/d52/d78/l5a 0 2024-03-04T09:33:57.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/611: read d0/d3/d16/d1e/d73/f9a [1043338,69477] 0 2024-03-04T09:33:57.229 INFO:tasks.workunit.client.0.smithi046.stdout:0/571: dwrite d10/d12/d52/d5d/fac [0,4194304] 0 2024-03-04T09:33:57.727 INFO:tasks.workunit.client.0.smithi046.stdout:5/539: rename d1/d5f/f60 to d1/d44/d81/d8e/d72/fa2 0 2024-03-04T09:33:57.824 INFO:tasks.workunit.client.0.smithi046.stdout:4/612: mknod d0/d3/d16/ddc/ce6 0 2024-03-04T09:33:57.824 INFO:tasks.workunit.client.0.smithi046.stdout:4/613: truncate d0/d1f/fcd 862642 0 2024-03-04T09:33:57.824 INFO:tasks.workunit.client.0.smithi046.stdout:4/614: write d0/d3/d16/d1e/f36 [1354542,6060] 0 2024-03-04T09:33:58.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/572: mknod d10/dc2/ccd 0 2024-03-04T09:33:58.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/573: readlink d10/d12/d1f/d3f/d4b/l70 0 2024-03-04T09:33:58.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/574: read d10/d12/d1f/d3b/d6b/f72 [3279036,5825] 0 2024-03-04T09:33:58.140 INFO:tasks.workunit.client.0.smithi046.stdout:0/575: readlink d10/d12/l55 0 2024-03-04T09:33:58.140 INFO:tasks.workunit.client.0.smithi046.stdout:0/576: dread - d10/d12/d1f/d3f/fc5 zero size 2024-03-04T09:33:58.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/674: rename d1/d21/d35/d24/f28 to d1/d21/d35/d43/dd2/d51/da3/fec 0 2024-03-04T09:33:58.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/540: creat d1/d44/d81/d96/d20/d76/fa3 x:0 0 0 2024-03-04T09:33:58.813 INFO:tasks.workunit.client.0.smithi046.stdout:4/615: mknod d0/d3/d16/d1e/da1/dcc/ce7 0 2024-03-04T09:33:58.814 INFO:tasks.workunit.client.0.smithi046.stdout:2/605: write d5/da/f23 [8969954,43272] 0 2024-03-04T09:33:58.814 INFO:tasks.workunit.client.0.smithi046.stdout:0/577: creat d10/d12/d9f/da6/dc3/fce x:0 0 0 2024-03-04T09:33:58.924 INFO:tasks.workunit.client.0.smithi046.stdout:0/578: dwrite d10/d12/d52/d78/d8a/fb2 [0,4194304] 0 2024-03-04T09:33:58.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/579: write d10/f22 [7620938,6135] 0 2024-03-04T09:33:59.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/675: rename d1/d1d/d27/f53 to d1/d1d/d27/fed 0 2024-03-04T09:33:59.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/676: fsync d1/d1d/d5e/f6e 0 2024-03-04T09:33:59.119 INFO:tasks.workunit.client.0.smithi046.stdout:3/677: dwrite d1/d1d/d5e/f6e [0,4194304] 0 2024-03-04T09:33:59.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/606: rename d5/d2c/d51/d61/f9f to d5/d2c/d51/d61/db5/fc9 0 2024-03-04T09:34:00.108 INFO:tasks.workunit.client.0.smithi046.stdout:3/678: link d1/d1d/d27/d40/d76/f96 d1/d1d/d5e/fee 0 2024-03-04T09:34:00.108 INFO:tasks.workunit.client.0.smithi046.stdout:3/679: chown d1/d74 22 1 2024-03-04T09:34:00.327 INFO:tasks.workunit.client.0.smithi046.stdout:8/525: rmdir d7/de/d28/dab/d3c 39 2024-03-04T09:34:00.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/616: getdents d0/d3/d16/d1e/d73 0 2024-03-04T09:34:00.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/617: chown d0/d1f/f2c 0 1 2024-03-04T09:34:00.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/607: mkdir d5/d2c/d51/dca 0 2024-03-04T09:34:00.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/608: dwrite d5/d2c/f7e [0,4194304] 0 2024-03-04T09:34:00.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/680: read d1/d1d/d27/d40/d76/d8d/d95/fa6 [19648,75969] 0 2024-03-04T09:34:00.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/681: write d1/d21/d35/d43/dd2/d51/da3/fae [1738436,75196] 0 2024-03-04T09:34:00.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/682: dwrite d1/d1d/d27/d40/d92/f9c [0,4194304] 0 2024-03-04T09:34:01.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/618: mkdir d0/d1f/de8 0 2024-03-04T09:34:01.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/647: dwrite d1/d11/d6/d8/d1d/d34/d46/f5f [0,4194304] 0 2024-03-04T09:34:01.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/648: chown d1/d11/d6/d8/d1d/d34/d46/l5c 13758 1 2024-03-04T09:34:01.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/609: unlink d5/d2c/d51/c9b 0 2024-03-04T09:34:01.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/610: chown d5/d38 1534824 1 2024-03-04T09:34:01.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/611: chown d5/d84/d88/d99 24676 1 2024-03-04T09:34:01.448 INFO:tasks.workunit.client.0.smithi046.stdout:8/526: mknod d7/de/d28/dab/cb3 0 2024-03-04T09:34:01.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/527: dread d7/de/d28/dab/d2c/f31 [0,4194304] 0 2024-03-04T09:34:01.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/528: readlink d7/de/d28/dab/l5b 0 2024-03-04T09:34:01.891 INFO:tasks.workunit.client.0.smithi046.stdout:3/683: mkdir d1/d1d/d27/def 0 2024-03-04T09:34:01.891 INFO:tasks.workunit.client.0.smithi046.stdout:3/684: readlink d1/d21/d35/d24/la4 0 2024-03-04T09:34:01.907 INFO:tasks.workunit.client.0.smithi046.stdout:3/685: dread d1/d21/d35/d43/f46 [0,4194304] 0 2024-03-04T09:34:01.917 INFO:tasks.workunit.client.0.smithi046.stdout:3/686: dread d1/fdb [0,4194304] 0 2024-03-04T09:34:02.004 INFO:tasks.workunit.client.0.smithi046.stdout:4/619: mknod d0/d3/d16/d1e/d73/ce9 0 2024-03-04T09:34:02.004 INFO:tasks.workunit.client.0.smithi046.stdout:4/620: truncate d0/d3/d16/d1e/da1/dc1/fcf 1031873 0 2024-03-04T09:34:02.039 INFO:tasks.workunit.client.0.smithi046.stdout:6/651: sync 2024-03-04T09:34:02.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/510: sync 2024-03-04T09:34:02.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/511: creat d1/d28/d6a/fa5 x:0 0 0 2024-03-04T09:34:02.076 INFO:tasks.workunit.client.0.smithi046.stdout:1/512: dread d1/f54 [0,4194304] 0 2024-03-04T09:34:02.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/554: write d0/d4/db/d12/d28/f5c [393614,19876] 0 2024-03-04T09:34:03.239 INFO:tasks.workunit.client.0.smithi046.stdout:5/541: dwrite d1/d44/d81/d96/d20/d76/f48 [4194304,4194304] 0 2024-03-04T09:34:03.661 INFO:tasks.workunit.client.0.smithi046.stdout:6/652: mkdir da/dd/d46/de6 0 2024-03-04T09:34:03.662 INFO:tasks.workunit.client.0.smithi046.stdout:6/653: read - da/dd/d39/d60/da0/ddd/fe4 zero size 2024-03-04T09:34:03.662 INFO:tasks.workunit.client.0.smithi046.stdout:6/654: write da/d14/d1e/d2c/f63 [520066,37566] 0 2024-03-04T09:34:03.662 INFO:tasks.workunit.client.0.smithi046.stdout:6/655: dread - da/dd/d39/d60/da0/ddd/fe4 zero size 2024-03-04T09:34:03.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/513: mkdir d1/d28/d6f/da6 0 2024-03-04T09:34:04.303 INFO:tasks.workunit.client.0.smithi046.stdout:2/612: rename d5/d84/d88/d3f/l6e to d5/lcb 0 2024-03-04T09:34:04.624 INFO:tasks.workunit.client.0.smithi046.stdout:5/542: mknod d1/d44/d81/ca4 0 2024-03-04T09:34:04.644 INFO:tasks.workunit.client.0.smithi046.stdout:5/543: dread d1/d44/d57/f35 [0,4194304] 0 2024-03-04T09:34:04.712 INFO:tasks.workunit.client.0.smithi046.stdout:5/544: dwrite d1/d5f/d9b/d9d/d1f/f37 [0,4194304] 0 2024-03-04T09:34:04.737 INFO:tasks.workunit.client.0.smithi046.stdout:5/545: read d1/d5f/f64 [3490916,117557] 0 2024-03-04T09:34:04.752 INFO:tasks.workunit.client.0.smithi046.stdout:8/529: truncate d7/de/d12/f59 1407398 0 2024-03-04T09:34:04.757 INFO:tasks.workunit.client.0.smithi046.stdout:8/530: write d7/f23 [303507,16454] 0 2024-03-04T09:34:04.886 INFO:tasks.workunit.client.0.smithi046.stdout:6/656: mknod da/dd/d39/d60/da0/d67/ce7 0 2024-03-04T09:34:04.928 INFO:tasks.workunit.client.0.smithi046.stdout:0/580: write d10/d12/d52/d78/d8a/da2/fb1 [400560,41534] 0 2024-03-04T09:34:05.012 INFO:tasks.workunit.client.0.smithi046.stdout:1/514: mkdir d1/d92/d96/da7 0 2024-03-04T09:34:05.067 INFO:tasks.workunit.client.0.smithi046.stdout:1/515: dwrite d1/d28/f37 [0,4194304] 0 2024-03-04T09:34:05.067 INFO:tasks.workunit.client.0.smithi046.stdout:1/516: dread - d1/d28/f7a zero size 2024-03-04T09:34:05.097 INFO:tasks.workunit.client.0.smithi046.stdout:1/517: dread d1/f61 [0,4194304] 0 2024-03-04T09:34:05.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/687: rename d1/d1d/d27/fc7 to d1/d21/d35/d24/ff0 0 2024-03-04T09:34:05.926 INFO:tasks.workunit.client.0.smithi046.stdout:5/546: creat d1/d5f/d9b/d9d/fa5 x:0 0 0 2024-03-04T09:34:06.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/547: dwrite d1/d44/d81/d8e/f33 [0,4194304] 0 2024-03-04T09:34:06.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/531: unlink d7/de/d12/l5d 0 2024-03-04T09:34:06.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/657: mkdir da/d14/d1e/d2c/de8 0 2024-03-04T09:34:06.488 INFO:tasks.workunit.client.0.smithi046.stdout:0/581: dread d10/f2e [0,4194304] 0 2024-03-04T09:34:06.488 INFO:tasks.workunit.client.0.smithi046.stdout:0/582: dread - d10/d12/d52/d78/d8a/da2/fa9 zero size 2024-03-04T09:34:06.559 INFO:tasks.workunit.client.0.smithi046.stdout:0/583: dwrite d10/d12/d52/f8c [0,4194304] 0 2024-03-04T09:34:06.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/518: getdents d1/d28 0 2024-03-04T09:34:06.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/519: stat d1/c46 0 2024-03-04T09:34:07.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/688: symlink d1/d1d/d27/d40/d70/d7d/lf1 0 2024-03-04T09:34:07.244 INFO:tasks.workunit.client.0.smithi046.stdout:8/532: creat d7/de/d3e/fb4 x:0 0 0 2024-03-04T09:34:07.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/658: creat da/d14/d1e/d27/d78/d66/d81/fe9 x:0 0 0 2024-03-04T09:34:07.661 INFO:tasks.workunit.client.0.smithi046.stdout:0/584: symlink d10/d12/d9f/da6/dc3/lcf 0 2024-03-04T09:34:07.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/585: chown d10/d12/d52/d5d/ca4 343130 1 2024-03-04T09:34:07.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/586: fdatasync d10/d36/f85 0 2024-03-04T09:34:07.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/587: chown d10/d12/d52/fae 153541 1 2024-03-04T09:34:07.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/659: getdents da/d14 0 2024-03-04T09:34:07.732 INFO:tasks.workunit.client.0.smithi046.stdout:6/660: dread da/dd/f2a [0,4194304] 0 2024-03-04T09:34:08.262 INFO:tasks.workunit.client.0.smithi046.stdout:4/621: write d0/d3/f6 [231382,57448] 0 2024-03-04T09:34:08.262 INFO:tasks.workunit.client.0.smithi046.stdout:4/622: stat d0/d1f/d25 0 2024-03-04T09:34:08.262 INFO:tasks.workunit.client.0.smithi046.stdout:4/623: chown d0/d3/d16/ddc/ce6 134292 1 2024-03-04T09:34:08.263 INFO:tasks.workunit.client.0.smithi046.stdout:9/649: sync 2024-03-04T09:34:08.265 INFO:tasks.workunit.client.0.smithi046.stdout:7/555: sync 2024-03-04T09:34:08.495 INFO:tasks.workunit.client.0.smithi046.stdout:8/533: dread d7/d53/d72/fb0 [0,4194304] 0 2024-03-04T09:34:08.515 INFO:tasks.workunit.client.0.smithi046.stdout:8/534: dread d7/f46 [0,4194304] 0 2024-03-04T09:34:08.528 INFO:tasks.workunit.client.0.smithi046.stdout:8/535: dread d7/d53/d72/fb0 [0,4194304] 0 2024-03-04T09:34:08.529 INFO:tasks.workunit.client.0.smithi046.stdout:8/536: write d7/de/d28/dab/d2c/f31 [1387942,77785] 0 2024-03-04T09:34:08.534 INFO:tasks.workunit.client.0.smithi046.stdout:2/613: dwrite d5/d2c/d91/f94 [0,4194304] 0 2024-03-04T09:34:08.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/624: symlink d0/d1f/db9/lea 0 2024-03-04T09:34:09.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/650: link d1/d11/d6/d8/d1d/d34/d46/f5f d1/d11/d6/d8/d13/d92/fcd 0 2024-03-04T09:34:09.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/556: creat d0/d4/db/fc2 x:0 0 0 2024-03-04T09:34:09.608 INFO:tasks.workunit.client.0.smithi046.stdout:8/537: rmdir d7/de/d28/d3a/d6f/d84 39 2024-03-04T09:34:09.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/538: write d7/de/d28/d36/d7c/f9f [556493,124085] 0 2024-03-04T09:34:09.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/614: mkdir d5/d84/d88/d47/dcc 0 2024-03-04T09:34:09.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/615: truncate d5/d84/d88/d3f/f8e 1002023 0 2024-03-04T09:34:10.509 INFO:tasks.workunit.client.0.smithi046.stdout:4/625: readlink d0/l19 0 2024-03-04T09:34:10.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/626: dread d0/f41 [4194304,4194304] 0 2024-03-04T09:34:10.548 INFO:tasks.workunit.client.0.smithi046.stdout:8/539: creat d7/de/d28/d3a/d7d/fb5 x:0 0 0 2024-03-04T09:34:10.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/540: write d7/de/d28/dab/f99 [880912,88504] 0 2024-03-04T09:34:10.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/541: dread - d7/de/d3e/da1/fa6 zero size 2024-03-04T09:34:10.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/542: dread - d7/de/f7b zero size 2024-03-04T09:34:10.580 INFO:tasks.workunit.client.0.smithi046.stdout:8/543: creat d7/d53/d72/fb6 x:0 0 0 2024-03-04T09:34:10.979 INFO:tasks.workunit.client.0.smithi046.stdout:7/557: rmdir d0/d4/db/d38/d94 39 2024-03-04T09:34:11.004 INFO:tasks.workunit.client.0.smithi046.stdout:7/558: write d0/d3c/f69 [441896,120848] 0 2024-03-04T09:34:11.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/559: fdatasync d0/d4/db/d38/f3f 0 2024-03-04T09:34:11.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/560: stat d0/d59/fba 0 2024-03-04T09:34:11.037 INFO:tasks.workunit.client.0.smithi046.stdout:5/548: write d1/d44/d81/d96/f4c [98546,19801] 0 2024-03-04T09:34:11.091 INFO:tasks.workunit.client.0.smithi046.stdout:7/561: dwrite d0/d59/fba [0,4194304] 0 2024-03-04T09:34:11.323 INFO:tasks.workunit.client.0.smithi046.stdout:5/549: mkdir d1/d44/d57/d70/da6 0 2024-03-04T09:34:11.327 INFO:tasks.workunit.client.0.smithi046.stdout:5/550: read d1/f5 [483870,3895] 0 2024-03-04T09:34:11.658 INFO:tasks.workunit.client.0.smithi046.stdout:7/562: fsync d0/d4/db/d12/d28/f56 0 2024-03-04T09:34:11.658 INFO:tasks.workunit.client.0.smithi046.stdout:7/563: creat d0/d4/db/d3b/fc3 x:0 0 0 2024-03-04T09:34:11.738 INFO:tasks.workunit.client.0.smithi046.stdout:8/544: getdents d7/de/d3e 0 2024-03-04T09:34:11.738 INFO:tasks.workunit.client.0.smithi046.stdout:8/545: creat d7/de/d12/fb7 x:0 0 0 2024-03-04T09:34:11.991 INFO:tasks.workunit.client.0.smithi046.stdout:3/689: dwrite d1/d1d/d27/d40/d76/d8d/d95/fa6 [0,4194304] 0 2024-03-04T09:34:12.040 INFO:tasks.workunit.client.0.smithi046.stdout:5/551: creat d1/d44/d57/d70/d86/d92/fa7 x:0 0 0 2024-03-04T09:34:12.280 INFO:tasks.workunit.client.0.smithi046.stdout:6/661: dwrite da/dd/d39/d60/da0/d67/d64/d56/fb5 [0,4194304] 0 2024-03-04T09:34:12.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/520: symlink d1/d28/la8 0 2024-03-04T09:34:12.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/521: fsync d1/f33 0 2024-03-04T09:34:12.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/627: symlink d0/d3/d16/leb 0 2024-03-04T09:34:13.108 INFO:tasks.workunit.client.0.smithi046.stdout:8/546: mkdir d7/de/d28/dab/d2c/d64/db8 0 2024-03-04T09:34:13.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/547: dread d7/de/d28/dab/f99 [0,4194304] 0 2024-03-04T09:34:13.146 INFO:tasks.workunit.client.0.smithi046.stdout:8/548: read - d7/de/d3e/da1/fb2 zero size 2024-03-04T09:34:13.657 INFO:tasks.workunit.client.0.smithi046.stdout:3/690: unlink d1/d1d/d5e/f6e 0 2024-03-04T09:34:13.657 INFO:tasks.workunit.client.0.smithi046.stdout:3/691: dread - d1/d1d/d27/d40/d70/d7d/f91 zero size 2024-03-04T09:34:13.657 INFO:tasks.workunit.client.0.smithi046.stdout:3/692: creat d1/d88/ff2 x:0 0 0 2024-03-04T09:34:13.770 INFO:tasks.workunit.client.0.smithi046.stdout:5/552: creat d1/d5f/d9b/d9d/d1f/fa8 x:0 0 0 2024-03-04T09:34:14.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/662: mknod da/d14/d1e/d27/d8c/dbf/cea 0 2024-03-04T09:34:14.258 INFO:tasks.workunit.client.0.smithi046.stdout:1/522: getdents d1/d28/d6f/da6 0 2024-03-04T09:34:14.258 INFO:tasks.workunit.client.0.smithi046.stdout:1/523: dread - d1/d92/f9b zero size 2024-03-04T09:34:14.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/663: write da/d14/d1e/d27/d78/d66/faa [419800,72084] 0 2024-03-04T09:34:14.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/564: mkdir d0/d4/db/dc4 0 2024-03-04T09:34:14.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/549: creat d7/de/d28/dab/d3c/da5/fb9 x:0 0 0 2024-03-04T09:34:14.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/565: dread d0/d4/f1f [0,4194304] 0 2024-03-04T09:34:14.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/566: dread d0/d4/db/d12/dc1/f93 [0,4194304] 0 2024-03-04T09:34:14.361 INFO:tasks.workunit.client.0.smithi046.stdout:7/567: dread - d0/da/d46/f8b zero size 2024-03-04T09:34:14.516 INFO:tasks.workunit.client.0.smithi046.stdout:5/553: symlink d1/d44/d57/d70/da6/la9 0 2024-03-04T09:34:14.628 INFO:tasks.workunit.client.0.smithi046.stdout:5/554: dwrite d1/d44/d57/d70/d86/d92/fa7 [0,4194304] 0 2024-03-04T09:34:14.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/555: write d1/f1b [1031394,129651] 0 2024-03-04T09:34:14.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/556: chown d1/d5f/d9b/d9d/c17 2077 1 2024-03-04T09:34:14.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/557: chown d1/d44/d81/d96/d20/d76/d6c/d7b/f3d 170863620 1 2024-03-04T09:34:14.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/558: dread - d1/d44/d81/d96/d20/d76/d6c/d7b/f8d zero size 2024-03-04T09:34:14.655 INFO:tasks.workunit.client.0.smithi046.stdout:6/664: mknod da/d14/d1e/d27/d4a/dab/ddc/ceb 0 2024-03-04T09:34:14.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/524: dwrite d1/d28/f7a [0,4194304] 0 2024-03-04T09:34:14.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/525: fdatasync d1/f21 0 2024-03-04T09:34:14.726 INFO:tasks.workunit.client.0.smithi046.stdout:6/665: dwrite da/dd/d39/fd2 [0,4194304] 0 2024-03-04T09:34:14.742 INFO:tasks.workunit.client.0.smithi046.stdout:6/666: dread da/dd/d39/d60/da0/f62 [0,4194304] 0 2024-03-04T09:34:14.753 INFO:tasks.workunit.client.0.smithi046.stdout:8/550: link d7/d53/c83 d7/de/d28/dab/d2c/d64/cba 0 2024-03-04T09:34:14.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/551: dwrite d7/de/f18 [0,4194304] 0 2024-03-04T09:34:14.937 INFO:tasks.workunit.client.0.smithi046.stdout:7/568: mkdir d0/d4/db/d38/d7e/dc5 0 2024-03-04T09:34:15.006 INFO:tasks.workunit.client.0.smithi046.stdout:7/569: dwrite d0/d4/d6e/fa0 [0,4194304] 0 2024-03-04T09:34:15.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/651: write d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 [4922849,44053] 0 2024-03-04T09:34:15.817 INFO:tasks.workunit.client.0.smithi046.stdout:3/693: rename d1/d1d/d27/d40/f5a to d1/d1d/d27/d40/d76/d8d/d95/dcf/ff3 0 2024-03-04T09:34:15.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/652: dwrite d1/d11/d6/d8/d13/d92/fcd [4194304,4194304] 0 2024-03-04T09:34:15.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/653: stat d1/d11/d6/d8/f62 0 2024-03-04T09:34:15.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/526: symlink d1/d92/la9 0 2024-03-04T09:34:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:2/616: dwrite d5/d2c/d51/f58 [0,4194304] 0 2024-03-04T09:34:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:2/617: dread d5/d2c/f93 [0,4194304] 0 2024-03-04T09:34:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:2/618: chown d5/d84/d7c/dae 114 1 2024-03-04T09:34:16.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/667: symlink da/d14/d1e/d8f/ddf/lec 0 2024-03-04T09:34:16.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/668: stat da/d14/d1e/d27/d4a/d94/lc9 0 2024-03-04T09:34:16.245 INFO:tasks.workunit.client.0.smithi046.stdout:7/570: getdents d0/d4/db/d12 0 2024-03-04T09:34:16.245 INFO:tasks.workunit.client.0.smithi046.stdout:7/571: write d0/d4/db/d12/d28/f5c [139649,38725] 0 2024-03-04T09:34:16.657 INFO:tasks.workunit.client.0.smithi046.stdout:8/552: rename d7/de/d28/dab/f87 to d7/de/d28/d3a/d6f/d84/fbb 0 2024-03-04T09:34:16.657 INFO:tasks.workunit.client.0.smithi046.stdout:3/694: creat d1/d21/d35/d43/dd2/d51/ff4 x:0 0 0 2024-03-04T09:34:16.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/695: write d1/f39 [1207302,36079] 0 2024-03-04T09:34:16.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/553: dwrite d7/d53/d72/f9a [0,4194304] 0 2024-03-04T09:34:16.797 INFO:tasks.workunit.client.0.smithi046.stdout:9/654: dread d1/d11/d6/d8/d12/fc2 [0,4194304] 0 2024-03-04T09:34:16.883 INFO:tasks.workunit.client.0.smithi046.stdout:1/527: truncate d1/f27 1170037 0 2024-03-04T09:34:16.884 INFO:tasks.workunit.client.0.smithi046.stdout:1/528: chown d1/f89 95 1 2024-03-04T09:34:17.092 INFO:tasks.workunit.client.0.smithi046.stdout:0/588: symlink d10/d12/ld0 0 2024-03-04T09:34:17.210 INFO:tasks.workunit.client.0.smithi046.stdout:2/619: unlink d5/da/l39 0 2024-03-04T09:34:17.375 INFO:tasks.workunit.client.0.smithi046.stdout:6/669: mknod da/d14/d1e/d27/d78/d66/d81/ced 0 2024-03-04T09:34:17.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/696: creat d1/d1d/d5e/ff5 x:0 0 0 2024-03-04T09:34:17.740 INFO:tasks.workunit.client.0.smithi046.stdout:3/697: write d1/d1d/d27/d40/d76/d8d/d95/fc9 [260913,110053] 0 2024-03-04T09:34:17.842 INFO:tasks.workunit.client.0.smithi046.stdout:3/698: dwrite d1/d21/f8b [0,4194304] 0 2024-03-04T09:34:17.842 INFO:tasks.workunit.client.0.smithi046.stdout:3/699: stat d1/d1d/fb8 0 2024-03-04T09:34:17.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/700: dwrite d1/d88/f9f [0,4194304] 0 2024-03-04T09:34:18.169 INFO:tasks.workunit.client.0.smithi046.stdout:9/655: truncate d1/d11/d6/d8/d12/d1c/f6e 7533505 0 2024-03-04T09:34:18.170 INFO:tasks.workunit.client.0.smithi046.stdout:9/656: readlink d1/d11/d6/d8/d1d/d34/d46/l95 0 2024-03-04T09:34:18.193 INFO:tasks.workunit.client.0.smithi046.stdout:9/657: read d1/d11/d6/d8/d6f/d8c/f9c [97676,125891] 0 2024-03-04T09:34:18.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/529: chown d1/d28/c55 36 1 2024-03-04T09:34:18.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/530: stat d1/l4a 0 2024-03-04T09:34:18.483 INFO:tasks.workunit.client.0.smithi046.stdout:0/589: rename d10/d12/cc7 to d10/d12/d1f/d3b/cd1 0 2024-03-04T09:34:18.658 INFO:tasks.workunit.client.0.smithi046.stdout:2/620: unlink d5/d84/f62 0 2024-03-04T09:34:19.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/701: symlink d1/d1d/d27/d4a/lf6 0 2024-03-04T09:34:19.297 INFO:tasks.workunit.client.0.smithi046.stdout:3/702: truncate d1/d1d/d27/d40/d70/fa8 793560 0 2024-03-04T09:34:19.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/658: creat d1/d11/d6/d8/d1d/d34/d46/fce x:0 0 0 2024-03-04T09:34:19.580 INFO:tasks.workunit.client.0.smithi046.stdout:9/659: dread d1/d11/f75 [0,4194304] 0 2024-03-04T09:34:19.678 INFO:tasks.workunit.client.0.smithi046.stdout:9/660: dwrite d1/d11/d6/d8/d1d/d34/d46/fce [0,4194304] 0 2024-03-04T09:34:19.678 INFO:tasks.workunit.client.0.smithi046.stdout:9/661: creat d1/d11/d6/d8/d36/fcf x:0 0 0 2024-03-04T09:34:19.678 INFO:tasks.workunit.client.0.smithi046.stdout:9/662: chown d1/d11/d6/d8/d1d/d34/d7f/fbf 4364735 1 2024-03-04T09:34:19.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/531: mknod d1/d28/d6f/caa 0 2024-03-04T09:34:19.907 INFO:tasks.workunit.client.0.smithi046.stdout:6/670: rename da/d14/d1e/d8f/lc2 to da/dd/d22/da7/lee 0 2024-03-04T09:34:19.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/590: unlink d10/d12/f21 0 2024-03-04T09:34:19.969 INFO:tasks.workunit.client.0.smithi046.stdout:2/621: chown d5/da/l26 2707 1 2024-03-04T09:34:19.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/703: symlink d1/d21/d35/d43/dd2/d9a/lf7 0 2024-03-04T09:34:20.980 INFO:tasks.workunit.client.0.smithi046.stdout:1/532: write d1/d28/f41 [268700,23409] 0 2024-03-04T09:34:21.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:34:21.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:34:21.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/663: rename d1/d11/d6/d8/d12/d1c/lc9 to d1/d11/d6/d8/d12/d1c/d26/dae/ld0 0 2024-03-04T09:34:21.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/671: mknod da/dd/d39/d60/da0/d67/d64/d82/d83/dd5/cef 0 2024-03-04T09:34:21.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/672: fdatasync da/dd/d39/d60/da0/f88 0 2024-03-04T09:34:21.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/591: truncate d10/d12/d52/d78/f30 1781583 0 2024-03-04T09:34:21.320 INFO:tasks.workunit.client.0.smithi046.stdout:6/673: dwrite da/d14/d1e/f30 [0,4194304] 0 2024-03-04T09:34:21.320 INFO:tasks.workunit.client.0.smithi046.stdout:6/674: read - da/d14/d1e/d27/d4a/db2/fc7 zero size 2024-03-04T09:34:21.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/559: dwrite d1/d44/d81/d96/d20/d76/f65 [0,4194304] 0 2024-03-04T09:34:21.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/675: dread da/dd/d39/d60/da0/f62 [0,4194304] 0 2024-03-04T09:34:21.335 INFO:tasks.workunit.client.0.smithi046.stdout:0/592: dread d10/d12/d52/d78/d8a/fb2 [0,4194304] 0 2024-03-04T09:34:21.335 INFO:tasks.workunit.client.0.smithi046.stdout:0/593: dread - d10/f96 zero size 2024-03-04T09:34:21.628 INFO:tasks.workunit.client.0.smithi046.stdout:1/533: mknod d1/d92/d96/cab 0 2024-03-04T09:34:21.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/622: rename d5/f3b to d5/da/dbd/fcd 0 2024-03-04T09:34:23.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/560: creat d1/d44/d81/faa x:0 0 0 2024-03-04T09:34:23.144 INFO:tasks.workunit.client.0.smithi046.stdout:6/676: symlink da/dd/d39/d60/dac/dcb/lf0 0 2024-03-04T09:34:23.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/594: creat d10/d12/d9f/fd2 x:0 0 0 2024-03-04T09:34:23.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/595: chown d10/l1e 235243 1 2024-03-04T09:34:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:1/534: creat d1/d28/d6f/d74/d97/fac x:0 0 0 2024-03-04T09:34:23.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/535: dread d1/f49 [0,4194304] 0 2024-03-04T09:34:23.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/623: unlink d5/d2c/f8b 0 2024-03-04T09:34:24.036 INFO:tasks.workunit.client.0.smithi046.stdout:5/561: mknod d1/d5f/cab 0 2024-03-04T09:34:24.036 INFO:tasks.workunit.client.0.smithi046.stdout:5/562: write d1/d44/d81/d96/d20/d76/d6c/d7b/f8d [150556,78290] 0 2024-03-04T09:34:24.039 INFO:tasks.workunit.client.0.smithi046.stdout:4/628: sync 2024-03-04T09:34:24.150 INFO:tasks.workunit.client.0.smithi046.stdout:6/677: mkdir da/dd/d39/d60/da0/d67/d64/d56/df1 0 2024-03-04T09:34:24.415 INFO:tasks.workunit.client.0.smithi046.stdout:0/596: unlink d10/d12/d1f/d3f/d4b/l70 0 2024-03-04T09:34:24.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/536: dread d1/d28/f39 [0,4194304] 0 2024-03-04T09:34:24.447 INFO:tasks.workunit.client.0.smithi046.stdout:0/597: dread d10/d12/d52/f8c [0,4194304] 0 2024-03-04T09:34:24.697 INFO:tasks.workunit.client.0.smithi046.stdout:2/624: mknod d5/d2c/d91/cce 0 2024-03-04T09:34:24.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/554: dwrite d7/de/d3e/f91 [0,4194304] 0 2024-03-04T09:34:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:5/563: rmdir d1/d44/d81/d96/d54 39 2024-03-04T09:34:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:4/629: link d0/d1f/d25/d50/d63/c71 d0/d1f/d25/cec 0 2024-03-04T09:34:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:4/630: chown d0/d3/d16/d1e/l3c 20 1 2024-03-04T09:34:26.510 INFO:tasks.workunit.client.0.smithi046.stdout:2/625: symlink d5/db9/lcf 0 2024-03-04T09:34:27.148 INFO:tasks.workunit.client.0.smithi046.stdout:9/664: rename d1/d11/d6/d8/d1d/d34/d46 to d1/d11/d6/d8/d12/d1c/dd1 0 2024-03-04T09:34:27.148 INFO:tasks.workunit.client.0.smithi046.stdout:9/665: chown d1/d11/d6/d8/d13/l6c 0 1 2024-03-04T09:34:27.345 INFO:tasks.workunit.client.0.smithi046.stdout:5/564: link d1/d5f/d9b/d9d/d3e/f66 d1/d44/d81/d8e/fac 0 2024-03-04T09:34:27.345 INFO:tasks.workunit.client.0.smithi046.stdout:5/565: dread - d1/d5f/d9b/d9d/fa5 zero size 2024-03-04T09:34:27.421 INFO:tasks.workunit.client.0.smithi046.stdout:3/704: dwrite d1/d1d/d27/f2d [0,4194304] 0 2024-03-04T09:34:28.131 INFO:tasks.workunit.client.0.smithi046.stdout:9/666: creat d1/d11/d6/d8/d12/d1c/dd1/d4c/da3/daf/fd2 x:0 0 0 2024-03-04T09:34:28.809 INFO:tasks.workunit.client.0.smithi046.stdout:3/705: dread d1/d1d/d5e/fee [0,4194304] 0 2024-03-04T09:34:29.015 INFO:tasks.workunit.client.0.smithi046.stdout:4/631: truncate d0/d1f/d5b/f78 1517042 0 2024-03-04T09:34:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:3/706: truncate d1/d21/d26/f30 451637 0 2024-03-04T09:34:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:3/707: stat d1/d1d/d5e/fe2 0 2024-03-04T09:34:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:3/708: chown d1/d1d/d27/d40/d76/d8d/d95/dcf/ff3 2720 1 2024-03-04T09:34:29.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/632: mknod d0/d1f/d25/d50/ddb/ced 0 2024-03-04T09:34:29.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/633: chown d0/d3/d3b/d8d 650 1 2024-03-04T09:34:29.872 INFO:tasks.workunit.client.0.smithi046.stdout:0/598: creat d10/d12/d52/d78/fd3 x:0 0 0 2024-03-04T09:34:30.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/709: mknod d1/d1d/d5e/cf8 0 2024-03-04T09:34:30.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/710: dwrite d1/d1d/f4c [0,4194304] 0 2024-03-04T09:34:30.435 INFO:tasks.workunit.client.0.smithi046.stdout:0/599: rename d10/d12/d9f/da6/dc3/fce to d10/d12/d9f/fd4 0 2024-03-04T09:34:30.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/600: dread ff [0,4194304] 0 2024-03-04T09:34:31.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/572: mkdir d0/d4/db/dc6 0 2024-03-04T09:34:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/678: dwrite da/dd/f36 [0,4194304] 0 2024-03-04T09:34:31.205 INFO:tasks.workunit.client.0.smithi046.stdout:7/573: dwrite d0/d4/db/d12/f34 [0,4194304] 0 2024-03-04T09:34:31.205 INFO:tasks.workunit.client.0.smithi046.stdout:7/574: truncate d0/d4/d6e/f84 371141 0 2024-03-04T09:34:31.219 INFO:tasks.workunit.client.0.smithi046.stdout:7/575: dread d0/d4/db/d38/f57 [0,4194304] 0 2024-03-04T09:34:31.220 INFO:tasks.workunit.client.0.smithi046.stdout:7/576: write d0/da/d46/f8b [890056,113935] 0 2024-03-04T09:34:31.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/577: dwrite d0/da/d4e/f88 [0,4194304] 0 2024-03-04T09:34:31.427 INFO:tasks.workunit.client.0.smithi046.stdout:8/555: dwrite d7/f5f [0,4194304] 0 2024-03-04T09:34:32.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/556: truncate d7/de/d4c/d50/f7a 3930905 0 2024-03-04T09:34:32.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/557: fsync d7/de/d12/f8b 0 2024-03-04T09:34:32.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/558: dread d7/de/d12/fac [0,4194304] 0 2024-03-04T09:34:32.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/559: dread - d7/de/d12/fb7 zero size 2024-03-04T09:34:32.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/560: readlink d7/de/l2a 0 2024-03-04T09:34:32.668 INFO:tasks.workunit.client.0.smithi046.stdout:8/561: dwrite d7/de/f7e [0,4194304] 0 2024-03-04T09:34:32.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/562: creat d7/de/d28/dab/d3c/da5/fbc x:0 0 0 2024-03-04T09:34:32.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/563: write d7/f4e [615105,21703] 0 2024-03-04T09:34:32.881 INFO:tasks.workunit.client.0.smithi046.stdout:6/679: mknod da/d14/d1e/d27/d4a/cf2 0 2024-03-04T09:34:33.379 INFO:tasks.workunit.client.0.smithi046.stdout:8/564: symlink d7/de/d28/dab/d2c/d64/lbd 0 2024-03-04T09:34:33.409 INFO:tasks.workunit.client.0.smithi046.stdout:6/680: mkdir da/d14/d17/dd3/df3 0 2024-03-04T09:34:33.481 INFO:tasks.workunit.client.0.smithi046.stdout:6/681: dwrite da/dd/d39/d60/da0/d67/f6d [0,4194304] 0 2024-03-04T09:34:33.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/667: dwrite d1/d11/d6/d8/d12/fc2 [0,4194304] 0 2024-03-04T09:34:33.841 INFO:tasks.workunit.client.0.smithi046.stdout:8/565: getdents d7/de/d28/d3a/d6f/d84 0 2024-03-04T09:34:33.841 INFO:tasks.workunit.client.0.smithi046.stdout:8/566: fdatasync d7/de/d12/fac 0 2024-03-04T09:34:33.841 INFO:tasks.workunit.client.0.smithi046.stdout:8/567: write d7/de/f7b [793291,9716] 0 2024-03-04T09:34:33.842 INFO:tasks.workunit.client.0.smithi046.stdout:8/568: write d7/de/d28/dab/d3c/f95 [370136,91458] 0 2024-03-04T09:34:33.842 INFO:tasks.workunit.client.0.smithi046.stdout:8/569: stat d7/de/d28/f2e 0 2024-03-04T09:34:33.948 INFO:tasks.workunit.client.0.smithi046.stdout:6/682: truncate da/dd/d46/f72 2774539 0 2024-03-04T09:34:34.078 INFO:tasks.workunit.client.0.smithi046.stdout:0/601: mkdir d10/dd5 0 2024-03-04T09:34:34.317 INFO:tasks.workunit.client.0.smithi046.stdout:6/683: symlink da/d14/lf4 0 2024-03-04T09:34:34.317 INFO:tasks.workunit.client.0.smithi046.stdout:6/684: chown da/dd/d39/fd2 1651057073 1 2024-03-04T09:34:34.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/537: sync 2024-03-04T09:34:34.886 INFO:tasks.workunit.client.0.smithi046.stdout:2/626: sync 2024-03-04T09:34:34.915 INFO:tasks.workunit.client.0.smithi046.stdout:2/627: dread d5/d2c/f7e [0,4194304] 0 2024-03-04T09:34:35.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/685: mkdir da/d14/d1e/d27/d78/df5 0 2024-03-04T09:34:35.233 INFO:tasks.workunit.client.0.smithi046.stdout:1/538: dwrite d1/d28/f38 [0,4194304] 0 2024-03-04T09:34:35.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/686: mknod da/dd/d39/d60/da0/d67/d64/d56/d86/cf6 0 2024-03-04T09:34:35.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/687: symlink da/dd/d39/d60/dac/dcb/lf7 0 2024-03-04T09:34:35.666 INFO:tasks.workunit.client.0.smithi046.stdout:6/688: dread da/dd/d39/d60/f71 [0,4194304] 0 2024-03-04T09:34:35.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/539: creat d1/d28/d8d/fad x:0 0 0 2024-03-04T09:34:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:6/689: fdatasync da/d14/d1e/d27/d78/f7b 0 2024-03-04T09:34:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:6/690: write da/d14/d1e/d8f/f9e [4611570,49770] 0 2024-03-04T09:34:36.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/566: mknod d1/d5f/d9b/cad 0 2024-03-04T09:34:36.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/567: chown d1/d5f/d9b/d9d/c12 10 1 2024-03-04T09:34:36.203 INFO:tasks.workunit.client.0.smithi046.stdout:5/568: dwrite d1/d44/d81/f91 [0,4194304] 0 2024-03-04T09:34:36.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/540: getdents d1 0 2024-03-04T09:34:36.420 INFO:tasks.workunit.client.0.smithi046.stdout:1/541: dwrite d1/d28/d8d/fad [0,4194304] 0 2024-03-04T09:34:36.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/691: mknod da/d14/de0/cf8 0 2024-03-04T09:34:36.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/692: creat da/dd/d39/d60/da0/d67/d64/d82/ff9 x:0 0 0 2024-03-04T09:34:37.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/693: mknod da/d14/d1e/d2c/cfa 0 2024-03-04T09:34:37.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/694: truncate da/dd/d39/d60/da0/ddd/fe4 848385 0 2024-03-04T09:34:37.327 INFO:tasks.workunit.client.0.smithi046.stdout:1/542: symlink d1/d28/d8d/lae 0 2024-03-04T09:34:37.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/634: write d0/d1f/d5b/f78 [611728,72400] 0 2024-03-04T09:34:37.770 INFO:tasks.workunit.client.0.smithi046.stdout:3/711: rename d1/d1d/d27/f73 to d1/d21/ff9 0 2024-03-04T09:34:37.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/712: read d1/f1e [1951405,65134] 0 2024-03-04T09:34:37.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/713: chown d1/d1d/d27/ld1 17937260 1 2024-03-04T09:34:38.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/570: rename d7/de/d12/c73 to d7/de/d28/cbe 0 2024-03-04T09:34:38.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/714: creat d1/d1d/d27/d40/d70/d7d/ffa x:0 0 0 2024-03-04T09:34:38.554 INFO:tasks.workunit.client.0.smithi046.stdout:3/715: dwrite d1/d1d/d27/d4a/f65 [0,4194304] 0 2024-03-04T09:34:38.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/668: creat d1/d11/d6/d8/d12/d1c/fd3 x:0 0 0 2024-03-04T09:34:38.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/669: stat d1/d11/d6/d8/d1d/c8e 0 2024-03-04T09:34:39.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/543: unlink d1/d28/l53 0 2024-03-04T09:34:39.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/544: chown d1/l1c 2606358 1 2024-03-04T09:34:39.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/628: rename d5/d2c/d51/d61/db5/dba to d5/d84/d7c/dd0 0 2024-03-04T09:34:39.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/716: creat d1/d1d/d27/d40/d76/d8d/d95/ffb x:0 0 0 2024-03-04T09:34:39.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/717: readlink d1/d21/l22 0 2024-03-04T09:34:39.748 INFO:tasks.workunit.client.0.smithi046.stdout:3/718: dwrite d1/d21/d35/d43/f63 [0,4194304] 0 2024-03-04T09:34:39.769 INFO:tasks.workunit.client.0.smithi046.stdout:3/719: dread d1/d21/d35/d43/fbd [0,4194304] 0 2024-03-04T09:34:39.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/545: mkdir d1/d92/d9a/daf 0 2024-03-04T09:34:40.155 INFO:tasks.workunit.client.0.smithi046.stdout:4/635: rename d0/d3/d20/d96/fa0 to d0/d1f/d35/fee 0 2024-03-04T09:34:40.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/569: dwrite d1/d44/d81/d96/d20/f3b [0,4194304] 0 2024-03-04T09:34:40.385 INFO:tasks.workunit.client.0.smithi046.stdout:8/571: mknod d7/de/d28/dab/d2c/cbf 0 2024-03-04T09:34:40.742 INFO:tasks.workunit.client.0.smithi046.stdout:3/720: symlink d1/d1d/d27/d40/d76/d8d/lfc 0 2024-03-04T09:34:40.939 INFO:tasks.workunit.client.0.smithi046.stdout:9/670: link d1/d11/d6/d8/d12/d1c/dd1/d5e/l81 d1/d11/d6/d8/d1d/d34/ld4 0 2024-03-04T09:34:40.939 INFO:tasks.workunit.client.0.smithi046.stdout:9/671: write d1/d11/d6/d8/d12/d1c/f38 [828060,43950] 0 2024-03-04T09:34:40.939 INFO:tasks.workunit.client.0.smithi046.stdout:9/672: chown d1/d11/d6/d8/laa 65333887 1 2024-03-04T09:34:41.265 INFO:tasks.workunit.client.0.smithi046.stdout:1/546: rename d1/l1c to d1/d92/d96/da7/lb0 0 2024-03-04T09:34:41.529 INFO:tasks.workunit.client.0.smithi046.stdout:6/695: write da/dd/fe [616138,35069] 0 2024-03-04T09:34:41.633 INFO:tasks.workunit.client.0.smithi046.stdout:6/696: dwrite da/d14/d1e/d27/f43 [4194304,4194304] 0 2024-03-04T09:34:41.724 INFO:tasks.workunit.client.0.smithi046.stdout:5/570: truncate d1/f1b 1045083 0 2024-03-04T09:34:41.725 INFO:tasks.workunit.client.0.smithi046.stdout:5/571: fsync d1/d5f/d9b/d9d/d3e/f66 0 2024-03-04T09:34:41.725 INFO:tasks.workunit.client.0.smithi046.stdout:5/572: fdatasync d1/d44/d81/d96/d20/d5e/f74 0 2024-03-04T09:34:41.777 INFO:tasks.workunit.client.0.smithi046.stdout:5/573: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:34:41.863 INFO:tasks.workunit.client.0.smithi046.stdout:7/578: sync 2024-03-04T09:34:41.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/572: getdents d7/de 0 2024-03-04T09:34:41.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/573: fdatasync d7/de/f21 0 2024-03-04T09:34:41.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/574: chown d7/d53/d72 233 1 2024-03-04T09:34:41.864 INFO:tasks.workunit.client.0.smithi046.stdout:5/574: dwrite d1/f87 [0,4194304] 0 2024-03-04T09:34:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:3/721: mkdir d1/d1d/d27/d40/d76/dfd 0 2024-03-04T09:34:42.076 INFO:tasks.workunit.client.0.smithi046.stdout:3/722: read d1/f3f [3531582,76637] 0 2024-03-04T09:34:42.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/673: creat d1/d11/d6/d8/d12/d1c/dd1/d4c/da3/fd5 x:0 0 0 2024-03-04T09:34:42.586 INFO:tasks.workunit.client.0.smithi046.stdout:1/547: fsync d1/d28/f7f 0 2024-03-04T09:34:42.745 INFO:tasks.workunit.client.0.smithi046.stdout:6/697: dread da/d14/d1e/d27/d78/f3d [0,4194304] 0 2024-03-04T09:34:42.811 INFO:tasks.workunit.client.0.smithi046.stdout:6/698: dwrite da/d14/d1e/d27/d4a/db2/fc7 [0,4194304] 0 2024-03-04T09:34:42.838 INFO:tasks.workunit.client.0.smithi046.stdout:6/699: dread da/d14/d1e/f30 [0,4194304] 0 2024-03-04T09:34:43.111 INFO:tasks.workunit.client.0.smithi046.stdout:0/602: sync 2024-03-04T09:34:43.112 INFO:tasks.workunit.client.0.smithi046.stdout:0/603: dread - d10/d12/d1f/d3f/fc1 zero size 2024-03-04T09:34:43.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/579: rmdir d0/d4/db/d12 39 2024-03-04T09:34:43.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/580: creat d0/d4/db/d38/fc7 x:0 0 0 2024-03-04T09:34:43.596 INFO:tasks.workunit.client.0.smithi046.stdout:8/575: mknod d7/de/d28/dab/d3c/da5/cc0 0 2024-03-04T09:34:43.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/575: getdents d1/d44/d81/d96/d9a 0 2024-03-04T09:34:44.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/674: rmdir d1/d11/d6/d8/d12/d1c/d26/d91 39 2024-03-04T09:34:44.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/675: creat d1/d11/d6/d8/d36/fd6 x:0 0 0 2024-03-04T09:34:44.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/676: dwrite d1/d11/d6/d8/d12/d1c/dd1/d4c/fa1 [0,4194304] 0 2024-03-04T09:34:44.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/677: fdatasync d1/d11/d6/d8/d1d/d34/d35/f5d 0 2024-03-04T09:34:44.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/678: dread d1/d11/d6/d8/d36/f51 [0,4194304] 0 2024-03-04T09:34:44.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/679: chown d1/d11/d6/d8/d1d/l4b 1539783 1 2024-03-04T09:34:44.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/680: dread - d1/d11/d6/d8/d6f/d8c/d9a/fc6 zero size 2024-03-04T09:34:44.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/548: mkdir d1/d28/d6f/db1 0 2024-03-04T09:34:44.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/700: mkdir da/dd/d39/d60/da0/d67/d64/d56/d86/dfb 0 2024-03-04T09:34:44.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/701: readlink da/d14/d1e/d27/l8e 0 2024-03-04T09:34:44.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/702: dwrite da/d14/fa1 [4194304,4194304] 0 2024-03-04T09:34:44.856 INFO:tasks.workunit.client.0.smithi046.stdout:2/629: write d5/d84/d88/f35 [3981037,49270] 0 2024-03-04T09:34:44.856 INFO:tasks.workunit.client.0.smithi046.stdout:2/630: fdatasync d5/d2c/f71 0 2024-03-04T09:34:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/636: write d0/d1f/d25/f26 [7676223,103408] 0 2024-03-04T09:34:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/637: chown d0/d1f/fcd 1 1 2024-03-04T09:34:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/638: chown d0/d3/d20/d96 2071 1 2024-03-04T09:34:45.678 INFO:tasks.workunit.client.0.smithi046.stdout:5/576: dread d1/d44/d81/d96/f10 [0,4194304] 0 2024-03-04T09:34:45.752 INFO:tasks.workunit.client.0.smithi046.stdout:5/577: dwrite d1/d44/d81/d96/d20/f5d [0,4194304] 0 2024-03-04T09:34:45.880 INFO:tasks.workunit.client.0.smithi046.stdout:3/723: getdents d1/d1d/d5e 0 2024-03-04T09:34:45.881 INFO:tasks.workunit.client.0.smithi046.stdout:3/724: chown d1/d1d/d27/d4a/d78/l93 7540 1 2024-03-04T09:34:46.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/549: rmdir d1/d92/d96 39 2024-03-04T09:34:46.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/681: mknod d1/d11/d6/d8/d1d/cd7 0 2024-03-04T09:34:46.861 INFO:tasks.workunit.client.0.smithi046.stdout:6/703: rename da/d14/d1e/d27/d4a/c85 to da/d4e/cfc 0 2024-03-04T09:34:46.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/704: chown da/dd/d39/d60/da0/d67/d64/d56/df1 777136 1 2024-03-04T09:34:47.043 INFO:tasks.workunit.client.0.smithi046.stdout:0/604: getdents d10/d12/d52/d5d 0 2024-03-04T09:34:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:2/631: symlink d5/d84/d7c/ld1 0 2024-03-04T09:34:47.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/639: mknod d0/d3/d16/d76/cef 0 2024-03-04T09:34:47.412 INFO:tasks.workunit.client.0.smithi046.stdout:4/640: dread d0/d3/d16/d1e/d73/f9a [0,4194304] 0 2024-03-04T09:34:47.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/725: creat d1/d1d/d27/def/ffe x:0 0 0 2024-03-04T09:34:48.267 INFO:tasks.workunit.client.0.smithi046.stdout:1/550: symlink d1/d28/d6f/db1/lb2 0 2024-03-04T09:34:48.300 INFO:tasks.workunit.client.0.smithi046.stdout:1/551: write d1/d28/f39 [3451558,48161] 0 2024-03-04T09:34:48.423 INFO:tasks.workunit.client.0.smithi046.stdout:6/705: symlink da/dd/d39/d60/da9/lfd 0 2024-03-04T09:34:48.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/706: dwrite da/dd/d22/da7/fda [0,4194304] 0 2024-03-04T09:34:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/707: creat da/dd/d46/ffe x:0 0 0 2024-03-04T09:34:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/708: chown da/d14/d17/dd3/de3/ld4 24 1 2024-03-04T09:34:48.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/605: creat d10/d36/d87/fd6 x:0 0 0 2024-03-04T09:34:48.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/632: mkdir d5/db9/dd2 0 2024-03-04T09:34:48.640 INFO:tasks.workunit.client.0.smithi046.stdout:0/606: dread d10/d12/d52/d5d/d83/f95 [0,4194304] 0 2024-03-04T09:34:48.677 INFO:tasks.workunit.client.0.smithi046.stdout:4/641: mknod d0/d1f/de8/cf0 0 2024-03-04T09:34:48.677 INFO:tasks.workunit.client.0.smithi046.stdout:4/642: creat d0/d5f/d6f/ff1 x:0 0 0 2024-03-04T09:34:48.945 INFO:tasks.workunit.client.0.smithi046.stdout:5/578: mknod d1/d5f/d9b/d9d/cae 0 2024-03-04T09:34:48.945 INFO:tasks.workunit.client.0.smithi046.stdout:5/579: write d1/d44/d81/d96/d20/d5e/f74 [958641,74955] 0 2024-03-04T09:34:49.037 INFO:tasks.workunit.client.0.smithi046.stdout:5/580: dwrite d1/d5f/f7c [0,4194304] 0 2024-03-04T09:34:49.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/726: symlink d1/d1d/d27/d40/d76/d8d/d95/lff 0 2024-03-04T09:34:49.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/581: dwrite d1/d5f/d9b/d9d/d1f/fa8 [0,4194304] 0 2024-03-04T09:34:49.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/552: creat d1/d28/d6a/fb3 x:0 0 0 2024-03-04T09:34:49.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/553: chown d1/d28/d6f 546938673 1 2024-03-04T09:34:49.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/709: rmdir da/dd/d39/d60/da0/d67/d64/d56/d86/dfb 0 2024-03-04T09:34:49.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/710: creat da/d14/d1e/d27/d4b/fff x:0 0 0 2024-03-04T09:34:49.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/711: dwrite da/d14/d1e/d8f/f9e [0,4194304] 0 2024-03-04T09:34:49.605 INFO:tasks.workunit.client.0.smithi046.stdout:6/712: dread da/dd/d39/d60/da0/f5a [0,4194304] 0 2024-03-04T09:34:49.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/713: stat da/d14/d1e/d27/d4b 0 2024-03-04T09:34:49.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/714: creat da/d14/d1e/d27/d78/d66/d81/f100 x:0 0 0 2024-03-04T09:34:49.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/715: creat da/dd/d39/d60/da0/ddd/f101 x:0 0 0 2024-03-04T09:34:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/607: symlink d10/d12/d6e/ld7 0 2024-03-04T09:34:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/608: dread - d10/d12/d52/d78/f32 zero size 2024-03-04T09:34:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/609: dread - d10/d12/d52/d5d/f64 zero size 2024-03-04T09:34:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:0/610: dwrite d10/d12/d52/d78/d8a/da2/fb1 [0,4194304] 0 2024-03-04T09:34:50.280 INFO:tasks.workunit.client.0.smithi046.stdout:8/576: rmdir d7/de/d4c 39 2024-03-04T09:34:50.280 INFO:tasks.workunit.client.0.smithi046.stdout:3/727: symlink d1/d1d/d27/d4a/l100 0 2024-03-04T09:34:50.280 INFO:tasks.workunit.client.0.smithi046.stdout:8/577: fdatasync d7/de/d28/dab/f88 0 2024-03-04T09:34:50.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/581: sync 2024-03-04T09:34:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:7/582: write d0/d4/db/d12/f75 [3845711,59341] 0 2024-03-04T09:34:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:7/583: write d0/d4/db/d12/d28/f56 [5011751,64036] 0 2024-03-04T09:34:50.455 INFO:tasks.workunit.client.0.smithi046.stdout:7/584: truncate d0/d2d/d85/f9a 684584 0 2024-03-04T09:34:50.455 INFO:tasks.workunit.client.0.smithi046.stdout:7/585: truncate d0/da/d46/d99/fb8 480569 0 2024-03-04T09:34:50.954 INFO:tasks.workunit.client.0.smithi046.stdout:5/582: mknod d1/d44/d81/d96/d9a/caf 0 2024-03-04T09:34:50.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/583: fsync d1/f2 0 2024-03-04T09:34:51.282 INFO:tasks.workunit.client.0.smithi046.stdout:1/554: dread d1/f27 [0,4194304] 0 2024-03-04T09:34:51.282 INFO:tasks.workunit.client.0.smithi046.stdout:1/555: fsync d1/fd 0 2024-03-04T09:34:51.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:34:51.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:34:51.540 INFO:tasks.workunit.client.0.smithi046.stdout:6/716: mknod da/dd/d39/d60/dac/daf/c102 0 2024-03-04T09:34:51.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/717: dread da/dd/d39/d60/da0/d67/d64/d56/fb4 [4194304,4194304] 0 2024-03-04T09:34:51.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/718: fsync da/dd/d22/f92 0 2024-03-04T09:34:52.322 INFO:tasks.workunit.client.0.smithi046.stdout:0/611: mkdir d10/d12/d9a/dd8 0 2024-03-04T09:34:52.426 INFO:tasks.workunit.client.0.smithi046.stdout:0/612: dwrite d10/d12/d52/d78/d8a/fb2 [4194304,4194304] 0 2024-03-04T09:34:52.476 INFO:tasks.workunit.client.0.smithi046.stdout:0/613: dwrite d10/d12/d52/d5d/fcb [0,4194304] 0 2024-03-04T09:34:53.304 INFO:tasks.workunit.client.0.smithi046.stdout:7/586: mkdir d0/d59/db1/dc8 0 2024-03-04T09:34:53.306 INFO:tasks.workunit.client.0.smithi046.stdout:0/614: unlink d10/d12/d52/d78/l53 0 2024-03-04T09:34:53.360 INFO:tasks.workunit.client.0.smithi046.stdout:9/682: dwrite d1/d11/d6/d8/d13/d21/f69 [4194304,4194304] 0 2024-03-04T09:34:53.909 INFO:tasks.workunit.client.0.smithi046.stdout:7/587: symlink d0/d2d/d85/lc9 0 2024-03-04T09:34:54.081 INFO:tasks.workunit.client.0.smithi046.stdout:0/615: symlink d10/d12/d6e/d99/ld9 0 2024-03-04T09:34:54.084 INFO:tasks.workunit.client.0.smithi046.stdout:0/616: write d10/d12/f82 [103348,77953] 0 2024-03-04T09:34:54.097 INFO:tasks.workunit.client.0.smithi046.stdout:0/617: dread fd [0,4194304] 0 2024-03-04T09:34:54.326 INFO:tasks.workunit.client.0.smithi046.stdout:7/588: mknod d0/d2d/cca 0 2024-03-04T09:34:54.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/589: dwrite d0/d4/db/d12/f34 [0,4194304] 0 2024-03-04T09:34:54.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/590: readlink d0/d4/db/d12/lbc 0 2024-03-04T09:34:54.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/556: rename d1/d28/f37 to d1/d28/d6f/da6/fb4 0 2024-03-04T09:34:54.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/618: read d10/d12/f81 [18374,73102] 0 2024-03-04T09:34:54.583 INFO:tasks.workunit.client.0.smithi046.stdout:1/557: dwrite d1/f17 [4194304,4194304] 0 2024-03-04T09:34:54.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/619: dwrite d10/d12/d52/d78/f6d [0,4194304] 0 2024-03-04T09:34:54.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/620: chown d10/d12/d52/d78/f33 64215 1 2024-03-04T09:34:54.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/591: mkdir d0/d59/db1/dc8/dcb 0 2024-03-04T09:34:54.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/592: write d0/d2d/d85/fa9 [292170,107731] 0 2024-03-04T09:34:54.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/593: write d0/d4/fd [4718265,26370] 0 2024-03-04T09:34:54.880 INFO:tasks.workunit.client.0.smithi046.stdout:8/578: mkdir d7/de/d28/dab/dc1 0 2024-03-04T09:34:55.206 INFO:tasks.workunit.client.0.smithi046.stdout:7/594: unlink d0/d58/fbb 0 2024-03-04T09:34:55.255 INFO:tasks.workunit.client.0.smithi046.stdout:4/643: write d0/d3/d16/d1e/da1/dc1/fcf [490674,74930] 0 2024-03-04T09:34:55.340 INFO:tasks.workunit.client.0.smithi046.stdout:4/644: dwrite d0/d1f/d25/f69 [0,4194304] 0 2024-03-04T09:34:55.340 INFO:tasks.workunit.client.0.smithi046.stdout:4/645: creat d0/d3/d3b/d9d/ff2 x:0 0 0 2024-03-04T09:34:55.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/719: rename da/d14/d1e/d27/d78/d6c to da/d14/d1e/d8f/ddf/d103 0 2024-03-04T09:34:55.428 INFO:tasks.workunit.client.0.smithi046.stdout:6/720: dread da/dd/f36 [0,4194304] 0 2024-03-04T09:34:55.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/721: write da/d14/d1e/d27/f43 [5834687,57605] 0 2024-03-04T09:34:55.506 INFO:tasks.workunit.client.0.smithi046.stdout:7/595: symlink d0/d4/db/d3b/d6b/lcc 0 2024-03-04T09:34:55.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/596: dread d0/d4/db/d3b/f7c [0,4194304] 0 2024-03-04T09:34:55.904 INFO:tasks.workunit.client.0.smithi046.stdout:4/646: symlink d0/d3/d16/d1e/da1/lf3 0 2024-03-04T09:34:56.035 INFO:tasks.workunit.client.0.smithi046.stdout:0/621: rename d10/d12/c9c to d10/d12/d9f/da6/dc3/cda 0 2024-03-04T09:34:57.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/647: rmdir d0/d3/d20/d96/d6e/d85/dc5 0 2024-03-04T09:34:57.410 INFO:tasks.workunit.client.0.smithi046.stdout:8/579: rename d7/de/d28/d36/d7c/d89/f8c to d7/de/d3e/fc2 0 2024-03-04T09:34:57.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/648: stat d0/d1f/d25/da6/lb7 0 2024-03-04T09:34:57.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/633: write d5/da/d1b/f25 [1086372,8223] 0 2024-03-04T09:34:57.479 INFO:tasks.workunit.client.0.smithi046.stdout:2/634: dread d5/da/fab [0,4194304] 0 2024-03-04T09:34:57.486 INFO:tasks.workunit.client.0.smithi046.stdout:8/580: dwrite d7/de/d28/dab/d3c/da5/fb9 [0,4194304] 0 2024-03-04T09:34:57.677 INFO:tasks.workunit.client.0.smithi046.stdout:3/728: sync 2024-03-04T09:34:57.680 INFO:tasks.workunit.client.0.smithi046.stdout:7/597: truncate d0/d4/db/d12/f75 322806 0 2024-03-04T09:34:57.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/598: fsync d0/d4/db/d12/d28/f5c 0 2024-03-04T09:34:58.055 INFO:tasks.workunit.client.0.smithi046.stdout:5/584: write d1/f82 [1451958,60120] 0 2024-03-04T09:34:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/649: link d0/d5f/caf d0/d3/d16/d1e/cf4 0 2024-03-04T09:34:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/650: fsync d0/d3/d3b/d8d/fb8 0 2024-03-04T09:34:58.707 INFO:tasks.workunit.client.0.smithi046.stdout:9/683: unlink d1/d11/d6/d8/d12/d1c/dd1/c88 0 2024-03-04T09:34:58.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/684: creat d1/d11/d6/d8/d36/fd8 x:0 0 0 2024-03-04T09:34:59.574 INFO:tasks.workunit.client.0.smithi046.stdout:3/729: creat d1/d21/d35/d43/f101 x:0 0 0 2024-03-04T09:34:59.738 INFO:tasks.workunit.client.0.smithi046.stdout:7/599: readlink d0/d4/db/d12/d28/l35 0 2024-03-04T09:34:59.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/600: dwrite d0/da/d46/d99/fb2 [0,4194304] 0 2024-03-04T09:34:59.814 INFO:tasks.workunit.client.0.smithi046.stdout:1/558: dwrite d1/d28/d6a/f90 [0,4194304] 0 2024-03-04T09:34:59.823 INFO:tasks.workunit.client.0.smithi046.stdout:7/601: write d0/f31 [692600,125171] 0 2024-03-04T09:34:59.851 INFO:tasks.workunit.client.0.smithi046.stdout:5/585: dread d1/d44/d81/d8e/d72/fa2 [0,4194304] 0 2024-03-04T09:34:59.851 INFO:tasks.workunit.client.0.smithi046.stdout:5/586: fdatasync d1/d44/d81/d96/f49 0 2024-03-04T09:35:00.038 INFO:tasks.workunit.client.0.smithi046.stdout:4/651: unlink d0/d3/d16/f5a 0 2024-03-04T09:35:00.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/685: unlink d1/d11/d6/d8/d12/d1c/f31 0 2024-03-04T09:35:00.290 INFO:tasks.workunit.client.0.smithi046.stdout:9/686: read d1/d11/f75 [4079741,26437] 0 2024-03-04T09:35:00.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/722: dwrite da/d14/d1e/d27/d78/f3c [0,4194304] 0 2024-03-04T09:35:00.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/723: dread f5 [0,4194304] 0 2024-03-04T09:35:00.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/724: write da/d14/d1e/d2c/f63 [1421983,128192] 0 2024-03-04T09:35:01.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/587: symlink d1/d44/d57/d70/d86/d92/lb0 0 2024-03-04T09:35:01.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/588: truncate d1/d44/d81/d8e/f2e 21940 0 2024-03-04T09:35:01.421 INFO:tasks.workunit.client.0.smithi046.stdout:4/652: mkdir d0/d1f/d25/d50/df5 0 2024-03-04T09:35:01.421 INFO:tasks.workunit.client.0.smithi046.stdout:4/653: write d0/f41 [8717008,120970] 0 2024-03-04T09:35:01.665 INFO:tasks.workunit.client.0.smithi046.stdout:9/687: mknod d1/d11/d6/d8/d12/cd9 0 2024-03-04T09:35:01.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/730: mknod d1/d21/d35/d2b/c102 0 2024-03-04T09:35:01.938 INFO:tasks.workunit.client.0.smithi046.stdout:6/725: symlink da/dd/d39/l104 0 2024-03-04T09:35:01.938 INFO:tasks.workunit.client.0.smithi046.stdout:6/726: fsync da/dd/fe 0 2024-03-04T09:35:01.990 INFO:tasks.workunit.client.0.smithi046.stdout:5/589: mkdir d1/d44/d57/d70/d86/d92/db1 0 2024-03-04T09:35:01.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/590: chown d1/d44/c56 1765011 1 2024-03-04T09:35:02.039 INFO:tasks.workunit.client.0.smithi046.stdout:4/654: readlink d0/l9 0 2024-03-04T09:35:02.040 INFO:tasks.workunit.client.0.smithi046.stdout:4/655: chown d0/d3/d16/d1e/d73/lcb 22279119 1 2024-03-04T09:35:02.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/688: rmdir d1/d11/d6/d8 39 2024-03-04T09:35:02.767 INFO:tasks.workunit.client.0.smithi046.stdout:3/731: rename d1/d21/d35/d24/fc6 to d1/d1d/d27/d40/d76/d8d/d95/f103 0 2024-03-04T09:35:02.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/689: dread d1/d11/d6/d8/d12/d1c/f38 [0,4194304] 0 2024-03-04T09:35:02.789 INFO:tasks.workunit.client.0.smithi046.stdout:6/727: mknod da/dd/d39/c105 0 2024-03-04T09:35:02.834 INFO:tasks.workunit.client.0.smithi046.stdout:3/732: dwrite d1/d88/f9f [0,4194304] 0 2024-03-04T09:35:02.834 INFO:tasks.workunit.client.0.smithi046.stdout:3/733: write d1/d21/d35/d24/ff0 [462081,49931] 0 2024-03-04T09:35:02.918 INFO:tasks.workunit.client.0.smithi046.stdout:4/656: symlink d0/d1f/lf6 0 2024-03-04T09:35:02.918 INFO:tasks.workunit.client.0.smithi046.stdout:4/657: stat d0/d1f/d25/d7b 0 2024-03-04T09:35:03.317 INFO:tasks.workunit.client.0.smithi046.stdout:5/591: rename d1/d5f to d1/d44/d81/d96/d20/d76/d6c/db2 0 2024-03-04T09:35:03.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/690: getdents d1/d11/d6/d8/d12/d1c/dd1/d5e 0 2024-03-04T09:35:03.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/728: mknod da/d14/d1e/c106 0 2024-03-04T09:35:03.345 INFO:tasks.workunit.client.0.smithi046.stdout:6/729: write da/dd/d39/fb7 [158266,128306] 0 2024-03-04T09:35:03.345 INFO:tasks.workunit.client.0.smithi046.stdout:6/730: creat da/d14/d1e/d27/d4a/db2/f107 x:0 0 0 2024-03-04T09:35:03.345 INFO:tasks.workunit.client.0.smithi046.stdout:6/731: chown da/dd/d22/c28 167 1 2024-03-04T09:35:03.346 INFO:tasks.workunit.client.0.smithi046.stdout:6/732: chown da/d14/d1e/d2c 149 1 2024-03-04T09:35:03.346 INFO:tasks.workunit.client.0.smithi046.stdout:6/733: fsync da/d14/d1e/d27/d78/d66/fad 0 2024-03-04T09:35:03.402 INFO:tasks.workunit.client.0.smithi046.stdout:5/592: dwrite d1/d44/d81/d96/d20/f42 [4194304,4194304] 0 2024-03-04T09:35:03.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/658: creat d0/d1f/db9/ddd/ff7 x:0 0 0 2024-03-04T09:35:03.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/659: dwrite d0/d3/d20/d96/fd2 [0,4194304] 0 2024-03-04T09:35:03.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/660: write d0/d5f/d6f/f7f [1704972,71541] 0 2024-03-04T09:35:03.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/581: dwrite d7/de/d4c/f98 [0,4194304] 0 2024-03-04T09:35:03.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/734: rename d1/d21/d35/d43/f64 to d1/d1d/d27/d4a/d78/de0/f104 0 2024-03-04T09:35:03.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/735: fsync d1/d88/fd5 0 2024-03-04T09:35:03.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/736: chown d1/d21/d35/d43/dd2/fe9 77533252 1 2024-03-04T09:35:03.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/691: truncate d1/fc5 50309 0 2024-03-04T09:35:04.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/661: mknod d0/d1f/d25/d50/d63/cf8 0 2024-03-04T09:35:04.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/662: write d0/d1f/d25/d50/fae [104163,48573] 0 2024-03-04T09:35:05.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/582: creat d7/fc3 x:0 0 0 2024-03-04T09:35:05.075 INFO:tasks.workunit.client.0.smithi046.stdout:9/692: symlink d1/d11/d6/lda 0 2024-03-04T09:35:05.075 INFO:tasks.workunit.client.0.smithi046.stdout:9/693: readlink d1/d11/d3e/l8f 0 2024-03-04T09:35:05.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/593: mkdir d1/db3 0 2024-03-04T09:35:05.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/594: fsync d1/f82 0 2024-03-04T09:35:05.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/663: creat d0/d1f/d25/d50/df5/ff9 x:0 0 0 2024-03-04T09:35:05.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/664: dread d0/d3/d3b/d8d/fa3 [0,4194304] 0 2024-03-04T09:35:05.641 INFO:tasks.workunit.client.0.smithi046.stdout:4/665: dwrite d0/d3/d16/d1e/f36 [0,4194304] 0 2024-03-04T09:35:05.641 INFO:tasks.workunit.client.0.smithi046.stdout:4/666: fsync d0/d3/d20/f64 0 2024-03-04T09:35:05.723 INFO:tasks.workunit.client.0.smithi046.stdout:8/583: creat d7/de/d12/da9/fc4 x:0 0 0 2024-03-04T09:35:06.025 INFO:tasks.workunit.client.0.smithi046.stdout:9/694: creat d1/d11/d6/d8/d12/d1c/dd1/d4c/fdb x:0 0 0 2024-03-04T09:35:06.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/595: link d1/d44/d81/d8e/c6f d1/d44/d81/d96/cb4 0 2024-03-04T09:35:06.188 INFO:tasks.workunit.client.0.smithi046.stdout:5/596: dwrite d1/d44/d81/d96/f4c [4194304,4194304] 0 2024-03-04T09:35:06.287 INFO:tasks.workunit.client.0.smithi046.stdout:5/597: dwrite d1/f5 [0,4194304] 0 2024-03-04T09:35:06.494 INFO:tasks.workunit.client.0.smithi046.stdout:4/667: creat d0/d1f/de8/ffa x:0 0 0 2024-03-04T09:35:06.744 INFO:tasks.workunit.client.0.smithi046.stdout:9/695: mkdir d1/d11/d6/d8/d6f/d8c/d9a/ddc 0 2024-03-04T09:35:07.320 INFO:tasks.workunit.client.0.smithi046.stdout:1/559: dwrite d1/d28/f40 [0,4194304] 0 2024-03-04T09:35:07.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/560: dread d1/d28/d6f/da6/fb4 [0,4194304] 0 2024-03-04T09:35:07.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/668: creat d0/d1f/d25/d50/ddb/ffb x:0 0 0 2024-03-04T09:35:07.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/669: dread d0/d1f/d5b/f78 [0,4194304] 0 2024-03-04T09:35:07.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/670: dread - d0/d3/d3b/d8d/fb8 zero size 2024-03-04T09:35:07.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/671: dread - d0/d1f/d25/d50/fdf zero size 2024-03-04T09:35:07.492 INFO:tasks.workunit.client.0.smithi046.stdout:4/672: dread d0/d3/d3b/d8d/f68 [0,4194304] 0 2024-03-04T09:35:07.701 INFO:tasks.workunit.client.0.smithi046.stdout:0/622: creat d10/fdb x:0 0 0 2024-03-04T09:35:07.765 INFO:tasks.workunit.client.0.smithi046.stdout:0/623: dwrite d10/fdb [0,4194304] 0 2024-03-04T09:35:08.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/673: creat d0/d3/d3b/d8d/ffc x:0 0 0 2024-03-04T09:35:08.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/624: truncate d10/d12/d1f/f27 3674574 0 2024-03-04T09:35:08.505 INFO:tasks.workunit.client.0.smithi046.stdout:4/674: dread d0/d3/d20/f38 [0,4194304] 0 2024-03-04T09:35:08.704 INFO:tasks.workunit.client.0.smithi046.stdout:0/625: mknod d10/d12/d52/d5d/d83/cdc 0 2024-03-04T09:35:08.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/626: dread d10/d36/f76 [0,4194304] 0 2024-03-04T09:35:08.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/627: write d10/d12/d52/d78/f3c [630642,45843] 0 2024-03-04T09:35:09.402 INFO:tasks.workunit.client.0.smithi046.stdout:0/628: unlink d10/d12/d52/d78/f33 0 2024-03-04T09:35:09.616 INFO:tasks.workunit.client.0.smithi046.stdout:0/629: rmdir d10/d12/d1f/d3b/d6b 39 2024-03-04T09:35:11.118 INFO:tasks.workunit.client.0.smithi046.stdout:5/598: link d1/d44/d81/d96/f49 d1/d44/d81/fb5 0 2024-03-04T09:35:11.118 INFO:tasks.workunit.client.0.smithi046.stdout:5/599: chown d1/d44/d81/d96/d20/d76/d6c/d7b/f3d 1101 1 2024-03-04T09:35:11.151 INFO:tasks.workunit.client.0.smithi046.stdout:3/737: rename d1/d1d/d5e to d1/d1d/d27/d40/d70/d105 0 2024-03-04T09:35:11.151 INFO:tasks.workunit.client.0.smithi046.stdout:3/738: getdents d1/d21/d26 0 2024-03-04T09:35:11.153 INFO:tasks.workunit.client.0.smithi046.stdout:7/602: sync 2024-03-04T09:35:11.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/635: sync 2024-03-04T09:35:11.153 INFO:tasks.workunit.client.0.smithi046.stdout:6/734: sync 2024-03-04T09:35:11.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/600: truncate d1/d44/d81/d8e/f33 1543948 0 2024-03-04T09:35:11.333 INFO:tasks.workunit.client.0.smithi046.stdout:5/601: getdents d1/d44/d81/d96/d9a/da0 0 2024-03-04T09:35:11.525 INFO:tasks.workunit.client.0.smithi046.stdout:9/696: rename d1/d11/d6/d8/d12/d1c/d26/c66 to d1/d11/d6/d8/d1d/d34/d7f/cdd 0 2024-03-04T09:35:11.624 INFO:tasks.workunit.client.0.smithi046.stdout:9/697: dwrite d1/d11/d6/d8/d12/d1c/f48 [0,4194304] 0 2024-03-04T09:35:11.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/739: mkdir d1/d21/d35/d43/dd2/d9a/dbc/d106 0 2024-03-04T09:35:11.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/740: dread d1/f3f [0,4194304] 0 2024-03-04T09:35:11.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/741: stat d1/d21/d35/d43/dd2/d51/da3/cc0 0 2024-03-04T09:35:11.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/603: unlink d0/d2d/c74 0 2024-03-04T09:35:11.837 INFO:tasks.workunit.client.0.smithi046.stdout:7/604: dwrite d0/d4/db/d38/d94/fa8 [0,4194304] 0 2024-03-04T09:35:12.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/735: mknod da/d14/d1e/d27/d4a/d94/c108 0 2024-03-04T09:35:12.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/736: chown da/dd8 92735890 1 2024-03-04T09:35:12.342 INFO:tasks.workunit.client.0.smithi046.stdout:5/602: creat d1/d44/d81/d96/d20/d76/fb6 x:0 0 0 2024-03-04T09:35:12.636 INFO:tasks.workunit.client.0.smithi046.stdout:8/584: mknod d7/de/cc5 0 2024-03-04T09:35:12.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/675: rename d0/d1f/d25/l8a to d0/d1f/d25/da6/lfd 0 2024-03-04T09:35:12.687 INFO:tasks.workunit.client.0.smithi046.stdout:8/585: dwrite d7/d53/d72/fb0 [0,4194304] 0 2024-03-04T09:35:12.729 INFO:tasks.workunit.client.0.smithi046.stdout:8/586: read d7/de/d3e/fc2 [3635746,50950] 0 2024-03-04T09:35:12.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/587: dwrite d7/f46 [0,4194304] 0 2024-03-04T09:35:12.905 INFO:tasks.workunit.client.0.smithi046.stdout:3/742: mkdir d1/d1d/d27/d4a/d78/de0/d107 0 2024-03-04T09:35:13.373 INFO:tasks.workunit.client.0.smithi046.stdout:7/605: link d0/c23 d0/da/d4e/ccd 0 2024-03-04T09:35:13.442 INFO:tasks.workunit.client.0.smithi046.stdout:7/606: dwrite d0/d4/f5 [0,4194304] 0 2024-03-04T09:35:13.529 INFO:tasks.workunit.client.0.smithi046.stdout:6/737: symlink da/dd/d39/d60/dac/dcb/l109 0 2024-03-04T09:35:13.703 INFO:tasks.workunit.client.0.smithi046.stdout:5/603: mkdir d1/d44/d81/d96/d20/d76/d6c/d7b/db7 0 2024-03-04T09:35:13.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/604: fsync d1/d44/d81/d96/d20/d76/d6c/db2/f64 0 2024-03-04T09:35:13.729 INFO:tasks.workunit.client.0.smithi046.stdout:5/605: dread d1/d44/d57/d70/d86/d92/fa7 [0,4194304] 0 2024-03-04T09:35:13.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/561: symlink d1/d28/d6f/da6/lb5 0 2024-03-04T09:35:13.911 INFO:tasks.workunit.client.0.smithi046.stdout:0/630: rename d10/d12/d52/d78/f6d to d10/d12/d9f/da6/fdd 0 2024-03-04T09:35:14.387 INFO:tasks.workunit.client.0.smithi046.stdout:3/743: creat d1/d1d/d27/d40/d70/d7d/f108 x:0 0 0 2024-03-04T09:35:14.452 INFO:tasks.workunit.client.0.smithi046.stdout:3/744: dwrite d1/f89 [0,4194304] 0 2024-03-04T09:35:14.941 INFO:tasks.workunit.client.0.smithi046.stdout:4/676: link d0/d1f/d25/d50/ddb/ffb d0/d3/ffe 0 2024-03-04T09:35:14.941 INFO:tasks.workunit.client.0.smithi046.stdout:7/607: creat d0/da/d46/fce x:0 0 0 2024-03-04T09:35:14.989 INFO:tasks.workunit.client.0.smithi046.stdout:4/677: dwrite d0/d1f/d25/d50/fae [0,4194304] 0 2024-03-04T09:35:14.989 INFO:tasks.workunit.client.0.smithi046.stdout:4/678: fdatasync d0/d3/d16/f1a 0 2024-03-04T09:35:15.007 INFO:tasks.workunit.client.0.smithi046.stdout:6/738: creat da/d4e/d98/f10a x:0 0 0 2024-03-04T09:35:15.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/606: unlink d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/fa8 0 2024-03-04T09:35:15.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/607: readlink d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/l34 0 2024-03-04T09:35:15.394 INFO:tasks.workunit.client.0.smithi046.stdout:0/631: symlink d10/d12/d52/d78/lde 0 2024-03-04T09:35:16.274 INFO:tasks.workunit.client.0.smithi046.stdout:2/636: write d5/da/d1b/f30 [1662984,44356] 0 2024-03-04T09:35:16.274 INFO:tasks.workunit.client.0.smithi046.stdout:3/745: mknod d1/d21/d35/d43/dd2/d9a/dbc/c109 0 2024-03-04T09:35:17.528 INFO:tasks.workunit.client.0.smithi046.stdout:5/608: symlink d1/d44/d81/d96/d20/d76/d6c/d7b/lb8 0 2024-03-04T09:35:17.535 INFO:tasks.workunit.client.0.smithi046.stdout:9/698: rename d1/d11/d6/d8/d12/d1c/d26/d91 to d1/d11/d6/d8/d12/d1c/dd1/d5e/dde 0 2024-03-04T09:35:17.550 INFO:tasks.workunit.client.0.smithi046.stdout:5/609: dread d1/d44/d81/d8e/d72/fa2 [0,4194304] 0 2024-03-04T09:35:17.550 INFO:tasks.workunit.client.0.smithi046.stdout:5/610: truncate d1/f7 5252774 0 2024-03-04T09:35:17.550 INFO:tasks.workunit.client.0.smithi046.stdout:5/611: fsync d1/d44/d81/d96/d20/f3b 0 2024-03-04T09:35:17.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/612: readlink d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/l75 0 2024-03-04T09:35:17.559 INFO:tasks.workunit.client.0.smithi046.stdout:9/699: write d1/d11/d6/d8/d1d/d34/d4d/f55 [1807231,73509] 0 2024-03-04T09:35:17.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/700: dwrite d1/d11/d3e/fa6 [0,4194304] 0 2024-03-04T09:35:17.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/701: fdatasync d1/d11/d6/d8/d6f/d8c/f9c 0 2024-03-04T09:35:17.668 INFO:tasks.workunit.client.0.smithi046.stdout:0/632: truncate d10/f14 1067234 0 2024-03-04T09:35:17.668 INFO:tasks.workunit.client.0.smithi046.stdout:0/633: dread - d10/d12/d52/d5d/f64 zero size 2024-03-04T09:35:17.668 INFO:tasks.workunit.client.0.smithi046.stdout:0/634: chown d10/d12/d9a/dd8 3022 1 2024-03-04T09:35:17.929 INFO:tasks.workunit.client.0.smithi046.stdout:1/562: link d1/d28/d6f/da6/fb4 d1/fb6 0 2024-03-04T09:35:18.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/637: truncate d5/da/f2b 654991 0 2024-03-04T09:35:18.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/746: mknod d1/d1d/d27/d4a/d78/c10a 0 2024-03-04T09:35:18.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/747: chown d1/d21/l2f 3604879 1 2024-03-04T09:35:18.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/748: creat d1/d21/d35/d43/f10b x:0 0 0 2024-03-04T09:35:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:3/749: write d1/d21/d35/d24/fe6 [649974,97177] 0 2024-03-04T09:35:18.231 INFO:tasks.workunit.client.0.smithi046.stdout:5/613: creat d1/d44/d81/d96/d20/fb9 x:0 0 0 2024-03-04T09:35:18.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/702: getdents d1/d11/d6/d8/d6f 0 2024-03-04T09:35:18.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/703: creat d1/d11/d3e/fdf x:0 0 0 2024-03-04T09:35:18.936 INFO:tasks.workunit.client.0.smithi046.stdout:0/635: rmdir d10/d36/d7a 39 2024-03-04T09:35:19.088 INFO:tasks.workunit.client.0.smithi046.stdout:8/588: sync 2024-03-04T09:35:19.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/589: dwrite d7/de/f21 [0,4194304] 0 2024-03-04T09:35:19.446 INFO:tasks.workunit.client.0.smithi046.stdout:3/750: symlink d1/d21/d35/d43/dd2/d51/da3/l10c 0 2024-03-04T09:35:19.756 INFO:tasks.workunit.client.0.smithi046.stdout:5/614: rmdir d1/d44/d57/d70/d86/d92/db1 0 2024-03-04T09:35:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:9/704: getdents d1/d11/d6/d8/d12/d1c/dd1/d4c 0 2024-03-04T09:35:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:9/705: read d1/d11/d6/d8/d1d/d34/d4d/f55 [7094078,19036] 0 2024-03-04T09:35:20.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/706: write d1/d11/d6/d8/d12/d1c/dd1/f80 [797011,93685] 0 2024-03-04T09:35:20.435 INFO:tasks.workunit.client.0.smithi046.stdout:0/636: creat d10/d12/d52/d78/d8a/da2/dc8/fdf x:0 0 0 2024-03-04T09:35:20.436 INFO:tasks.workunit.client.0.smithi046.stdout:0/637: chown cb 0 1 2024-03-04T09:35:20.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/638: dread d10/f20 [0,4194304] 0 2024-03-04T09:35:20.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/739: rename c3 to da/d14/d1e/d27/d4a/dab/ddc/c10b 0 2024-03-04T09:35:21.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:35:21.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:35:21.683 INFO:tasks.workunit.client.0.smithi046.stdout:9/707: stat d1/d11/d6/d8/d12/f1e 0 2024-03-04T09:35:21.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/639: truncate d10/d12/f82 64412 0 2024-03-04T09:35:21.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/640: read - d10/d36/d87/fd6 zero size 2024-03-04T09:35:21.891 INFO:tasks.workunit.client.0.smithi046.stdout:5/615: rename d1/d44/d81/d96/d20/d76/d6c/d7b/lb8 to d1/d44/d57/d70/d86/d92/lba 0 2024-03-04T09:35:21.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/740: mknod da/d4e/d98/c10c 0 2024-03-04T09:35:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/616: dwrite d1/d44/d81/d96/d20/d76/fa3 [0,4194304] 0 2024-03-04T09:35:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/617: readlink d1/d44/d81/d96/d20/d76/d6c/d7b/l85 0 2024-03-04T09:35:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/618: stat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/c12 0 2024-03-04T09:35:21.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/679: sync 2024-03-04T09:35:21.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/680: chown d0/d3/d16/d1e/cf4 21 1 2024-03-04T09:35:21.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/681: chown d0/d1f/f44 7673448 1 2024-03-04T09:35:22.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/619: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f66 [0,4194304] 0 2024-03-04T09:35:22.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/620: readlink d1/d44/d81/d96/d4f/d8f/la1 0 2024-03-04T09:35:22.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/621: stat d1/d44/d81/d8e/d72/fa2 0 2024-03-04T09:35:22.411 INFO:tasks.workunit.client.0.smithi046.stdout:0/641: creat d10/d12/d9a/dd8/fe0 x:0 0 0 2024-03-04T09:35:22.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/741: unlink da/d14/d1e/d27/d78/ce5 0 2024-03-04T09:35:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/682: symlink d0/d3/d3b/d8d/lff 0 2024-03-04T09:35:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:5/622: mkdir d1/d44/d57/d70/d86/d92/dbb 0 2024-03-04T09:35:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/683: chown d0/d3/d20/d96/lc4 14911 1 2024-03-04T09:35:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:5/623: fdatasync d1/d44/d81/f91 0 2024-03-04T09:35:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/684: chown d0/d1f/d25/da6/lfd 275 1 2024-03-04T09:35:22.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/708: symlink d1/d11/d6/d8/d12/d1c/dd1/d5e/dde/le0 0 2024-03-04T09:35:23.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/642: creat d10/d12/d52/d78/d8a/fe1 x:0 0 0 2024-03-04T09:35:23.335 INFO:tasks.workunit.client.0.smithi046.stdout:4/685: mkdir d0/d3/d16/d1e/da1/dc1/d100 0 2024-03-04T09:35:23.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/624: mkdir d1/d44/d81/d96/d20/d76/d6c/db2/dbc 0 2024-03-04T09:35:23.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/625: truncate d1/d44/d81/d96/f4c 8543911 0 2024-03-04T09:35:23.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/626: dread d1/f36 [0,4194304] 0 2024-03-04T09:35:23.511 INFO:tasks.workunit.client.0.smithi046.stdout:9/709: rmdir d1/d11/d6/d8/d13/d92 39 2024-03-04T09:35:23.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/686: mkdir d0/d1f/d25/d50/df5/d101 0 2024-03-04T09:35:23.941 INFO:tasks.workunit.client.0.smithi046.stdout:7/608: dwrite d0/d4/db/d12/f30 [0,4194304] 0 2024-03-04T09:35:23.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/687: dwrite d0/f41 [0,4194304] 0 2024-03-04T09:35:23.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/688: write d0/d1f/fb6 [34086,26034] 0 2024-03-04T09:35:23.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/710: symlink d1/d11/d6/d8/d12/d1c/dd1/le1 0 2024-03-04T09:35:23.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/711: readlink d1/d11/d6/d8/lbd 0 2024-03-04T09:35:23.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/712: readlink d1/d11/l7c 0 2024-03-04T09:35:24.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/713: dwrite d1/d11/d6/d8/d12/d1c/dd1/d5e/fbe [0,4194304] 0 2024-03-04T09:35:24.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/714: truncate d1/d11/d6/d8/d1d/d34/d7f/fbf 341653 0 2024-03-04T09:35:24.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/715: chown d1/d11/d6/d8/d13/d92 1472037104 1 2024-03-04T09:35:24.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/716: dread d1/d11/d6/d8/d1d/f77 [0,4194304] 0 2024-03-04T09:35:24.277 INFO:tasks.workunit.client.0.smithi046.stdout:7/609: creat d0/d4/db/d38/d7e/fcf x:0 0 0 2024-03-04T09:35:24.277 INFO:tasks.workunit.client.0.smithi046.stdout:7/610: write d0/d4/db/d38/f57 [1656611,19917] 0 2024-03-04T09:35:24.669 INFO:tasks.workunit.client.0.smithi046.stdout:2/638: write d5/d84/d88/f44 [1058899,33073] 0 2024-03-04T09:35:24.850 INFO:tasks.workunit.client.0.smithi046.stdout:7/611: truncate d0/d4/db/d3b/f7c 154063 0 2024-03-04T09:35:25.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/639: getdents d5 0 2024-03-04T09:35:25.388 INFO:tasks.workunit.client.0.smithi046.stdout:2/640: dwrite d5/d38/f66 [0,4194304] 0 2024-03-04T09:35:25.459 INFO:tasks.workunit.client.0.smithi046.stdout:2/641: dwrite d5/d84/d88/d3f/f41 [0,4194304] 0 2024-03-04T09:35:25.705 INFO:tasks.workunit.client.0.smithi046.stdout:9/717: symlink d1/d11/d6/d8/d13/d92/le2 0 2024-03-04T09:35:25.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/718: write d1/d11/d6/d8/d12/d1c/dd1/d4c/fdb [602797,65282] 0 2024-03-04T09:35:25.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/719: dread - d1/d11/d6/d8/d12/d1c/dd1/d4c/da3/fd5 zero size 2024-03-04T09:35:26.084 INFO:tasks.workunit.client.0.smithi046.stdout:6/742: getdents da/d14/d1e/d27/d4a/dab/ddc 0 2024-03-04T09:35:26.084 INFO:tasks.workunit.client.0.smithi046.stdout:6/743: fdatasync da/d14/f19 0 2024-03-04T09:35:26.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/590: dwrite d7/de/d28/d71/faa [0,4194304] 0 2024-03-04T09:35:26.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/720: chown d1/d11/d6/d8/d13/d92/lb8 11202 1 2024-03-04T09:35:26.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/744: rmdir da/d14/d17 39 2024-03-04T09:35:26.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/745: fdatasync da/dd/d39/fdb 0 2024-03-04T09:35:26.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/642: mkdir d5/d84/d88/d3f/dd3 0 2024-03-04T09:35:26.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/746: dread da/d14/d1e/d27/d4b/f75 [0,4194304] 0 2024-03-04T09:35:26.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/747: readlink da/dd/d39/d60/l9a 0 2024-03-04T09:35:26.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/721: mknod d1/d11/d6/d8/d13/ce3 0 2024-03-04T09:35:27.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/591: rename d7/de/d28/dab/d2c/d64/cba to d7/de/d28/dab/d2c/cc6 0 2024-03-04T09:35:27.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/722: truncate d1/d11/fac 388739 0 2024-03-04T09:35:27.791 INFO:tasks.workunit.client.0.smithi046.stdout:2/643: unlink d5/da/d1b/l77 0 2024-03-04T09:35:27.980 INFO:tasks.workunit.client.0.smithi046.stdout:6/748: rename da/d14/d1e/d27/d78/d66/d81/fe9 to da/d14/f10d 0 2024-03-04T09:35:28.237 INFO:tasks.workunit.client.0.smithi046.stdout:8/592: symlink d7/de/d28/lc7 0 2024-03-04T09:35:28.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/593: dwrite d7/de/d12/f43 [0,4194304] 0 2024-03-04T09:35:28.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/594: fdatasync d7/de/d28/dab/d3c/da5/fbc 0 2024-03-04T09:35:28.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/595: write d7/de/d28/dab/d3c/fb1 [66884,49824] 0 2024-03-04T09:35:28.318 INFO:tasks.workunit.client.0.smithi046.stdout:8/596: chown d7/f23 3090671 1 2024-03-04T09:35:28.318 INFO:tasks.workunit.client.0.smithi046.stdout:8/597: readlink d7/de/d4c/d5a/l70 0 2024-03-04T09:35:28.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/723: unlink d1/d11/d6/d8/d13/d21/c44 0 2024-03-04T09:35:28.632 INFO:tasks.workunit.client.0.smithi046.stdout:2/644: rename d5/l79 to d5/db9/ld4 0 2024-03-04T09:35:28.670 INFO:tasks.workunit.client.0.smithi046.stdout:2/645: dread d5/d84/d88/d3f/f4b [0,4194304] 0 2024-03-04T09:35:28.739 INFO:tasks.workunit.client.0.smithi046.stdout:6/749: mkdir da/dd/d39/d60/da0/ddd/d10e 0 2024-03-04T09:35:29.141 INFO:tasks.workunit.client.0.smithi046.stdout:0/643: fsync d10/d12/d52/d78/d8a/fe1 0 2024-03-04T09:35:29.247 INFO:tasks.workunit.client.0.smithi046.stdout:6/750: mknod da/d14/d17/dd3/de3/c10f 0 2024-03-04T09:35:29.378 INFO:tasks.workunit.client.0.smithi046.stdout:1/563: unlink d1/d28/c75 0 2024-03-04T09:35:29.506 INFO:tasks.workunit.client.0.smithi046.stdout:8/598: symlink d7/de/d28/dab/d2c/lc8 0 2024-03-04T09:35:29.506 INFO:tasks.workunit.client.0.smithi046.stdout:8/599: write d7/de/d12/fb7 [441065,11673] 0 2024-03-04T09:35:29.683 INFO:tasks.workunit.client.0.smithi046.stdout:0/644: truncate d10/d12/d52/d5d/fac 3285379 0 2024-03-04T09:35:29.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/645: creat d10/d12/d6e/d99/fe2 x:0 0 0 2024-03-04T09:35:30.028 INFO:tasks.workunit.client.0.smithi046.stdout:6/751: mknod da/d14/d17/dd3/de3/c110 0 2024-03-04T09:35:30.091 INFO:tasks.workunit.client.0.smithi046.stdout:6/752: dwrite da/dd/d39/fdb [0,4194304] 0 2024-03-04T09:35:30.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/627: write d1/d44/d81/d96/f10 [3372441,110304] 0 2024-03-04T09:35:30.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/600: mkdir d7/de/d4c/d5a/dc9 0 2024-03-04T09:35:30.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/601: chown d7/de/d4c/d50/f85 170709084 1 2024-03-04T09:35:30.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/602: write d7/de/d28/dab/d3c/f9c [628491,85743] 0 2024-03-04T09:35:30.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/646: creat d10/dd5/fe3 x:0 0 0 2024-03-04T09:35:30.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/647: chown d10/d12/d6e/d99 7271351 1 2024-03-04T09:35:31.205 INFO:tasks.workunit.client.0.smithi046.stdout:6/753: mkdir da/d14/d1e/d27/da3/d111 0 2024-03-04T09:35:31.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/754: chown da/d14/fb9 325095176 1 2024-03-04T09:35:31.265 INFO:tasks.workunit.client.0.smithi046.stdout:5/628: mkdir d1/d44/d57/d70/da6/dbd 0 2024-03-04T09:35:31.265 INFO:tasks.workunit.client.0.smithi046.stdout:8/603: mkdir d7/de/d28/dca 0 2024-03-04T09:35:31.265 INFO:tasks.workunit.client.0.smithi046.stdout:8/604: chown d7/de/d28/d36/d7c 7182118 1 2024-03-04T09:35:31.292 INFO:tasks.workunit.client.0.smithi046.stdout:5/629: dread d1/d44/d81/d96/d20/f5d [0,4194304] 0 2024-03-04T09:35:31.322 INFO:tasks.workunit.client.0.smithi046.stdout:5/630: dread d1/d44/d81/d96/d20/d76/d6c/db2/f7c [0,4194304] 0 2024-03-04T09:35:31.628 INFO:tasks.workunit.client.0.smithi046.stdout:1/564: rename d1/d28/d6f/d74/d97 to d1/d28/d6f/db7 0 2024-03-04T09:35:31.629 INFO:tasks.workunit.client.0.smithi046.stdout:1/565: write d1/d28/d6f/fa2 [374087,5115] 0 2024-03-04T09:35:31.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/605: truncate d7/de/d12/f59 684011 0 2024-03-04T09:35:31.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/755: truncate da/dd/d39/f45 1505854 0 2024-03-04T09:35:31.988 INFO:tasks.workunit.client.0.smithi046.stdout:0/648: truncate d10/d12/d52/d78/f30 2416658 0 2024-03-04T09:35:31.988 INFO:tasks.workunit.client.0.smithi046.stdout:0/649: truncate d10/d12/d9f/fb0 513793 0 2024-03-04T09:35:31.988 INFO:tasks.workunit.client.0.smithi046.stdout:0/650: chown d10/d12/d52/d78/d8a/da2 5 1 2024-03-04T09:35:32.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/606: dwrite d7/de/d3e/fc2 [0,4194304] 0 2024-03-04T09:35:32.117 INFO:tasks.workunit.client.0.smithi046.stdout:7/612: dwrite d0/f16 [0,4194304] 0 2024-03-04T09:35:32.331 INFO:tasks.workunit.client.0.smithi046.stdout:5/631: rename d1/d44/d57/d70/da6/dbd to d1/d44/d81/d8e/dbe 0 2024-03-04T09:35:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/756: link da/d4e/cc8 da/dd/d39/d60/da0/d67/dcf/c112 0 2024-03-04T09:35:32.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/757: dread da/d14/d1e/d2c/f63 [0,4194304] 0 2024-03-04T09:35:32.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/758: creat da/d4e/d98/f113 x:0 0 0 2024-03-04T09:35:32.660 INFO:tasks.workunit.client.0.smithi046.stdout:0/651: link d10/d12/d1f/d3f/f65 d10/d12/d9f/da6/dc3/fe4 0 2024-03-04T09:35:32.728 INFO:tasks.workunit.client.0.smithi046.stdout:0/652: dwrite fc [4194304,4194304] 0 2024-03-04T09:35:32.728 INFO:tasks.workunit.client.0.smithi046.stdout:0/653: creat d10/d12/d9a/fe5 x:0 0 0 2024-03-04T09:35:32.750 INFO:tasks.workunit.client.0.smithi046.stdout:0/654: write d10/d12/d52/d78/f50 [1045474,89180] 0 2024-03-04T09:35:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/607: mknod d7/d53/ccb 0 2024-03-04T09:35:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/608: fsync d7/de/d28/dab/f99 0 2024-03-04T09:35:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/609: dread - d7/de/d3e/f80 zero size 2024-03-04T09:35:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/610: dread - d7/de/d3e/f80 zero size 2024-03-04T09:35:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/611: chown d7/de/d28/dab/d2c/cbf 2580896 1 2024-03-04T09:35:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/612: chown d7/de/d12/f43 6595714 1 2024-03-04T09:35:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/613: creat d7/de/d4c/d50/fcc x:0 0 0 2024-03-04T09:35:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/614: getdents d7/d53/d72/d93 0 2024-03-04T09:35:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/615: read - d7/de/d28/dab/d2c/fa3 zero size 2024-03-04T09:35:32.773 INFO:tasks.workunit.client.0.smithi046.stdout:8/616: stat d7/de/d28/l78 0 2024-03-04T09:35:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/689: creat d0/d1f/f102 x:0 0 0 2024-03-04T09:35:33.882 INFO:tasks.workunit.client.0.smithi046.stdout:6/759: symlink da/d14/d1e/d27/d4a/dab/ddc/l114 0 2024-03-04T09:35:33.882 INFO:tasks.workunit.client.0.smithi046.stdout:6/760: rename da to da/dd/d46/d115 22 2024-03-04T09:35:33.883 INFO:tasks.workunit.client.0.smithi046.stdout:6/761: write da/d14/d1e/d27/da3/fcc [660223,112421] 0 2024-03-04T09:35:33.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/762: dwrite da/d14/d1e/f33 [0,4194304] 0 2024-03-04T09:35:34.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/724: symlink d1/d11/d6/d8/d12/le4 0 2024-03-04T09:35:34.683 INFO:tasks.workunit.client.0.smithi046.stdout:4/690: symlink d0/d3/d16/d1e/d73/l103 0 2024-03-04T09:35:34.763 INFO:tasks.workunit.client.0.smithi046.stdout:4/691: dwrite d0/d1f/d25/d7b/f92 [0,4194304] 0 2024-03-04T09:35:34.882 INFO:tasks.workunit.client.0.smithi046.stdout:7/613: mknod d0/d4/db/cd0 0 2024-03-04T09:35:34.950 INFO:tasks.workunit.client.0.smithi046.stdout:7/614: dwrite d0/da/d46/f8b [0,4194304] 0 2024-03-04T09:35:34.974 INFO:tasks.workunit.client.0.smithi046.stdout:7/615: dread d0/da/fac [0,4194304] 0 2024-03-04T09:35:34.991 INFO:tasks.workunit.client.0.smithi046.stdout:2/646: dwrite d5/da/f24 [0,4194304] 0 2024-03-04T09:35:35.247 INFO:tasks.workunit.client.0.smithi046.stdout:3/751: sync 2024-03-04T09:35:35.536 INFO:tasks.workunit.client.0.smithi046.stdout:1/566: rename d1/fb6 to d1/fb8 0 2024-03-04T09:35:37.405 INFO:tasks.workunit.client.0.smithi046.stdout:7/616: creat d0/da/d4e/fd1 x:0 0 0 2024-03-04T09:35:37.405 INFO:tasks.workunit.client.0.smithi046.stdout:9/725: mknod d1/ce5 0 2024-03-04T09:35:37.405 INFO:tasks.workunit.client.0.smithi046.stdout:9/726: read - d1/d11/d6/d8/d6f/d8c/d9a/fc6 zero size 2024-03-04T09:35:37.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/647: symlink d5/d84/d88/ld5 0 2024-03-04T09:35:37.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/648: fdatasync d5/da/f24 0 2024-03-04T09:35:37.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/649: dread d5/fb4 [0,4194304] 0 2024-03-04T09:35:37.714 INFO:tasks.workunit.client.0.smithi046.stdout:3/752: creat d1/d1d/d27/d40/d92/f10d x:0 0 0 2024-03-04T09:35:37.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/655: link d10/d12/d1f/d3b/d6b/f72 d10/d12/d9a/fe6 0 2024-03-04T09:35:37.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/656: fsync d10/d12/d52/d5d/fcb 0 2024-03-04T09:35:37.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/657: chown d10/d12/d1f/d3f/d4b/c5b 330514 1 2024-03-04T09:35:37.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/658: fdatasync fe 0 2024-03-04T09:35:38.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/753: mknod d1/d1d/d27/d4a/d78/de0/c10e 0 2024-03-04T09:35:38.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/754: write d1/d21/d35/d43/f10b [945157,18836] 0 2024-03-04T09:35:38.627 INFO:tasks.workunit.client.0.smithi046.stdout:0/659: dread d10/d12/d1f/f27 [0,4194304] 0 2024-03-04T09:35:38.627 INFO:tasks.workunit.client.0.smithi046.stdout:0/660: truncate d10/d12/d52/d78/f32 357680 0 2024-03-04T09:35:38.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/661: dwrite d10/d12/d52/d5d/f64 [0,4194304] 0 2024-03-04T09:35:38.709 INFO:tasks.workunit.client.0.smithi046.stdout:1/567: truncate d1/d28/f39 882405 0 2024-03-04T09:35:38.949 INFO:tasks.workunit.client.0.smithi046.stdout:3/755: mkdir d1/d1d/d27/d10f 0 2024-03-04T09:35:39.081 INFO:tasks.workunit.client.0.smithi046.stdout:8/617: dwrite d7/de/d12/f59 [0,4194304] 0 2024-03-04T09:35:39.626 INFO:tasks.workunit.client.0.smithi046.stdout:1/568: dwrite d1/f25 [0,4194304] 0 2024-03-04T09:35:40.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/632: unlink d1/f2 0 2024-03-04T09:35:40.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/618: symlink d7/de/d28/lcd 0 2024-03-04T09:35:40.165 INFO:tasks.workunit.client.0.smithi046.stdout:8/619: chown d7/de/d28/dab 214892 1 2024-03-04T09:35:40.277 INFO:tasks.workunit.client.0.smithi046.stdout:0/662: truncate d10/d12/d52/d78/f30 3357791 0 2024-03-04T09:35:40.277 INFO:tasks.workunit.client.0.smithi046.stdout:0/663: fdatasync d10/d12/f4f 0 2024-03-04T09:35:40.277 INFO:tasks.workunit.client.0.smithi046.stdout:0/664: chown d10/d12/d1f/c77 197702001 1 2024-03-04T09:35:40.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/665: write d10/d36/f40 [3428479,45903] 0 2024-03-04T09:35:40.593 INFO:tasks.workunit.client.0.smithi046.stdout:1/569: symlink d1/d28/d6f/d74/lb9 0 2024-03-04T09:35:40.691 INFO:tasks.workunit.client.0.smithi046.stdout:5/633: dread d1/d44/d81/d8e/f2e [0,4194304] 0 2024-03-04T09:35:40.906 INFO:tasks.workunit.client.0.smithi046.stdout:8/620: link d7/fc3 d7/de/d28/d3a/d6f/d84/fce 0 2024-03-04T09:35:40.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/621: dread d7/f23 [0,4194304] 0 2024-03-04T09:35:40.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/622: rename d7 to d7/d53/d72/d93/dcf 22 2024-03-04T09:35:40.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/623: stat d7/de/d28/dab/d2c/d64/lbd 0 2024-03-04T09:35:40.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/624: chown d7/de/c63 414174 1 2024-03-04T09:35:41.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/666: mknod d10/dc2/ce7 0 2024-03-04T09:35:41.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/667: truncate d10/d12/d9f/fd2 657644 0 2024-03-04T09:35:41.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/763: write da/dd/f13 [2588648,33542] 0 2024-03-04T09:35:41.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/764: chown da/d14/d1e/d8f/f9e 5013 1 2024-03-04T09:35:41.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/765: fsync da/dd/d39/f45 0 2024-03-04T09:35:41.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/766: creat da/d4e/d98/f116 x:0 0 0 2024-03-04T09:35:41.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/570: mkdir d1/d28/d6f/db7/dba 0 2024-03-04T09:35:41.573 INFO:tasks.workunit.client.0.smithi046.stdout:5/634: creat d1/d44/d69/fbf x:0 0 0 2024-03-04T09:35:41.929 INFO:tasks.workunit.client.0.smithi046.stdout:8/625: dwrite d7/de/d28/d71/faa [4194304,4194304] 0 2024-03-04T09:35:42.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/626: dwrite d7/de/d28/dab/d3c/da5/fb9 [0,4194304] 0 2024-03-04T09:35:42.073 INFO:tasks.workunit.client.0.smithi046.stdout:8/627: dwrite d7/d53/d72/fb0 [0,4194304] 0 2024-03-04T09:35:42.888 INFO:tasks.workunit.client.0.smithi046.stdout:8/628: mkdir d7/de/d28/d3a/d6f/dd0 0 2024-03-04T09:35:43.601 INFO:tasks.workunit.client.0.smithi046.stdout:8/629: rename d7/de/d28/dab/d2c/d64/lbd to d7/de/d12/ld1 0 2024-03-04T09:35:43.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/727: link d1/d11/d6/d8/d12/d1c/ca0 d1/d11/d6/d8/d12/d1c/dd1/ce6 0 2024-03-04T09:35:43.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/728: dread d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:35:44.020 INFO:tasks.workunit.client.0.smithi046.stdout:6/767: creat da/d14/d17/dd3/f117 x:0 0 0 2024-03-04T09:35:44.021 INFO:tasks.workunit.client.0.smithi046.stdout:4/692: sync 2024-03-04T09:35:44.272 INFO:tasks.workunit.client.0.smithi046.stdout:8/630: mknod d7/de/d28/dab/d2c/d64/db8/cd2 0 2024-03-04T09:35:44.631 INFO:tasks.workunit.client.0.smithi046.stdout:9/729: rename d1/d11/d6/d8/d1d/d34/d4d/la8 to d1/d11/d6/d8/d12/d1c/d26/le7 0 2024-03-04T09:35:44.677 INFO:tasks.workunit.client.0.smithi046.stdout:2/650: unlink d5/f13 0 2024-03-04T09:35:44.677 INFO:tasks.workunit.client.0.smithi046.stdout:2/651: stat f3 0 2024-03-04T09:35:44.705 INFO:tasks.workunit.client.0.smithi046.stdout:3/756: write d1/d21/ff9 [2426827,16525] 0 2024-03-04T09:35:44.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/757: write d1/d1d/d27/d4a/d78/de0/f104 [602118,40838] 0 2024-03-04T09:35:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:6/768: rename da/d4e/fc4 to da/dd/d39/d60/da0/d67/f118 0 2024-03-04T09:35:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:9/730: link d1/d11/d6/d8/d13/d92/le2 d1/d11/d6/d8/d6f/le8 0 2024-03-04T09:35:45.247 INFO:tasks.workunit.client.0.smithi046.stdout:9/731: dread d1/d11/d6/d8/d12/d1c/dd1/d5e/f6a [0,4194304] 0 2024-03-04T09:35:45.274 INFO:tasks.workunit.client.0.smithi046.stdout:9/732: write d1/d11/d6/d8/d12/d1c/dd1/d5e/fbe [1489363,54408] 0 2024-03-04T09:35:45.298 INFO:tasks.workunit.client.0.smithi046.stdout:6/769: dwrite da/dd/d39/d60/da0/d67/d64/d82/fbb [0,4194304] 0 2024-03-04T09:35:45.298 INFO:tasks.workunit.client.0.smithi046.stdout:6/770: readlink da/dd/d39/d60/dac/dcb/l109 0 2024-03-04T09:35:45.759 INFO:tasks.workunit.client.0.smithi046.stdout:2/652: symlink d5/d2c/ld6 0 2024-03-04T09:35:45.884 INFO:tasks.workunit.client.0.smithi046.stdout:3/758: symlink d1/d1d/l110 0 2024-03-04T09:35:45.922 INFO:tasks.workunit.client.0.smithi046.stdout:3/759: write d1/f20 [1985796,73652] 0 2024-03-04T09:35:45.922 INFO:tasks.workunit.client.0.smithi046.stdout:3/760: dread - d1/fd3 zero size 2024-03-04T09:35:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:4/693: rename d0/d1f/f77 to d0/d1f/d25/d50/d63/f104 0 2024-03-04T09:35:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/694: dwrite d0/d1f/d35/f6b [0,4194304] 0 2024-03-04T09:35:46.521 INFO:tasks.workunit.client.0.smithi046.stdout:6/771: creat da/dd/d39/d60/d7e/f119 x:0 0 0 2024-03-04T09:35:47.134 INFO:tasks.workunit.client.0.smithi046.stdout:4/695: creat d0/d3/d16/d1e/da1/dc1/d100/f105 x:0 0 0 2024-03-04T09:35:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/571: dwrite d1/d28/f38 [4194304,4194304] 0 2024-03-04T09:35:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/772: rmdir da/dd/d39/d60/da0/d67/dcf 39 2024-03-04T09:35:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/773: dread - da/d14/f10d zero size 2024-03-04T09:35:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:4/696: mknod d0/d1f/c106 0 2024-03-04T09:35:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/774: read - da/d14/d1e/d27/d4b/fb3 zero size 2024-03-04T09:35:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:4/697: fsync d0/d1f/db9/ddd/ff7 0 2024-03-04T09:35:47.437 INFO:tasks.workunit.client.0.smithi046.stdout:4/698: chown d0/d5f/d6f/fd7 47886 1 2024-03-04T09:35:47.437 INFO:tasks.workunit.client.0.smithi046.stdout:4/699: stat d0/d1f/d25/f69 0 2024-03-04T09:35:48.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/572: chown d1/fd 56 1 2024-03-04T09:35:48.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/617: sync 2024-03-04T09:35:48.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/775: truncate da/dd/d39/d60/f71 1235711 0 2024-03-04T09:35:48.441 INFO:tasks.workunit.client.0.smithi046.stdout:0/668: sync 2024-03-04T09:35:48.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/635: sync 2024-03-04T09:35:48.517 INFO:tasks.workunit.client.0.smithi046.stdout:0/669: dwrite d10/d12/d1f/d3b/fbd [0,4194304] 0 2024-03-04T09:35:48.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/618: truncate d0/d4/db/f3d 3173785 0 2024-03-04T09:35:48.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/631: sync 2024-03-04T09:35:48.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/776: symlink da/dd/d39/d60/da0/ddd/l11a 0 2024-03-04T09:35:48.936 INFO:tasks.workunit.client.0.smithi046.stdout:6/777: dread da/dd/d39/d60/da0/d67/d64/d82/fbb [0,4194304] 0 2024-03-04T09:35:48.936 INFO:tasks.workunit.client.0.smithi046.stdout:6/778: truncate da/dd/d39/d60/da0/ddd/f101 766925 0 2024-03-04T09:35:49.617 INFO:tasks.workunit.client.0.smithi046.stdout:0/670: symlink d10/d12/d52/le8 0 2024-03-04T09:35:49.618 INFO:tasks.workunit.client.0.smithi046.stdout:7/619: stat d0/da/d46/f5e 0 2024-03-04T09:35:49.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/671: dwrite d10/d12/d9f/fd4 [0,4194304] 0 2024-03-04T09:35:49.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/672: read - d10/d12/d52/d78/d8a/da2/fa9 zero size 2024-03-04T09:35:49.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/632: symlink d7/de/d28/d36/d7c/d89/ld3 0 2024-03-04T09:35:49.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/779: symlink da/d14/d17/dd3/df3/l11b 0 2024-03-04T09:35:50.114 INFO:tasks.workunit.client.0.smithi046.stdout:7/620: mkdir d0/da/d4e/dd2 0 2024-03-04T09:35:50.251 INFO:tasks.workunit.client.0.smithi046.stdout:9/733: dwrite d1/d11/d6/d8/d12/d1c/dd1/d4c/f71 [0,4194304] 0 2024-03-04T09:35:50.251 INFO:tasks.workunit.client.0.smithi046.stdout:9/734: chown d1/d11/d6/d8/d1d/d34/d7f 261011940 1 2024-03-04T09:35:50.379 INFO:tasks.workunit.client.0.smithi046.stdout:0/673: creat d10/d12/d52/d78/fe9 x:0 0 0 2024-03-04T09:35:50.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/633: symlink d7/de/d28/dab/d3c/da5/ld4 0 2024-03-04T09:35:50.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/634: read d7/d53/f65 [39388,37817] 0 2024-03-04T09:35:50.868 INFO:tasks.workunit.client.0.smithi046.stdout:8/635: dwrite d7/de/d12/fb7 [0,4194304] 0 2024-03-04T09:35:51.080 INFO:tasks.workunit.client.0.smithi046.stdout:6/780: link da/dd/d39/d60/da0/d67/f6d da/dd/d39/d60/da0/d67/d64/d82/d83/dd5/f11c 0 2024-03-04T09:35:51.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/621: truncate d0/da/d46/f5e 2038356 0 2024-03-04T09:35:51.273 INFO:tasks.workunit.client.0.smithi046.stdout:2/653: sync 2024-03-04T09:35:51.315 INFO:tasks.workunit.client.0.smithi046.stdout:7/622: dwrite d0/da/d41/f95 [0,4194304] 0 2024-03-04T09:35:51.602 INFO:tasks.workunit.client.0.smithi046.stdout:1/573: rmdir d1/d28/d6a 39 2024-03-04T09:35:51.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:35:51.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:35:51.661 INFO:tasks.workunit.client.0.smithi046.stdout:3/761: dwrite d1/d21/d35/d43/dd2/f52 [0,4194304] 0 2024-03-04T09:35:51.695 INFO:tasks.workunit.client.0.smithi046.stdout:0/674: mkdir d10/d12/d6e/d99/dea 0 2024-03-04T09:35:52.120 INFO:tasks.workunit.client.0.smithi046.stdout:8/636: creat d7/d53/d72/d93/fd5 x:0 0 0 2024-03-04T09:35:52.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/637: dread d7/de/f75 [0,4194304] 0 2024-03-04T09:35:52.388 INFO:tasks.workunit.client.0.smithi046.stdout:2/654: creat d5/db9/dd2/fd7 x:0 0 0 2024-03-04T09:35:52.654 INFO:tasks.workunit.client.0.smithi046.stdout:7/623: symlink d0/d59/db1/dc8/ld3 0 2024-03-04T09:35:53.261 INFO:tasks.workunit.client.0.smithi046.stdout:3/762: creat d1/d1d/d27/d40/d70/d105/de3/f111 x:0 0 0 2024-03-04T09:35:53.261 INFO:tasks.workunit.client.0.smithi046.stdout:0/675: link cb d10/d12/ceb 0 2024-03-04T09:35:53.276 INFO:tasks.workunit.client.0.smithi046.stdout:3/763: dread d1/d21/d35/d43/f10b [0,4194304] 0 2024-03-04T09:35:53.337 INFO:tasks.workunit.client.0.smithi046.stdout:8/638: rename d7/d53/f65 to d7/de/d4c/d5a/dc9/fd6 0 2024-03-04T09:35:53.337 INFO:tasks.workunit.client.0.smithi046.stdout:8/639: truncate d7/de/d3e/fb4 832478 0 2024-03-04T09:35:53.835 INFO:tasks.workunit.client.0.smithi046.stdout:7/624: mknod d0/d4/d6e/cd4 0 2024-03-04T09:35:53.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/676: creat d10/d12/d9f/dca/fec x:0 0 0 2024-03-04T09:35:53.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/677: read d10/f26 [6943043,46366] 0 2024-03-04T09:35:54.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/678: dread d10/d12/d1f/fb6 [0,4194304] 0 2024-03-04T09:35:54.042 INFO:tasks.workunit.client.0.smithi046.stdout:4/700: write d0/d3/d16/f66 [826043,108443] 0 2024-03-04T09:35:54.043 INFO:tasks.workunit.client.0.smithi046.stdout:4/701: creat d0/d5f/d6f/f107 x:0 0 0 2024-03-04T09:35:54.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/764: rmdir d1/d1d/d27/d40/d70 39 2024-03-04T09:35:54.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/765: creat d1/d1d/d27/def/f112 x:0 0 0 2024-03-04T09:35:54.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/766: stat d1/d1d/d27/d4a/d78/de0/c10e 0 2024-03-04T09:35:54.440 INFO:tasks.workunit.client.0.smithi046.stdout:5/636: write d1/d44/d81/d96/f49 [7091503,76072] 0 2024-03-04T09:35:55.338 INFO:tasks.workunit.client.0.smithi046.stdout:7/625: mknod d0/d2d/cd5 0 2024-03-04T09:35:55.472 INFO:tasks.workunit.client.0.smithi046.stdout:4/702: symlink d0/d3/d3b/d8d/l108 0 2024-03-04T09:35:55.472 INFO:tasks.workunit.client.0.smithi046.stdout:4/703: chown d0/d3/d16/f1a 5191905 1 2024-03-04T09:35:55.538 INFO:tasks.workunit.client.0.smithi046.stdout:4/704: dwrite d0/d1f/f102 [0,4194304] 0 2024-03-04T09:35:55.624 INFO:tasks.workunit.client.0.smithi046.stdout:3/767: link d1/d1d/d27/d4a/lf6 d1/d21/l113 0 2024-03-04T09:35:55.625 INFO:tasks.workunit.client.0.smithi046.stdout:3/768: write d1/d74/fce [943091,34089] 0 2024-03-04T09:35:56.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/679: getdents d10/d12/d9f/da6/dc3 0 2024-03-04T09:35:56.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/680: write d10/d36/d87/fd6 [233925,123557] 0 2024-03-04T09:35:56.264 INFO:tasks.workunit.client.0.smithi046.stdout:7/626: rmdir d0/d2d/d85 39 2024-03-04T09:35:56.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/735: write d1/d11/d6/d8/d13/d92/f96 [3250515,52175] 0 2024-03-04T09:35:56.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/781: dwrite da/d14/d1e/d27/d78/f3d [0,4194304] 0 2024-03-04T09:35:56.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/782: truncate da/dd/d22/f92 1576 0 2024-03-04T09:35:56.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/681: creat d10/d12/d1f/fed x:0 0 0 2024-03-04T09:35:56.988 INFO:tasks.workunit.client.0.smithi046.stdout:7/627: symlink d0/d8f/ld6 0 2024-03-04T09:35:57.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/628: dwrite d0/d4/f86 [0,4194304] 0 2024-03-04T09:35:57.115 INFO:tasks.workunit.client.0.smithi046.stdout:4/705: truncate d0/d1f/f2c 746348 0 2024-03-04T09:35:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/706: dwrite d0/d3/d16/d1e/f36 [0,4194304] 0 2024-03-04T09:35:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/707: dread - d0/d3/d20/d96/d6e/fe2 zero size 2024-03-04T09:35:58.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/640: rename d7/de/d4c/d5a to d7/d53/d72/d93/dd7 0 2024-03-04T09:35:58.577 INFO:tasks.workunit.client.0.smithi046.stdout:2/655: dwrite d5/da/f14 [4194304,4194304] 0 2024-03-04T09:35:58.664 INFO:tasks.workunit.client.0.smithi046.stdout:2/656: dwrite d5/f9d [0,4194304] 0 2024-03-04T09:35:59.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/708: unlink d0/d5f/da2/fb0 0 2024-03-04T09:35:59.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/783: rename da/dd/d39/d60/da0/d67/d64/d82/d83/dd5 to da/dd/d39/d60/dac/daf/d11d 0 2024-03-04T09:35:59.366 INFO:tasks.workunit.client.0.smithi046.stdout:8/641: truncate d7/f5f 3835188 0 2024-03-04T09:35:59.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/642: write d7/de/d12/f8b [821368,34462] 0 2024-03-04T09:35:59.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/643: dread - d7/de/d28/d3a/d7d/fb5 zero size 2024-03-04T09:35:59.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/657: symlink d5/d84/d88/d47/dcc/ld8 0 2024-03-04T09:35:59.586 INFO:tasks.workunit.client.0.smithi046.stdout:2/658: write d5/da/fbf [946232,10345] 0 2024-03-04T09:35:59.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/709: unlink d0/d1f/d25/f69 0 2024-03-04T09:35:59.673 INFO:tasks.workunit.client.0.smithi046.stdout:4/710: stat d0/d3/d20/d96/d6e/d85/da7/fd3 0 2024-03-04T09:35:59.700 INFO:tasks.workunit.client.0.smithi046.stdout:4/711: write d0/d1f/d35/f84 [317317,31622] 0 2024-03-04T09:35:59.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/784: mkdir da/dd/d39/d60/da0/d67/dcf/d11e 0 2024-03-04T09:36:00.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/644: creat d7/de/d28/d3a/d6f/dd0/fd8 x:0 0 0 2024-03-04T09:36:00.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/645: fsync d7/de/d12/f59 0 2024-03-04T09:36:00.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/646: chown d7/de/d28/d36/l96 3 1 2024-03-04T09:36:00.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/659: chown d5/d84/d88/d3f/c49 15032882 1 2024-03-04T09:36:00.397 INFO:tasks.workunit.client.0.smithi046.stdout:4/712: rename d0/d3/d3b/d8d/ffc to d0/d3/d3b/d9d/f109 0 2024-03-04T09:36:00.553 INFO:tasks.workunit.client.0.smithi046.stdout:8/647: dwrite d7/de/d3e/fb4 [0,4194304] 0 2024-03-04T09:36:00.553 INFO:tasks.workunit.client.0.smithi046.stdout:8/648: read - d7/de/d3e/da1/fb2 zero size 2024-03-04T09:36:00.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/660: getdents d5 0 2024-03-04T09:36:00.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/661: chown d5/d38/d54 498744 1 2024-03-04T09:36:00.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/662: readlink d5/d84/d7c/ld1 0 2024-03-04T09:36:01.068 INFO:tasks.workunit.client.0.smithi046.stdout:4/713: symlink d0/d3/d16/d1e/da1/dcc/l10a 0 2024-03-04T09:36:01.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/663: mknod d5/db9/cd9 0 2024-03-04T09:36:01.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/664: getdents d5/d84/d88/d99/daa/db8 0 2024-03-04T09:36:02.102 INFO:tasks.workunit.client.0.smithi046.stdout:4/714: mkdir d0/d3/d16/d1e/da1/d10b 0 2024-03-04T09:36:02.102 INFO:tasks.workunit.client.0.smithi046.stdout:4/715: fsync d0/d3/d16/d1e/f36 0 2024-03-04T09:36:02.129 INFO:tasks.workunit.client.0.smithi046.stdout:4/716: dread d0/d1f/d35/f84 [0,4194304] 0 2024-03-04T09:36:02.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/649: mkdir d7/de/d28/dab/d2c/dd9 0 2024-03-04T09:36:02.310 INFO:tasks.workunit.client.0.smithi046.stdout:5/637: dwrite d1/d44/f71 [0,4194304] 0 2024-03-04T09:36:02.322 INFO:tasks.workunit.client.0.smithi046.stdout:0/682: rmdir d10/d12/d52/d78 39 2024-03-04T09:36:02.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/683: write d10/d12/f4f [3241449,57337] 0 2024-03-04T09:36:02.433 INFO:tasks.workunit.client.0.smithi046.stdout:2/665: unlink d5/d84/d88/d3f/c49 0 2024-03-04T09:36:02.595 INFO:tasks.workunit.client.0.smithi046.stdout:8/650: unlink d7/de/d28/d71/l9e 0 2024-03-04T09:36:02.867 INFO:tasks.workunit.client.0.smithi046.stdout:3/769: write d1/d1d/f7a [530976,111731] 0 2024-03-04T09:36:02.936 INFO:tasks.workunit.client.0.smithi046.stdout:0/684: dread d10/d12/d52/d5d/f69 [0,4194304] 0 2024-03-04T09:36:03.113 INFO:tasks.workunit.client.0.smithi046.stdout:2/666: rename d5/d84/d88/d99/daa/db8 to d5/d38/d54/dda 0 2024-03-04T09:36:03.228 INFO:tasks.workunit.client.0.smithi046.stdout:8/651: symlink d7/d53/lda 0 2024-03-04T09:36:03.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/638: rmdir d1/d44/d57/d70/d86/d92 39 2024-03-04T09:36:03.387 INFO:tasks.workunit.client.0.smithi046.stdout:3/770: dread d1/f20 [0,4194304] 0 2024-03-04T09:36:03.388 INFO:tasks.workunit.client.0.smithi046.stdout:3/771: fdatasync d1/d1d/d27/d40/d70/d7d/f91 0 2024-03-04T09:36:03.388 INFO:tasks.workunit.client.0.smithi046.stdout:3/772: read - d1/d1d/d27/d40/d76/d8d/d95/f103 zero size 2024-03-04T09:36:03.472 INFO:tasks.workunit.client.0.smithi046.stdout:0/685: creat d10/d12/d52/d78/d8a/da2/fee x:0 0 0 2024-03-04T09:36:03.695 INFO:tasks.workunit.client.0.smithi046.stdout:2/667: creat d5/d38/d54/d8a/fdb x:0 0 0 2024-03-04T09:36:03.695 INFO:tasks.workunit.client.0.smithi046.stdout:2/668: dread - d5/d38/d54/d8a/fdb zero size 2024-03-04T09:36:03.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/669: dwrite d5/d38/f66 [4194304,4194304] 0 2024-03-04T09:36:03.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/670: fdatasync d5/da/f2b 0 2024-03-04T09:36:03.769 INFO:tasks.workunit.client.0.smithi046.stdout:2/671: fdatasync d5/d38/d54/f7a 0 2024-03-04T09:36:03.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/652: mkdir d7/de/d28/dab/d2c/d62/ddb 0 2024-03-04T09:36:03.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/653: dread - d7/de/d28/d3a/d6f/dd0/fd8 zero size 2024-03-04T09:36:04.095 INFO:tasks.workunit.client.0.smithi046.stdout:3/773: getdents d1/d1d/d27/d40/d76 0 2024-03-04T09:36:04.095 INFO:tasks.workunit.client.0.smithi046.stdout:3/774: chown d1/d21/d35/d43/fbd 968 1 2024-03-04T09:36:04.149 INFO:tasks.workunit.client.0.smithi046.stdout:0/686: mkdir d10/d12/d1f/d3b/def 0 2024-03-04T09:36:04.149 INFO:tasks.workunit.client.0.smithi046.stdout:0/687: creat d10/d36/d87/ff0 x:0 0 0 2024-03-04T09:36:04.595 INFO:tasks.workunit.client.0.smithi046.stdout:9/736: creat d1/d11/d6/d8/d12/fe9 x:0 0 0 2024-03-04T09:36:04.595 INFO:tasks.workunit.client.0.smithi046.stdout:2/672: link d5/db9/dd2/fd7 d5/d38/fdc 0 2024-03-04T09:36:04.675 INFO:tasks.workunit.client.0.smithi046.stdout:2/673: dread d5/d2c/f71 [0,4194304] 0 2024-03-04T09:36:04.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/654: getdents d7/de 0 2024-03-04T09:36:04.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/737: dwrite d1/d11/d6/d8/d6f/d8c/f9c [4194304,4194304] 0 2024-03-04T09:36:04.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/738: chown d1/d11/d6/d8/d12/d1c/f38 1 1 2024-03-04T09:36:04.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/739: truncate d1/d11/d6/d8/d1d/d34/d4d/fc4 318424 0 2024-03-04T09:36:04.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/674: dwrite d5/da/f65 [0,4194304] 0 2024-03-04T09:36:04.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/775: mkdir d1/d1d/d27/d4a/d78/de0/d107/d114 0 2024-03-04T09:36:05.032 INFO:tasks.workunit.client.0.smithi046.stdout:6/785: unlink da/dd/d39/fd2 0 2024-03-04T09:36:05.253 INFO:tasks.workunit.client.0.smithi046.stdout:0/688: unlink d10/d12/d9f/da6/dc3/fe4 0 2024-03-04T09:36:05.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/689: stat d10/d12/d9f/fd4 0 2024-03-04T09:36:05.340 INFO:tasks.workunit.client.0.smithi046.stdout:0/690: dwrite d10/f45 [4194304,4194304] 0 2024-03-04T09:36:05.607 INFO:tasks.workunit.client.0.smithi046.stdout:5/639: rmdir d1/d44/d57 39 2024-03-04T09:36:05.607 INFO:tasks.workunit.client.0.smithi046.stdout:8/655: readlink d7/de/d28/dab/d2c/l76 0 2024-03-04T09:36:05.607 INFO:tasks.workunit.client.0.smithi046.stdout:5/640: write d1/d44/d81/d96/f49 [6113640,32875] 0 2024-03-04T09:36:06.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/675: rename d5/d84/d88/f35 to d5/d84/d88/d99/daa/fdd 0 2024-03-04T09:36:06.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/676: getdents d5/d2c/d51/dca 0 2024-03-04T09:36:06.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/677: dread - d5/db9/dd2/fd7 zero size 2024-03-04T09:36:06.561 INFO:tasks.workunit.client.0.smithi046.stdout:5/641: creat d1/d44/d81/d96/d20/d76/d6c/fc0 x:0 0 0 2024-03-04T09:36:07.876 INFO:tasks.workunit.client.0.smithi046.stdout:6/786: rename da/dd/d39/d60/da0/d67/d64/d56/df1 to da/d14/d1e/d27/d78/d66/d11f 0 2024-03-04T09:36:08.347 INFO:tasks.workunit.client.0.smithi046.stdout:5/642: mknod d1/d44/d81/d96/d20/d76/d6c/db2/cc1 0 2024-03-04T09:36:08.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/717: write d0/f56 [133484,24861] 0 2024-03-04T09:36:08.787 INFO:tasks.workunit.client.0.smithi046.stdout:0/691: rename d10/d12/d52/d78/d8a/fe1 to d10/d12/d9f/ff1 0 2024-03-04T09:36:08.787 INFO:tasks.workunit.client.0.smithi046.stdout:0/692: write d10/d12/f3d [4996708,121308] 0 2024-03-04T09:36:08.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/643: mknod d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/cc2 0 2024-03-04T09:36:08.897 INFO:tasks.workunit.client.0.smithi046.stdout:5/644: dread d1/d44/d81/d8e/d72/fa2 [0,4194304] 0 2024-03-04T09:36:09.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/718: creat d0/d1f/f10c x:0 0 0 2024-03-04T09:36:09.168 INFO:tasks.workunit.client.0.smithi046.stdout:4/719: dread d0/d3/d16/f1a [4194304,4194304] 0 2024-03-04T09:36:09.581 INFO:tasks.workunit.client.0.smithi046.stdout:5/645: symlink d1/d44/d57/d70/d86/d92/dbb/lc3 0 2024-03-04T09:36:09.582 INFO:tasks.workunit.client.0.smithi046.stdout:5/646: fdatasync d1/d44/d81/d96/d20/d76/f65 0 2024-03-04T09:36:10.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/678: rename d5/d38/d54/d8a to d5/d40/dde 0 2024-03-04T09:36:10.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/720: rename d0/d3/d16/d76/cef to d0/d3/d20/d96/d6e/d85/da7/c10d 0 2024-03-04T09:36:10.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/721: symlink d0/d3/d16/d1e/l10e 0 2024-03-04T09:36:10.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/722: fdatasync d0/d3/d16/d1e/d73/f89 0 2024-03-04T09:36:10.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/723: creat d0/d1f/d25/d50/df5/f10f x:0 0 0 2024-03-04T09:36:10.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/724: truncate d0/d5f/d6f/f107 406651 0 2024-03-04T09:36:10.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/725: chown d0/d3/d16/d1e/da1/dcc 7426917 1 2024-03-04T09:36:11.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/740: write d1/d11/d6/d8/d6f/f82 [626685,60007] 0 2024-03-04T09:36:12.118 INFO:tasks.workunit.client.0.smithi046.stdout:1/574: rmdir d1/d28 39 2024-03-04T09:36:12.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/629: sync 2024-03-04T09:36:12.120 INFO:tasks.workunit.client.0.smithi046.stdout:7/630: chown d0/d4/d6e/cb9 896 1 2024-03-04T09:36:12.146 INFO:tasks.workunit.client.0.smithi046.stdout:6/787: symlink da/dd/d39/d60/l120 0 2024-03-04T09:36:12.146 INFO:tasks.workunit.client.0.smithi046.stdout:3/776: mknod d1/d1d/d27/c115 0 2024-03-04T09:36:12.146 INFO:tasks.workunit.client.0.smithi046.stdout:3/777: write d1/d1d/d27/d4a/f65 [4291555,60251] 0 2024-03-04T09:36:12.168 INFO:tasks.workunit.client.0.smithi046.stdout:3/778: read d1/d1d/d27/d4a/f65 [2672539,108007] 0 2024-03-04T09:36:12.168 INFO:tasks.workunit.client.0.smithi046.stdout:3/779: write d1/d1d/d27/d40/d76/d8d/d95/ffb [790745,55390] 0 2024-03-04T09:36:12.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/780: readlink d1/d21/l113 0 2024-03-04T09:36:12.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/788: dread da/d14/d1e/d27/d4a/db2/fc7 [0,4194304] 0 2024-03-04T09:36:12.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/647: dwrite d1/d44/d81/d96/d20/d76/f48 [4194304,4194304] 0 2024-03-04T09:36:12.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/648: dread d1/d44/d81/d96/d20/d76/d6c/d7b/f8d [0,4194304] 0 2024-03-04T09:36:12.868 INFO:tasks.workunit.client.0.smithi046.stdout:1/575: write d1/d28/d6a/fa5 [156928,61477] 0 2024-03-04T09:36:12.908 INFO:tasks.workunit.client.0.smithi046.stdout:7/631: dread d0/d4/db/d12/f30 [4194304,4194304] 0 2024-03-04T09:36:12.908 INFO:tasks.workunit.client.0.smithi046.stdout:7/632: chown d0/d4/db/d3b/f9e 1 1 2024-03-04T09:36:12.997 INFO:tasks.workunit.client.0.smithi046.stdout:3/781: dread d1/d1d/d27/d4a/f7b [4194304,4194304] 0 2024-03-04T09:36:12.997 INFO:tasks.workunit.client.0.smithi046.stdout:3/782: truncate d1/d21/fd0 881782 0 2024-03-04T09:36:13.023 INFO:tasks.workunit.client.0.smithi046.stdout:3/783: write d1/d88/f9f [947808,104612] 0 2024-03-04T09:36:13.041 INFO:tasks.workunit.client.0.smithi046.stdout:3/784: dread d1/d21/d35/d43/fbd [0,4194304] 0 2024-03-04T09:36:13.041 INFO:tasks.workunit.client.0.smithi046.stdout:3/785: fdatasync d1/d21/d35/d43/dd2/d51/da3/fcc 0 2024-03-04T09:36:13.041 INFO:tasks.workunit.client.0.smithi046.stdout:3/786: fsync d1/d1d/d27/f2e 0 2024-03-04T09:36:13.041 INFO:tasks.workunit.client.0.smithi046.stdout:3/787: readlink d1/d21/d26/l8a 0 2024-03-04T09:36:13.107 INFO:tasks.workunit.client.0.smithi046.stdout:6/789: mkdir da/dd/d39/d60/da0/d67/dcf/d11e/d121 0 2024-03-04T09:36:13.107 INFO:tasks.workunit.client.0.smithi046.stdout:6/790: chown da/dd/d39/d60/dac/daf/d11d 49286946 1 2024-03-04T09:36:13.107 INFO:tasks.workunit.client.0.smithi046.stdout:6/791: chown da/dd/d22/da7/lee 1909848 1 2024-03-04T09:36:13.197 INFO:tasks.workunit.client.0.smithi046.stdout:5/649: mkdir d1/d44/d81/d96/d20/d5e/dc4 0 2024-03-04T09:36:13.197 INFO:tasks.workunit.client.0.smithi046.stdout:5/650: chown d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/c17 1012 1 2024-03-04T09:36:13.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/788: unlink d1/d1d/f37 0 2024-03-04T09:36:13.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/789: write d1/d1d/d27/d40/d76/d8d/d95/fc9 [596507,62006] 0 2024-03-04T09:36:14.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/651: rmdir d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e 39 2024-03-04T09:36:14.450 INFO:tasks.workunit.client.0.smithi046.stdout:1/576: truncate d1/f68 602170 0 2024-03-04T09:36:14.450 INFO:tasks.workunit.client.0.smithi046.stdout:7/633: mknod d0/d4/db/d12/d28/cd7 0 2024-03-04T09:36:14.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/790: rename d1/d74/fb6 to d1/d1d/d27/d40/d76/f116 0 2024-03-04T09:36:14.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/791: creat d1/d88/f117 x:0 0 0 2024-03-04T09:36:14.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/577: dwrite d1/d28/d6f/f80 [0,4194304] 0 2024-03-04T09:36:14.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/741: dwrite d1/d11/d6/d8/d12/d1c/dd1/f5f [0,4194304] 0 2024-03-04T09:36:14.544 INFO:tasks.workunit.client.0.smithi046.stdout:5/652: dwrite d1/d44/d81/d96/d20/d76/fb6 [0,4194304] 0 2024-03-04T09:36:14.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/653: dread d1/d44/d81/d96/d20/d76/d6c/d7b/f8d [0,4194304] 0 2024-03-04T09:36:14.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/578: dwrite d1/d28/f40 [0,4194304] 0 2024-03-04T09:36:14.866 INFO:tasks.workunit.client.0.smithi046.stdout:0/693: sync 2024-03-04T09:36:14.866 INFO:tasks.workunit.client.0.smithi046.stdout:4/726: sync 2024-03-04T09:36:14.866 INFO:tasks.workunit.client.0.smithi046.stdout:8/656: sync 2024-03-04T09:36:14.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/679: sync 2024-03-04T09:36:14.866 INFO:tasks.workunit.client.0.smithi046.stdout:0/694: write d10/d12/f1c [3045429,41403] 0 2024-03-04T09:36:14.866 INFO:tasks.workunit.client.0.smithi046.stdout:4/727: creat d0/d1f/d25/d7b/f110 x:0 0 0 2024-03-04T09:36:14.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/695: dread d10/f45 [4194304,4194304] 0 2024-03-04T09:36:14.938 INFO:tasks.workunit.client.0.smithi046.stdout:4/728: dwrite d0/d3/d16/d1e/da1/dc1/fcf [0,4194304] 0 2024-03-04T09:36:14.938 INFO:tasks.workunit.client.0.smithi046.stdout:4/729: dread - d0/d8e/f91 zero size 2024-03-04T09:36:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:4/730: dread d0/d1f/d5b/f78 [0,4194304] 0 2024-03-04T09:36:15.035 INFO:tasks.workunit.client.0.smithi046.stdout:4/731: dwrite d0/d1f/d35/fee [0,4194304] 0 2024-03-04T09:36:15.035 INFO:tasks.workunit.client.0.smithi046.stdout:4/732: chown d0/c58 1666 1 2024-03-04T09:36:15.035 INFO:tasks.workunit.client.0.smithi046.stdout:4/733: fdatasync d0/d1f/d25/d50/fae 0 2024-03-04T09:36:15.079 INFO:tasks.workunit.client.0.smithi046.stdout:7/634: creat d0/fd8 x:0 0 0 2024-03-04T09:36:15.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/792: unlink da/dd/lf 0 2024-03-04T09:36:15.368 INFO:tasks.workunit.client.0.smithi046.stdout:3/792: mknod d1/d1d/d27/d40/d70/c118 0 2024-03-04T09:36:15.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/793: dwrite d1/d88/fd4 [0,4194304] 0 2024-03-04T09:36:15.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/794: dwrite d1/d1d/f7a [0,4194304] 0 2024-03-04T09:36:15.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/795: dread d1/d21/d35/d43/dd2/d51/f9d [0,4194304] 0 2024-03-04T09:36:15.707 INFO:tasks.workunit.client.0.smithi046.stdout:9/742: link d1/d11/d3e/c53 d1/d11/d6/d8/d13/d21/cea 0 2024-03-04T09:36:15.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/743: creat d1/d11/d6/d8/d12/d1c/dd1/d4c/da3/feb x:0 0 0 2024-03-04T09:36:15.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/744: write d1/d11/d6/d8/d13/d92/f96 [1876057,70688] 0 2024-03-04T09:36:15.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/745: write d1/d11/d6/d8/f33 [441307,85832] 0 2024-03-04T09:36:16.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/654: getdents d1/d44/d81/d8e/d63 0 2024-03-04T09:36:17.095 INFO:tasks.workunit.client.0.smithi046.stdout:8/657: mkdir d7/d53/d72/d93/dd7/dc9/ddc 0 2024-03-04T09:36:17.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/734: mkdir d0/d1f/d35/d111 0 2024-03-04T09:36:17.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/735: stat d0/d1f/d25/fc6 0 2024-03-04T09:36:17.710 INFO:tasks.workunit.client.0.smithi046.stdout:7/635: creat d0/da/d4e/dd2/fd9 x:0 0 0 2024-03-04T09:36:17.710 INFO:tasks.workunit.client.0.smithi046.stdout:4/736: creat d0/d1f/d25/d50/ddb/f112 x:0 0 0 2024-03-04T09:36:17.710 INFO:tasks.workunit.client.0.smithi046.stdout:4/737: readlink d0/d3/d3b/d8d/l90 0 2024-03-04T09:36:17.858 INFO:tasks.workunit.client.0.smithi046.stdout:6/793: rename da/d14/l52 to da/dd/d39/d60/l122 0 2024-03-04T09:36:18.561 INFO:tasks.workunit.client.0.smithi046.stdout:3/796: creat d1/d1d/d27/f119 x:0 0 0 2024-03-04T09:36:19.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/655: unlink d1/d44/d81/d96/d4f/l6d 0 2024-03-04T09:36:19.410 INFO:tasks.workunit.client.0.smithi046.stdout:1/579: mkdir d1/d92/d96/dbb 0 2024-03-04T09:36:19.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/656: dwrite d1/d44/d57/d70/d86/d92/fa7 [0,4194304] 0 2024-03-04T09:36:20.064 INFO:tasks.workunit.client.0.smithi046.stdout:0/696: write d10/d12/f1b [96870,38074] 0 2024-03-04T09:36:20.424 INFO:tasks.workunit.client.0.smithi046.stdout:7/636: rmdir d0/d4/db/dc6 0 2024-03-04T09:36:20.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/738: dread d0/d1f/fcd [0,4194304] 0 2024-03-04T09:36:20.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/794: rename da/dd/d39/d60/da0/d67/dcf/d11e/d121 to da/d14/d1e/d8f/ddf/d103/d123 0 2024-03-04T09:36:20.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/795: dread f5 [4194304,4194304] 0 2024-03-04T09:36:20.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/796: chown da/dd/d39/d60/da9/lfd 515114412 1 2024-03-04T09:36:21.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/680: rmdir d5/d40 39 2024-03-04T09:36:21.780 INFO:tasks.workunit.client.0.smithi046.stdout:1/580: dread d1/d28/f4e [0,4194304] 0 2024-03-04T09:36:21.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:36:21.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:36:21.806 INFO:tasks.workunit.client.0.smithi046.stdout:1/581: write d1/d28/f7a [2597075,62348] 0 2024-03-04T09:36:21.841 INFO:tasks.workunit.client.0.smithi046.stdout:5/657: dread d1/f7 [4194304,4194304] 0 2024-03-04T09:36:21.860 INFO:tasks.workunit.client.0.smithi046.stdout:5/658: write d1/d44/d81/d8e/fac [1403211,113897] 0 2024-03-04T09:36:21.931 INFO:tasks.workunit.client.0.smithi046.stdout:4/739: creat d0/d1f/d25/da9/f113 x:0 0 0 2024-03-04T09:36:22.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/697: rename d10/d12/d6e/d99/la1 to d10/d12/d9f/da6/dc3/lf2 0 2024-03-04T09:36:22.145 INFO:tasks.workunit.client.0.smithi046.stdout:0/698: chown d10/d12/d6e/d99/ld9 60658718 1 2024-03-04T09:36:22.190 INFO:tasks.workunit.client.0.smithi046.stdout:6/797: mkdir da/d14/d1e/d27/d4a/db2/d124 0 2024-03-04T09:36:22.276 INFO:tasks.workunit.client.0.smithi046.stdout:2/681: getdents d5/d2c/d51/d61 0 2024-03-04T09:36:22.276 INFO:tasks.workunit.client.0.smithi046.stdout:2/682: read - d5/d38/fa7 zero size 2024-03-04T09:36:22.693 INFO:tasks.workunit.client.0.smithi046.stdout:1/582: read d1/f23 [970486,86711] 0 2024-03-04T09:36:23.121 INFO:tasks.workunit.client.0.smithi046.stdout:6/798: link da/d14/d1e/d27/d4b/l9f da/d14/d1e/d27/d4a/db2/d124/l125 0 2024-03-04T09:36:23.122 INFO:tasks.workunit.client.0.smithi046.stdout:6/799: fdatasync da/d14/d17/dd3/f117 0 2024-03-04T09:36:23.122 INFO:tasks.workunit.client.0.smithi046.stdout:6/800: dread - da/dd/d39/d60/da0/fa5 zero size 2024-03-04T09:36:23.145 INFO:tasks.workunit.client.0.smithi046.stdout:9/746: dwrite d1/d11/d6/d8/d1d/d34/d35/f90 [4194304,4194304] 0 2024-03-04T09:36:23.158 INFO:tasks.workunit.client.0.smithi046.stdout:2/683: creat d5/d84/d88/d99/fdf x:0 0 0 2024-03-04T09:36:23.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/801: dwrite da/d14/d1e/d27/d4a/db2/f107 [0,4194304] 0 2024-03-04T09:36:23.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/684: dwrite d5/d38/f66 [0,4194304] 0 2024-03-04T09:36:23.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/685: chown d5 101304 1 2024-03-04T09:36:23.257 INFO:tasks.workunit.client.0.smithi046.stdout:2/686: read d5/d38/f90 [176574,46256] 0 2024-03-04T09:36:23.257 INFO:tasks.workunit.client.0.smithi046.stdout:2/687: readlink d5/d84/d88/d99/lb6 0 2024-03-04T09:36:23.269 INFO:tasks.workunit.client.0.smithi046.stdout:1/583: creat d1/d28/d6f/db1/fbc x:0 0 0 2024-03-04T09:36:23.269 INFO:tasks.workunit.client.0.smithi046.stdout:1/584: chown d1/d28/d6a/l86 14848 1 2024-03-04T09:36:23.854 INFO:tasks.workunit.client.0.smithi046.stdout:9/747: symlink d1/d11/d6/d8/d12/lec 0 2024-03-04T09:36:23.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/748: dread d1/d11/d6/d8/d13/d92/f96 [0,4194304] 0 2024-03-04T09:36:23.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/749: fsync d1/d11/d6/d8/f62 0 2024-03-04T09:36:23.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/750: stat d1/d11/d6/d8/d12/d1c/dd1/f5f 0 2024-03-04T09:36:24.180 INFO:tasks.workunit.client.0.smithi046.stdout:8/658: write d7/f5f [2167602,42954] 0 2024-03-04T09:36:24.720 INFO:tasks.workunit.client.0.smithi046.stdout:9/751: mkdir d1/d11/d6/d8/d1d/d34/d7f/ded 0 2024-03-04T09:36:24.729 INFO:tasks.workunit.client.0.smithi046.stdout:1/585: dread d1/f25 [0,4194304] 0 2024-03-04T09:36:25.008 INFO:tasks.workunit.client.0.smithi046.stdout:2/688: unlink d5/da/d1b/l2a 0 2024-03-04T09:36:25.295 INFO:tasks.workunit.client.0.smithi046.stdout:9/752: rmdir d1/d11/d6/d8/d12/d1c/dd1/d5e/dde 39 2024-03-04T09:36:25.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/586: rmdir d1/d92/d9a/daf 0 2024-03-04T09:36:25.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/659: write d7/de/d4c/d50/f85 [1069820,110287] 0 2024-03-04T09:36:25.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/660: stat d7/de/d3e/da1/fb2 0 2024-03-04T09:36:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:8/661: dread d7/de/d28/f37 [0,4194304] 0 2024-03-04T09:36:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:8/662: read d7/de/d28/dab/d2c/f31 [3886953,98545] 0 2024-03-04T09:36:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:8/663: dread d7/de/d3e/fc2 [0,4194304] 0 2024-03-04T09:36:25.636 INFO:tasks.workunit.client.0.smithi046.stdout:3/797: sync 2024-03-04T09:36:25.661 INFO:tasks.workunit.client.0.smithi046.stdout:3/798: dread d1/d1d/fa7 [0,4194304] 0 2024-03-04T09:36:25.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/637: sync 2024-03-04T09:36:25.706 INFO:tasks.workunit.client.0.smithi046.stdout:0/699: rmdir d10/d12/d9f 39 2024-03-04T09:36:25.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/799: dwrite d1/d21/d35/f13 [0,4194304] 0 2024-03-04T09:36:25.732 INFO:tasks.workunit.client.0.smithi046.stdout:7/638: dread d0/d59/fba [0,4194304] 0 2024-03-04T09:36:25.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/753: creat d1/d11/d6/d8/d12/d1c/dd1/d5e/fee x:0 0 0 2024-03-04T09:36:25.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/754: read d1/d11/d6/d8/d12/d1c/dd1/d5e/f8d [1288678,39834] 0 2024-03-04T09:36:26.018 INFO:tasks.workunit.client.0.smithi046.stdout:8/664: dread d7/de/d12/fad [0,4194304] 0 2024-03-04T09:36:26.018 INFO:tasks.workunit.client.0.smithi046.stdout:8/665: read - d7/fc3 zero size 2024-03-04T09:36:26.055 INFO:tasks.workunit.client.0.smithi046.stdout:8/666: write d7/de/d28/d71/faa [7236753,17266] 0 2024-03-04T09:36:26.106 INFO:tasks.workunit.client.0.smithi046.stdout:3/800: link d1/d21/d35/f13 d1/d21/d35/f11a 0 2024-03-04T09:36:26.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/639: mknod d0/d4/db/d38/d7e/cda 0 2024-03-04T09:36:26.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/689: mknod d5/ce0 0 2024-03-04T09:36:26.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/690: getdents d5/d2c/d51/dca 0 2024-03-04T09:36:26.693 INFO:tasks.workunit.client.0.smithi046.stdout:2/691: dwrite d5/d2c/f9c [4194304,4194304] 0 2024-03-04T09:36:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:2/692: dread d5/fd [0,4194304] 0 2024-03-04T09:36:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:2/693: chown d5/d2c/f33 11238419 1 2024-03-04T09:36:26.965 INFO:tasks.workunit.client.0.smithi046.stdout:1/587: rmdir d1/d28/d6f/db1 39 2024-03-04T09:36:26.986 INFO:tasks.workunit.client.0.smithi046.stdout:1/588: read d1/f25 [3143054,53929] 0 2024-03-04T09:36:27.186 INFO:tasks.workunit.client.0.smithi046.stdout:9/755: stat d1/d11/d6/d8/d13/d92/le2 0 2024-03-04T09:36:27.826 INFO:tasks.workunit.client.0.smithi046.stdout:2/694: dread d5/d38/d54/fa4 [0,4194304] 0 2024-03-04T09:36:27.826 INFO:tasks.workunit.client.0.smithi046.stdout:2/695: creat d5/d2c/d91/fe1 x:0 0 0 2024-03-04T09:36:27.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/696: chown d5/da/fbf 2068750 1 2024-03-04T09:36:27.934 INFO:tasks.workunit.client.0.smithi046.stdout:6/802: dwrite da/d14/d1e/d27/d78/d66/faa [0,4194304] 0 2024-03-04T09:36:28.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/589: symlink d1/d92/lbd 0 2024-03-04T09:36:28.356 INFO:tasks.workunit.client.0.smithi046.stdout:1/590: fdatasync d1/d28/d6a/fb3 0 2024-03-04T09:36:28.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/667: link d7/de/d28/dab/d2c/f31 d7/de/d28/d36/fdd 0 2024-03-04T09:36:28.444 INFO:tasks.workunit.client.0.smithi046.stdout:1/591: dwrite d1/d28/d6a/f90 [0,4194304] 0 2024-03-04T09:36:28.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/803: mknod da/dd/d39/d60/da0/d67/d64/d82/d83/c126 0 2024-03-04T09:36:28.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/804: read da/dd/d39/fb7 [1829448,81180] 0 2024-03-04T09:36:28.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/756: truncate d1/d11/d6/d8/d12/d1c/f6e 4318827 0 2024-03-04T09:36:28.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/757: dread - d1/d11/d6/d8/d12/d1c/dd1/d5e/fee zero size 2024-03-04T09:36:29.815 INFO:tasks.workunit.client.0.smithi046.stdout:5/659: rename d1/d44/d81/d96/d20/d76/d6c/db2/c67 to d1/d44/d81/d96/d20/cc5 0 2024-03-04T09:36:29.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/592: write d1/d28/f5b [364934,31077] 0 2024-03-04T09:36:29.846 INFO:tasks.workunit.client.0.smithi046.stdout:5/660: write d1/d44/d57/d70/d86/d92/fa7 [3745771,125889] 0 2024-03-04T09:36:29.846 INFO:tasks.workunit.client.0.smithi046.stdout:5/661: write d1/d44/d81/d96/d20/d76/d6c/d7b/f4d [1487600,57906] 0 2024-03-04T09:36:29.867 INFO:tasks.workunit.client.0.smithi046.stdout:3/801: rmdir d1/d1d/d27/d40/d76/d8d/d95 39 2024-03-04T09:36:30.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/758: dread d1/d11/fac [0,4194304] 0 2024-03-04T09:36:30.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/759: write d1/d11/d6/d8/d12/d1c/dd1/fce [4980714,120188] 0 2024-03-04T09:36:30.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/760: stat d1/d11/d6/d8/d12/d1c/dd1/d5e/c78 0 2024-03-04T09:36:30.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/761: chown d1/d11/d6/d8/d13/f24 30 1 2024-03-04T09:36:30.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/740: rename d0/d1f/d25/d50/df5/d101 to d0/d1f/db9/ddd/d114 0 2024-03-04T09:36:30.318 INFO:tasks.workunit.client.0.smithi046.stdout:1/593: rmdir d1/d28/d6f/db1 39 2024-03-04T09:36:30.836 INFO:tasks.workunit.client.0.smithi046.stdout:5/662: link d1/d44/d81/d96/d20/d76/d6c/db2/cc1 d1/d44/d57/d70/cc6 0 2024-03-04T09:36:30.836 INFO:tasks.workunit.client.0.smithi046.stdout:8/668: link d7/de/d28/d36/l96 d7/de/d28/dab/d3c/lde 0 2024-03-04T09:36:31.715 INFO:tasks.workunit.client.0.smithi046.stdout:9/762: rmdir d1/d11/d6/d8/d1d/d34/d4d 39 2024-03-04T09:36:32.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/663: mkdir d1/d44/d57/dc7 0 2024-03-04T09:36:32.391 INFO:tasks.workunit.client.0.smithi046.stdout:9/763: link d1/d11/d6/d8/d12/d1c/dd1/f8a d1/d11/d6/d8/fef 0 2024-03-04T09:36:32.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/700: rename d10/d12/d52/d78/lc4 to d10/d12/d1f/d3b/d6b/lf3 0 2024-03-04T09:36:32.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/701: dwrite d10/d12/d52/d78/d8a/da2/fa9 [0,4194304] 0 2024-03-04T09:36:32.755 INFO:tasks.workunit.client.0.smithi046.stdout:5/664: symlink d1/d44/d81/d96/d20/d76/d6c/lc8 0 2024-03-04T09:36:32.755 INFO:tasks.workunit.client.0.smithi046.stdout:5/665: stat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/cae 0 2024-03-04T09:36:33.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/702: creat d10/d12/d1f/d3f/d4b/ff4 x:0 0 0 2024-03-04T09:36:33.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/703: chown d10/d12/d52/d78/d8a/da2/dc8/fdf 2 1 2024-03-04T09:36:33.746 INFO:tasks.workunit.client.0.smithi046.stdout:9/764: symlink d1/d11/d6/d8/d12/d1c/lf0 0 2024-03-04T09:36:33.746 INFO:tasks.workunit.client.0.smithi046.stdout:5/666: write d1/d44/d57/f35 [174262,82610] 0 2024-03-04T09:36:33.840 INFO:tasks.workunit.client.0.smithi046.stdout:7/640: rename d0/l52 to d0/d4/db/d12/ldb 0 2024-03-04T09:36:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/704: symlink d10/d12/d9a/lf5 0 2024-03-04T09:36:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/705: fsync d10/d12/d52/d78/d8a/da2/dc8/fdf 0 2024-03-04T09:36:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/706: creat d10/d12/d9a/ff6 x:0 0 0 2024-03-04T09:36:34.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/707: dread d10/d12/d52/f8c [0,4194304] 0 2024-03-04T09:36:34.130 INFO:tasks.workunit.client.0.smithi046.stdout:9/765: chown d1/d11/d6/d8/d13/l6c 45124373 1 2024-03-04T09:36:34.358 INFO:tasks.workunit.client.0.smithi046.stdout:5/667: readlink d1/d44/d57/d70/da6/la9 0 2024-03-04T09:36:34.707 INFO:tasks.workunit.client.0.smithi046.stdout:7/641: mknod d0/da/d41/cdc 0 2024-03-04T09:36:34.708 INFO:tasks.workunit.client.0.smithi046.stdout:7/642: readlink d0/d59/db1/dc8/ld3 0 2024-03-04T09:36:34.746 INFO:tasks.workunit.client.0.smithi046.stdout:7/643: read d0/d4/db/f25 [577617,93929] 0 2024-03-04T09:36:34.775 INFO:tasks.workunit.client.0.smithi046.stdout:7/644: read d0/d4/d40/f49 [2099010,19309] 0 2024-03-04T09:36:34.775 INFO:tasks.workunit.client.0.smithi046.stdout:7/645: fsync d0/da/fac 0 2024-03-04T09:36:34.998 INFO:tasks.workunit.client.0.smithi046.stdout:9/766: truncate d1/d11/d6/d8/d12/d1c/dd1/d5e/f8d 310582 0 2024-03-04T09:36:35.691 INFO:tasks.workunit.client.0.smithi046.stdout:2/697: rename d5/da/d1b/f36 to d5/d40/d5a/fe2 0 2024-03-04T09:36:35.691 INFO:tasks.workunit.client.0.smithi046.stdout:2/698: readlink d5/d40/d5a/l7d 0 2024-03-04T09:36:35.706 INFO:tasks.workunit.client.0.smithi046.stdout:5/668: dread d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/f23 [8388608,4194304] 0 2024-03-04T09:36:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:3/802: sync 2024-03-04T09:36:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:4/741: sync 2024-03-04T09:36:35.766 INFO:tasks.workunit.client.0.smithi046.stdout:3/803: dread d1/d1d/d27/d4a/f7b [8388608,4194304] 0 2024-03-04T09:36:35.766 INFO:tasks.workunit.client.0.smithi046.stdout:3/804: truncate d1/d1d/d27/d4a/d78/fa2 988464 0 2024-03-04T09:36:35.766 INFO:tasks.workunit.client.0.smithi046.stdout:3/805: fsync d1/db0/fc4 0 2024-03-04T09:36:35.925 INFO:tasks.workunit.client.0.smithi046.stdout:1/594: dwrite d1/f8f [0,4194304] 0 2024-03-04T09:36:35.978 INFO:tasks.workunit.client.0.smithi046.stdout:8/669: dwrite f2 [0,4194304] 0 2024-03-04T09:36:36.162 INFO:tasks.workunit.client.0.smithi046.stdout:6/805: rename da/dd/d46/ffe to da/dd/d39/d60/da0/d67/dcf/f127 0 2024-03-04T09:36:36.162 INFO:tasks.workunit.client.0.smithi046.stdout:2/699: unlink d5/d2c/d51/d61/c89 0 2024-03-04T09:36:36.189 INFO:tasks.workunit.client.0.smithi046.stdout:6/806: dread da/d14/f19 [4194304,4194304] 0 2024-03-04T09:36:36.291 INFO:tasks.workunit.client.0.smithi046.stdout:7/646: rmdir d0/d4/db/d38/d7e 39 2024-03-04T09:36:36.315 INFO:tasks.workunit.client.0.smithi046.stdout:7/647: dread d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:36:37.330 INFO:tasks.workunit.client.0.smithi046.stdout:8/670: creat d7/de/d28/dab/dc1/fdf x:0 0 0 2024-03-04T09:36:37.731 INFO:tasks.workunit.client.0.smithi046.stdout:5/669: rename d1/d44/d81/d96/d4f/f77 to d1/d44/d81/d96/d20/d76/d6c/db2/fc9 0 2024-03-04T09:36:37.731 INFO:tasks.workunit.client.0.smithi046.stdout:5/670: readlink d1/d44/d81/d96/d20/d76/d6c/d7b/l85 0 2024-03-04T09:36:37.882 INFO:tasks.workunit.client.0.smithi046.stdout:6/807: mknod da/d14/d1e/d27/d4b/c128 0 2024-03-04T09:36:37.882 INFO:tasks.workunit.client.0.smithi046.stdout:7/648: link d0/d4/d6e/f84 d0/d59/fdd 0 2024-03-04T09:36:37.901 INFO:tasks.workunit.client.0.smithi046.stdout:6/808: dread da/d14/d17/f1b [0,4194304] 0 2024-03-04T09:36:37.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/809: write da/dd/f13 [6443502,4491] 0 2024-03-04T09:36:38.758 INFO:tasks.workunit.client.0.smithi046.stdout:4/742: rename d0/d3/d20/d96/d6e/d85/cbf to d0/d3/d16/d1e/da1/d10b/c115 0 2024-03-04T09:36:38.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/708: sync 2024-03-04T09:36:38.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/709: write fe [4509763,49724] 0 2024-03-04T09:36:38.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/710: dwrite d10/d12/f1c [0,4194304] 0 2024-03-04T09:36:38.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/711: dread - d10/d12/d9f/da6/fbb zero size 2024-03-04T09:36:38.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/712: truncate d10/d12/f1c 4874315 0 2024-03-04T09:36:39.209 INFO:tasks.workunit.client.0.smithi046.stdout:7/649: stat d0/d4/db/d3b/l76 0 2024-03-04T09:36:39.209 INFO:tasks.workunit.client.0.smithi046.stdout:6/810: truncate da/dd/d39/d60/da0/d67/d64/d56/fb4 7035780 0 2024-03-04T09:36:39.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/671: rmdir d7/de/d28/d36/d7c/d89 39 2024-03-04T09:36:39.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/672: dread - d7/de/d28/dab/d2c/fae zero size 2024-03-04T09:36:39.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/767: rename d1/d11/d6/d8/d12/cd9 to d1/d11/d6/d8/d6f/d8c/d9a/ddc/cf1 0 2024-03-04T09:36:40.094 INFO:tasks.workunit.client.0.smithi046.stdout:4/743: symlink d0/d1f/d35/l116 0 2024-03-04T09:36:40.498 INFO:tasks.workunit.client.0.smithi046.stdout:0/713: mkdir d10/d12/d52/d78/df7 0 2024-03-04T09:36:40.515 INFO:tasks.workunit.client.0.smithi046.stdout:7/650: dread d0/d59/fdd [0,4194304] 0 2024-03-04T09:36:40.515 INFO:tasks.workunit.client.0.smithi046.stdout:7/651: stat d0/da/d41/ca4 0 2024-03-04T09:36:40.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/811: creat da/d14/d1e/d27/d78/d66/d11f/f129 x:0 0 0 2024-03-04T09:36:40.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/812: creat da/d4e/d98/f12a x:0 0 0 2024-03-04T09:36:41.004 INFO:tasks.workunit.client.0.smithi046.stdout:1/595: write d1/f21 [1580627,85773] 0 2024-03-04T09:36:41.005 INFO:tasks.workunit.client.0.smithi046.stdout:1/596: write d1/d92/f9b [574450,122111] 0 2024-03-04T09:36:41.033 INFO:tasks.workunit.client.0.smithi046.stdout:0/714: symlink d10/d12/d52/d78/lf8 0 2024-03-04T09:36:41.064 INFO:tasks.workunit.client.0.smithi046.stdout:9/768: dwrite d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:36:41.065 INFO:tasks.workunit.client.0.smithi046.stdout:9/769: truncate d1/d11/d6/d8/d12/d1c/fd3 18406 0 2024-03-04T09:36:41.139 INFO:tasks.workunit.client.0.smithi046.stdout:7/652: mknod d0/da/d4e/cde 0 2024-03-04T09:36:41.332 INFO:tasks.workunit.client.0.smithi046.stdout:6/813: stat da/d14/d1e/d27/d4a/db2/d124/l125 0 2024-03-04T09:36:41.367 INFO:tasks.workunit.client.0.smithi046.stdout:6/814: write da/d14/d1e/d8f/f9e [913115,22722] 0 2024-03-04T09:36:41.469 INFO:tasks.workunit.client.0.smithi046.stdout:1/597: rmdir d1/d28 39 2024-03-04T09:36:41.700 INFO:tasks.workunit.client.0.smithi046.stdout:0/715: rename d10/dc2/ccd to d10/d12/d1f/d3b/def/cf9 0 2024-03-04T09:36:41.796 INFO:tasks.workunit.client.0.smithi046.stdout:2/700: write d5/d2c/d51/f58 [2240022,14410] 0 2024-03-04T09:36:41.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/770: dwrite d1/d11/d6/d8/d36/f51 [0,4194304] 0 2024-03-04T09:36:41.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/771: write d1/d11/d6/d8/d12/d1c/f38 [629459,52219] 0 2024-03-04T09:36:41.816 INFO:tasks.workunit.client.0.smithi046.stdout:2/701: dread d5/da/f24 [0,4194304] 0 2024-03-04T09:36:41.816 INFO:tasks.workunit.client.0.smithi046.stdout:2/702: creat d5/db9/dd2/fe3 x:0 0 0 2024-03-04T09:36:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/598: mkdir d1/d28/d6f/dbe 0 2024-03-04T09:36:42.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/772: mkdir d1/d11/d6/d8/d12/d1c/d26/dae/df2 0 2024-03-04T09:36:42.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/815: rename da/d14/d1e/d27/d4a to da/dd/d22/d12b 0 2024-03-04T09:36:42.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/816: getdents da/dd8 0 2024-03-04T09:36:42.847 INFO:tasks.workunit.client.0.smithi046.stdout:9/773: write d1/d11/d6/d8/d12/d1c/dd1/d4c/da3/fd5 [26789,19661] 0 2024-03-04T09:36:42.847 INFO:tasks.workunit.client.0.smithi046.stdout:9/774: write d1/d11/d6/d8/d12/d1c/fd3 [1006652,117939] 0 2024-03-04T09:36:42.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/703: creat d5/d40/da8/fe4 x:0 0 0 2024-03-04T09:36:42.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/704: chown d5/f1d 192 1 2024-03-04T09:36:42.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/817: write da/dd/d39/d60/da0/f5a [3161214,5113] 0 2024-03-04T09:36:42.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/705: dwrite d5/d84/d88/d99/fdf [0,4194304] 0 2024-03-04T09:36:42.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/653: truncate d0/d4/db/d12/f75 911542 0 2024-03-04T09:36:42.983 INFO:tasks.workunit.client.0.smithi046.stdout:1/599: creat d1/d28/d6f/d74/fbf x:0 0 0 2024-03-04T09:36:42.983 INFO:tasks.workunit.client.0.smithi046.stdout:1/600: stat d1/d28/d6a 0 2024-03-04T09:36:43.016 INFO:tasks.workunit.client.0.smithi046.stdout:3/806: symlink d1/l11b 0 2024-03-04T09:36:43.017 INFO:tasks.workunit.client.0.smithi046.stdout:3/807: stat d1/d1d/d27/def 0 2024-03-04T09:36:43.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/775: fsync d1/d11/d6/d8/f33 0 2024-03-04T09:36:43.561 INFO:tasks.workunit.client.0.smithi046.stdout:6/818: creat da/d14/d17/dd3/df3/f12c x:0 0 0 2024-03-04T09:36:43.994 INFO:tasks.workunit.client.0.smithi046.stdout:2/706: link d5/f10 d5/d2c/d51/d61/db5/fe5 0 2024-03-04T09:36:44.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/654: creat d0/d4/db/d38/d7e/dc5/fdf x:0 0 0 2024-03-04T09:36:44.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/655: read d0/d4/db/d38/d94/fa8 [3354216,75299] 0 2024-03-04T09:36:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:3/808: link d1/d1d/d27/d40/d76/d8d/d95/f87 d1/d21/d35/d43/dd2/d9a/f11c 0 2024-03-04T09:36:44.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/673: creat d7/de/d28/fe0 x:0 0 0 2024-03-04T09:36:44.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/674: creat d7/de/d28/d3a/d6f/dd0/fe1 x:0 0 0 2024-03-04T09:36:44.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/675: readlink d7/de/d28/dab/d3c/lde 0 2024-03-04T09:36:44.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/676: chown d7/de/d12/fac 118 1 2024-03-04T09:36:44.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/677: creat d7/de/d28/d3a/d6f/dd0/fe2 x:0 0 0 2024-03-04T09:36:44.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/601: truncate d1/d28/fa3 790624 0 2024-03-04T09:36:44.973 INFO:tasks.workunit.client.0.smithi046.stdout:7/656: mknod d0/d59/db1/ce0 0 2024-03-04T09:36:44.973 INFO:tasks.workunit.client.0.smithi046.stdout:7/657: stat d0/d4/db/d12/d28/f4b 0 2024-03-04T09:36:44.993 INFO:tasks.workunit.client.0.smithi046.stdout:7/658: dread d0/d4/db/d12/f34 [0,4194304] 0 2024-03-04T09:36:45.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/809: mkdir d1/d21/d35/d43/dd2/d9a/d11d 0 2024-03-04T09:36:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/659: mkdir d0/d4/db/d38/de1 0 2024-03-04T09:36:46.224 INFO:tasks.workunit.client.0.smithi046.stdout:1/602: creat d1/d92/d96/fc0 x:0 0 0 2024-03-04T09:36:46.416 INFO:tasks.workunit.client.0.smithi046.stdout:3/810: creat d1/d1d/d27/d4a/d78/de0/f11e x:0 0 0 2024-03-04T09:36:46.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/603: unlink d1/d28/c55 0 2024-03-04T09:36:47.995 INFO:tasks.workunit.client.0.smithi046.stdout:3/811: rmdir d1/d21/de7 0 2024-03-04T09:36:47.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/776: link d1/d11/d6/d8/d12/d1c/dd1/d5e/dde/ca2 d1/d11/d6/d8/d13/d92/cf3 0 2024-03-04T09:36:48.065 INFO:tasks.workunit.client.0.smithi046.stdout:9/777: dwrite d1/d11/d6/d8/d12/d1c/dd1/fba [0,4194304] 0 2024-03-04T09:36:48.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/671: sync 2024-03-04T09:36:48.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/672: chown d1/d44/d57/d70/c9f 43728428 1 2024-03-04T09:36:48.225 INFO:tasks.workunit.client.0.smithi046.stdout:3/812: creat d1/d1d/d27/d40/d76/d8d/d95/f11f x:0 0 0 2024-03-04T09:36:48.254 INFO:tasks.workunit.client.0.smithi046.stdout:3/813: write d1/f59 [811345,42131] 0 2024-03-04T09:36:49.157 INFO:tasks.workunit.client.0.smithi046.stdout:3/814: symlink d1/d21/d35/d43/dd2/d51/l120 0 2024-03-04T09:36:49.313 INFO:tasks.workunit.client.0.smithi046.stdout:9/778: link d1/d11/d6/d8/d12/d1c/c56 d1/d11/d6/d8/d1d/d34/d4d/cf4 0 2024-03-04T09:36:49.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/744: sync 2024-03-04T09:36:49.636 INFO:tasks.workunit.client.0.smithi046.stdout:9/779: symlink d1/d11/d6/d8/d36/lf5 0 2024-03-04T09:36:49.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/707: write d5/da/d1b/f30 [641675,114656] 0 2024-03-04T09:36:49.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/708: chown d5/d2c/d51/f58 46153 1 2024-03-04T09:36:49.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/745: creat d0/d3/d16/d1e/da1/dc1/f117 x:0 0 0 2024-03-04T09:36:50.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/815: symlink d1/d1d/d27/d40/d76/d8d/d95/l121 0 2024-03-04T09:36:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:8/678: dwrite d7/de/d4c/d50/f7a [0,4194304] 0 2024-03-04T09:36:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:8/679: readlink d7/de/d12/ld1 0 2024-03-04T09:36:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:8/680: readlink d7/de/d28/dab/d2c/d64/l77 0 2024-03-04T09:36:50.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/681: write d7/de/d12/f59 [2960665,33238] 0 2024-03-04T09:36:50.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/709: mknod d5/d84/d7c/dd0/ce6 0 2024-03-04T09:36:50.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/710: readlink d5/d84/d88/d47/lc6 0 2024-03-04T09:36:50.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/711: write d5/d2c/d91/fe1 [3453,34571] 0 2024-03-04T09:36:50.396 INFO:tasks.workunit.client.0.smithi046.stdout:8/682: dwrite d7/de/d28/dab/d2c/f45 [0,4194304] 0 2024-03-04T09:36:50.476 INFO:tasks.workunit.client.0.smithi046.stdout:8/683: dwrite d7/de/d28/d3a/d6f/d84/fce [0,4194304] 0 2024-03-04T09:36:50.476 INFO:tasks.workunit.client.0.smithi046.stdout:8/684: chown d7/de/d28/d3a/d6f/d84 260048 1 2024-03-04T09:36:50.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/746: unlink d0/d5f/d6f/ld5 0 2024-03-04T09:36:50.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/747: dread - d0/d1f/de8/ffa zero size 2024-03-04T09:36:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/816: mknod d1/d1d/d27/def/c122 0 2024-03-04T09:36:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/817: fdatasync d1/d21/d35/d24/f18 0 2024-03-04T09:36:51.489 INFO:tasks.workunit.client.0.smithi046.stdout:8/685: creat d7/de/d28/d3a/fe3 x:0 0 0 2024-03-04T09:36:51.490 INFO:tasks.workunit.client.0.smithi046.stdout:8/686: write d7/de/d28/dab/d3c/da5/fbc [774117,128598] 0 2024-03-04T09:36:51.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/687: dwrite d7/d53/d72/fb6 [0,4194304] 0 2024-03-04T09:36:51.624 INFO:tasks.workunit.client.0.smithi046.stdout:4/748: unlink d0/d1f/f48 0 2024-03-04T09:36:51.664 INFO:tasks.workunit.client.0.smithi046.stdout:4/749: dread d0/d3/d3b/d9d/fa5 [4194304,4194304] 0 2024-03-04T09:36:51.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/750: dread d0/f39 [0,4194304] 0 2024-03-04T09:36:51.706 INFO:tasks.workunit.client.0.smithi046.stdout:4/751: creat d0/d1f/d35/f118 x:0 0 0 2024-03-04T09:36:51.706 INFO:tasks.workunit.client.0.smithi046.stdout:4/752: write d0/d3/d3b/d8d/fb8 [258657,91979] 0 2024-03-04T09:36:51.742 INFO:tasks.workunit.client.0.smithi046.stdout:3/818: unlink d1/d21/d35/d43/dd2/fe9 0 2024-03-04T09:36:51.742 INFO:tasks.workunit.client.0.smithi046.stdout:3/819: chown d1/d1d/d27/d4a/f55 2817 1 2024-03-04T09:36:51.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:36:51.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:36:52.039 INFO:tasks.workunit.client.0.smithi046.stdout:2/712: getdents d5/db9/dd2 0 2024-03-04T09:36:52.039 INFO:tasks.workunit.client.0.smithi046.stdout:2/713: chown d5/d84/d88/lac 16506126 1 2024-03-04T09:36:52.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/714: read d5/fb4 [1663855,49267] 0 2024-03-04T09:36:52.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/715: fdatasync d5/d84/d9a/fa0 0 2024-03-04T09:36:52.639 INFO:tasks.workunit.client.0.smithi046.stdout:9/780: creat d1/d11/d6/d8/d12/d1c/ff6 x:0 0 0 2024-03-04T09:36:52.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/604: write d1/f79 [1993796,36293] 0 2024-03-04T09:36:52.719 INFO:tasks.workunit.client.0.smithi046.stdout:9/781: dwrite d1/d11/d6/d8/d12/d1c/dd1/d4c/fdb [0,4194304] 0 2024-03-04T09:36:52.719 INFO:tasks.workunit.client.0.smithi046.stdout:9/782: stat d1/fc5 0 2024-03-04T09:36:52.719 INFO:tasks.workunit.client.0.smithi046.stdout:9/783: fdatasync d1/d11/d6/d8/d1d/d34/d35/f90 0 2024-03-04T09:36:52.744 INFO:tasks.workunit.client.0.smithi046.stdout:5/673: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/fc [0,4194304] 0 2024-03-04T09:36:52.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/716: rename d10/d12/d52/d78/f30 to d10/d12/d1f/ffa 0 2024-03-04T09:36:52.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/717: write d10/d12/d52/d78/d8a/da2/fee [118359,983] 0 2024-03-04T09:36:52.946 INFO:tasks.workunit.client.0.smithi046.stdout:2/716: mknod d5/db9/ce7 0 2024-03-04T09:36:53.033 INFO:tasks.workunit.client.0.smithi046.stdout:2/717: dwrite d5/d2c/d51/fc7 [0,4194304] 0 2024-03-04T09:36:53.064 INFO:tasks.workunit.client.0.smithi046.stdout:2/718: dread d5/d2c/d51/fc7 [0,4194304] 0 2024-03-04T09:36:53.085 INFO:tasks.workunit.client.0.smithi046.stdout:8/688: mkdir d7/de/d4c/de4 0 2024-03-04T09:36:53.126 INFO:tasks.workunit.client.0.smithi046.stdout:1/605: creat d1/d28/d6f/db7/fc1 x:0 0 0 2024-03-04T09:36:53.126 INFO:tasks.workunit.client.0.smithi046.stdout:1/606: truncate d1/d28/d6a/f94 203122 0 2024-03-04T09:36:53.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/784: creat d1/d11/d6/d8/d12/d1c/dd1/ff7 x:0 0 0 2024-03-04T09:36:53.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/674: truncate d1/d44/d81/d96/d20/d76/d6c/db2/fc9 3405585 0 2024-03-04T09:36:53.976 INFO:tasks.workunit.client.0.smithi046.stdout:5/675: truncate d1/d44/d81/d96/d20/d76/d6c/db2/f7c 4346355 0 2024-03-04T09:36:53.976 INFO:tasks.workunit.client.0.smithi046.stdout:6/819: rename da/d14/d1e/d2c/f63 to da/d14/d1e/d8f/ddf/f12d 0 2024-03-04T09:36:54.413 INFO:tasks.workunit.client.0.smithi046.stdout:2/719: chown d5/da/c4d 0 1 2024-03-04T09:36:54.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/720: write d5/d40/f8f [124469,50041] 0 2024-03-04T09:36:55.571 INFO:tasks.workunit.client.0.smithi046.stdout:9/785: dread d1/d11/d6/d8/d13/d92/fcd [4194304,4194304] 0 2024-03-04T09:36:56.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/820: mkdir da/dd/d39/d60/da0/d67/d64/d12e 0 2024-03-04T09:36:56.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/718: truncate d10/d12/d6e/f93 29721 0 2024-03-04T09:36:56.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/719: fsync d10/d12/d1f/d3f/f65 0 2024-03-04T09:36:56.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/721: creat d5/d2c/d51/d7f/fe8 x:0 0 0 2024-03-04T09:36:56.292 INFO:tasks.workunit.client.0.smithi046.stdout:8/689: symlink d7/de/d4c/le5 0 2024-03-04T09:36:56.292 INFO:tasks.workunit.client.0.smithi046.stdout:8/690: chown d7 209 1 2024-03-04T09:36:56.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/691: dwrite d7/de/d28/d3a/d7d/fb5 [0,4194304] 0 2024-03-04T09:36:56.384 INFO:tasks.workunit.client.0.smithi046.stdout:8/692: dread d7/de/d12/fad [0,4194304] 0 2024-03-04T09:36:56.525 INFO:tasks.workunit.client.0.smithi046.stdout:9/786: truncate d1/d11/d6/d8/d13/d21/f69 5708869 0 2024-03-04T09:36:56.525 INFO:tasks.workunit.client.0.smithi046.stdout:9/787: chown d1/d11/d6/d8/d1d/d34/ld4 3987 1 2024-03-04T09:36:56.551 INFO:tasks.workunit.client.0.smithi046.stdout:9/788: write d1/d11/d6/d8/d12/d1c/dd1/d4c/fdb [3546135,73202] 0 2024-03-04T09:36:56.552 INFO:tasks.workunit.client.0.smithi046.stdout:9/789: creat d1/d11/d6/d8/d12/d1c/d26/ff8 x:0 0 0 2024-03-04T09:36:56.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/753: rename d0/d3/d16 to d0/d1f/d25/d50/d119 0 2024-03-04T09:36:57.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/660: sync 2024-03-04T09:36:57.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/720: truncate d10/f26 4598177 0 2024-03-04T09:36:57.652 INFO:tasks.workunit.client.0.smithi046.stdout:2/722: rmdir d5/d84/d88 39 2024-03-04T09:36:57.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/693: mknod d7/de/d28/d3a/d6f/ce6 0 2024-03-04T09:36:57.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/694: write d7/de/d28/f2e [4287893,75234] 0 2024-03-04T09:36:58.878 INFO:tasks.workunit.client.0.smithi046.stdout:0/721: creat d10/d12/d1f/d3f/ffb x:0 0 0 2024-03-04T09:36:58.928 INFO:tasks.workunit.client.0.smithi046.stdout:0/722: dwrite f7 [0,4194304] 0 2024-03-04T09:36:58.973 INFO:tasks.workunit.client.0.smithi046.stdout:3/820: unlink d1/cba 0 2024-03-04T09:36:58.974 INFO:tasks.workunit.client.0.smithi046.stdout:3/821: getdents d1/d1d/d27/d10f 0 2024-03-04T09:36:59.017 INFO:tasks.workunit.client.0.smithi046.stdout:2/723: dread d5/d84/d88/d3f/f41 [0,4194304] 0 2024-03-04T09:36:59.181 INFO:tasks.workunit.client.0.smithi046.stdout:8/695: symlink d7/d53/d72/d93/dd7/dc9/ddc/le7 0 2024-03-04T09:36:59.503 INFO:tasks.workunit.client.0.smithi046.stdout:9/790: creat d1/d11/d6/d8/d1d/d34/d4d/d7e/ff9 x:0 0 0 2024-03-04T09:36:59.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/754: symlink d0/d3/d3b/l11a 0 2024-03-04T09:36:59.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/755: readlink d0/l9 0 2024-03-04T09:36:59.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/756: fdatasync d0/d1f/d25/d50/d119/d1e/da1/fce 0 2024-03-04T09:36:59.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/723: getdents d10/d12/d9f/da6 0 2024-03-04T09:36:59.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/724: truncate d10/d12/d1f/d3f/f66 203205 0 2024-03-04T09:36:59.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/822: mkdir d1/d1d/d123 0 2024-03-04T09:36:59.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/823: chown d1/d21/d35/d43/dd2/d51/f9d 506157490 1 2024-03-04T09:36:59.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/607: dwrite d1/d28/d6a/f78 [0,4194304] 0 2024-03-04T09:36:59.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/696: fsync d7/de/d4c/d50/f85 0 2024-03-04T09:36:59.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/697: write d7/de/d28/d3a/d6f/dd0/fe2 [251916,1781] 0 2024-03-04T09:36:59.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/698: write d7/de/d28/d3a/d6f/d84/fbb [250451,26331] 0 2024-03-04T09:37:00.145 INFO:tasks.workunit.client.0.smithi046.stdout:9/791: stat d1/d11/d6/d8/d12/d1c/dd1/d5e/f8d 0 2024-03-04T09:37:00.145 INFO:tasks.workunit.client.0.smithi046.stdout:4/757: rmdir d0/d3/d3b/d8d 39 2024-03-04T09:37:00.145 INFO:tasks.workunit.client.0.smithi046.stdout:4/758: readlink d0/d1f/d5b/le4 0 2024-03-04T09:37:00.455 INFO:tasks.workunit.client.0.smithi046.stdout:3/824: fsync d1/d1d/d27/d40/d76/d8d/d95/f87 0 2024-03-04T09:37:00.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/724: symlink d5/da/le9 0 2024-03-04T09:37:01.241 INFO:tasks.workunit.client.0.smithi046.stdout:9/792: creat d1/ffa x:0 0 0 2024-03-04T09:37:01.241 INFO:tasks.workunit.client.0.smithi046.stdout:9/793: chown d1/d11/d6/d8/d6f/d8c/d9a/fc6 2 1 2024-03-04T09:37:01.241 INFO:tasks.workunit.client.0.smithi046.stdout:9/794: stat d1/d11/d6/d8/d6f/d8c/d9a 0 2024-03-04T09:37:01.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/825: mknod d1/d21/d35/d43/dd2/d51/da3/c124 0 2024-03-04T09:37:01.595 INFO:tasks.workunit.client.0.smithi046.stdout:2/725: creat d5/d84/d7c/dd0/fea x:0 0 0 2024-03-04T09:37:01.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/795: creat d1/d11/d6/d8/d13/d92/ffb x:0 0 0 2024-03-04T09:37:01.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/796: chown d1/d11/d6/d8/d12/d1c/dd1/fba 0 1 2024-03-04T09:37:01.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/797: dread d1/d11/d6/d8/d12/d1c/dd1/d4c/fa1 [0,4194304] 0 2024-03-04T09:37:02.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/798: fsync d1/d11/d6/d8/d13/d21/f69 0 2024-03-04T09:37:02.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/799: dread - d1/d11/d6/d8/d12/fe9 zero size 2024-03-04T09:37:02.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/676: rename d1/d44/d81/d96/d20/cc5 to d1/d44/cca 0 2024-03-04T09:37:02.222 INFO:tasks.workunit.client.0.smithi046.stdout:6/821: write da/dd/d39/d60/da0/d67/fa8 [358814,110011] 0 2024-03-04T09:37:02.239 INFO:tasks.workunit.client.0.smithi046.stdout:0/725: mkdir d10/d36/d7a/dfc 0 2024-03-04T09:37:02.239 INFO:tasks.workunit.client.0.smithi046.stdout:0/726: write d10/d12/d52/d78/fd3 [394091,66593] 0 2024-03-04T09:37:02.450 INFO:tasks.workunit.client.0.smithi046.stdout:3/826: mknod d1/db0/c125 0 2024-03-04T09:37:02.454 INFO:tasks.workunit.client.0.smithi046.stdout:3/827: write d1/d21/d35/d24/fe6 [133179,87227] 0 2024-03-04T09:37:02.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/822: truncate da/d14/f19 8903898 0 2024-03-04T09:37:03.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/727: creat d10/d36/d7a/ffd x:0 0 0 2024-03-04T09:37:03.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/699: getdents d7/de/d28/d3a/d6f 0 2024-03-04T09:37:03.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/726: mkdir d5/da/deb 0 2024-03-04T09:37:03.326 INFO:tasks.workunit.client.0.smithi046.stdout:2/727: dread d5/d2c/f33 [4194304,4194304] 0 2024-03-04T09:37:03.801 INFO:tasks.workunit.client.0.smithi046.stdout:6/823: getdents da/dd/d39/d60/da0/d67/dcf/d11e 0 2024-03-04T09:37:03.801 INFO:tasks.workunit.client.0.smithi046.stdout:6/824: truncate da/dd/d39/d60/da0/d67/d64/d82/ff9 749357 0 2024-03-04T09:37:03.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/825: dread f9 [0,4194304] 0 2024-03-04T09:37:03.826 INFO:tasks.workunit.client.0.smithi046.stdout:6/826: write da/d14/d1e/d27/d4b/f75 [3465969,8228] 0 2024-03-04T09:37:03.826 INFO:tasks.workunit.client.0.smithi046.stdout:6/827: truncate da/d14/d17/dd3/df3/f12c 98614 0 2024-03-04T09:37:03.922 INFO:tasks.workunit.client.0.smithi046.stdout:0/728: rmdir d10/d12/d52/d78/d8a/da2 39 2024-03-04T09:37:04.221 INFO:tasks.workunit.client.0.smithi046.stdout:2/728: truncate d5/da/f24 3191770 0 2024-03-04T09:37:04.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/661: rename d0/d59 to d0/da/d46/d99/de2 0 2024-03-04T09:37:04.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/662: fdatasync d0/da/d46/d99/fb2 0 2024-03-04T09:37:05.332 INFO:tasks.workunit.client.0.smithi046.stdout:7/663: mkdir d0/da/d46/d99/de2/de3 0 2024-03-04T09:37:05.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/729: dread d5/da/f14 [4194304,4194304] 0 2024-03-04T09:37:05.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/730: creat d5/d2c/d91/fec x:0 0 0 2024-03-04T09:37:05.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/608: write d1/d28/f47 [387031,34236] 0 2024-03-04T09:37:05.784 INFO:tasks.workunit.client.0.smithi046.stdout:8/700: unlink d7/de/d28/la4 0 2024-03-04T09:37:05.901 INFO:tasks.workunit.client.0.smithi046.stdout:8/701: dwrite d7/d53/d72/fb6 [4194304,4194304] 0 2024-03-04T09:37:05.901 INFO:tasks.workunit.client.0.smithi046.stdout:8/702: truncate d7/de/d28/d3a/fe3 543348 0 2024-03-04T09:37:06.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/703: creat d7/de/d28/fe8 x:0 0 0 2024-03-04T09:37:06.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/704: dread d7/d53/d72/f9a [0,4194304] 0 2024-03-04T09:37:06.512 INFO:tasks.workunit.client.0.smithi046.stdout:1/609: rmdir d1/d92/d96 39 2024-03-04T09:37:06.513 INFO:tasks.workunit.client.0.smithi046.stdout:1/610: readlink d1/d28/d6f/l76 0 2024-03-04T09:37:06.513 INFO:tasks.workunit.client.0.smithi046.stdout:1/611: write d1/d28/d6f/fa2 [1292377,61662] 0 2024-03-04T09:37:06.522 INFO:tasks.workunit.client.0.smithi046.stdout:1/612: dread d1/d28/f7f [0,4194304] 0 2024-03-04T09:37:06.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/613: readlink d1/d28/d6a/l86 0 2024-03-04T09:37:07.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/759: rename d0/d1f/f79 to d0/d1f/d5b/f11b 0 2024-03-04T09:37:07.911 INFO:tasks.workunit.client.0.smithi046.stdout:1/614: truncate d1/d28/f3c 468759 0 2024-03-04T09:37:08.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/800: rename d1/d11/d6/d8/d12/d1c/dd1/d5e/d9e to d1/d11/d6/d8/d1d/d34/d7f/dfc 0 2024-03-04T09:37:08.845 INFO:tasks.workunit.client.0.smithi046.stdout:4/760: symlink d0/d1f/d25/d50/d63/l11c 0 2024-03-04T09:37:09.693 INFO:tasks.workunit.client.0.smithi046.stdout:9/801: creat d1/d11/d6/d8/d6f/ffd x:0 0 0 2024-03-04T09:37:09.694 INFO:tasks.workunit.client.0.smithi046.stdout:4/761: creat d0/d1f/db9/ddd/d114/f11d x:0 0 0 2024-03-04T09:37:09.694 INFO:tasks.workunit.client.0.smithi046.stdout:4/762: creat d0/d1f/d25/d50/ddb/f11e x:0 0 0 2024-03-04T09:37:09.718 INFO:tasks.workunit.client.0.smithi046.stdout:2/731: dwrite d5/d84/d88/d3f/f8c [0,4194304] 0 2024-03-04T09:37:10.326 INFO:tasks.workunit.client.0.smithi046.stdout:2/732: creat d5/d84/d7c/fed x:0 0 0 2024-03-04T09:37:10.330 INFO:tasks.workunit.client.0.smithi046.stdout:2/733: read d5/d84/d88/f3e [319149,48339] 0 2024-03-04T09:37:10.765 INFO:tasks.workunit.client.0.smithi046.stdout:2/734: symlink d5/d38/lee 0 2024-03-04T09:37:11.334 INFO:tasks.workunit.client.0.smithi046.stdout:0/729: symlink d10/d12/lfe 0 2024-03-04T09:37:11.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/730: read d10/d12/d52/d5d/f61 [3482743,20396] 0 2024-03-04T09:37:11.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/731: write d10/d12/d1f/d3f/d4b/f7f [3271606,110289] 0 2024-03-04T09:37:11.582 INFO:tasks.workunit.client.0.smithi046.stdout:0/732: link d10/d12/d1f/fed d10/d12/d9f/da6/fff 0 2024-03-04T09:37:11.582 INFO:tasks.workunit.client.0.smithi046.stdout:0/733: chown d10/d12/d52/d78/lde 117 1 2024-03-04T09:37:11.645 INFO:tasks.workunit.client.0.smithi046.stdout:0/734: dwrite d10/d12/d52/d78/d8a/da2/fb1 [0,4194304] 0 2024-03-04T09:37:11.955 INFO:tasks.workunit.client.0.smithi046.stdout:0/735: mknod d10/d12/c100 0 2024-03-04T09:37:11.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/677: rename d1/db3 to d1/d44/d81/d96/d20/d76/d6c/db2/dcb 0 2024-03-04T09:37:11.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/678: readlink d1/d44/d69/l73 0 2024-03-04T09:37:11.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/679: fdatasync d1/d44/d81/d8e/f2e 0 2024-03-04T09:37:12.412 INFO:tasks.workunit.client.0.smithi046.stdout:0/736: creat d10/d12/d52/d78/f101 x:0 0 0 2024-03-04T09:37:12.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/828: rename d1/d1d/f6d to d1/d1d/d27/d4a/f126 0 2024-03-04T09:37:12.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/829: write d1/d21/d35/d43/dd2/d51/da3/fec [397797,3611] 0 2024-03-04T09:37:12.518 INFO:tasks.workunit.client.0.smithi046.stdout:5/680: creat d1/d44/d81/d8e/d63/fcc x:0 0 0 2024-03-04T09:37:12.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/830: mkdir d1/d21/d35/d127 0 2024-03-04T09:37:12.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/737: dread d10/d12/d9f/fd2 [0,4194304] 0 2024-03-04T09:37:13.019 INFO:tasks.workunit.client.0.smithi046.stdout:6/828: sync 2024-03-04T09:37:13.019 INFO:tasks.workunit.client.0.smithi046.stdout:8/705: sync 2024-03-04T09:37:13.019 INFO:tasks.workunit.client.0.smithi046.stdout:4/763: sync 2024-03-04T09:37:13.019 INFO:tasks.workunit.client.0.smithi046.stdout:6/829: read da/d14/d1e/d27/da3/fcc [250409,65841] 0 2024-03-04T09:37:13.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/764: write d0/d3/d3b/fd9 [896614,59899] 0 2024-03-04T09:37:13.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/765: fsync d0/d1f/d25/d50/ddb/f112 0 2024-03-04T09:37:13.041 INFO:tasks.workunit.client.0.smithi046.stdout:4/766: dread d0/d1f/fb6 [0,4194304] 0 2024-03-04T09:37:13.041 INFO:tasks.workunit.client.0.smithi046.stdout:4/767: fsync d0/d1f/d25/d50/ddb/ffb 0 2024-03-04T09:37:13.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/830: dwrite da/dd/d39/d60/da0/d67/d64/d56/d86/f95 [0,4194304] 0 2024-03-04T09:37:13.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/831: dread - da/dd/d39/d60/da0/d67/dcf/f127 zero size 2024-03-04T09:37:13.156 INFO:tasks.workunit.client.0.smithi046.stdout:6/832: dwrite da/d14/d1e/f30 [0,4194304] 0 2024-03-04T09:37:13.156 INFO:tasks.workunit.client.0.smithi046.stdout:6/833: chown da/dd/d39/d60/da0/d67/dcf/f127 133874625 1 2024-03-04T09:37:13.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/664: rename d0/d4/db/d12/l3e to d0/le4 0 2024-03-04T09:37:14.090 INFO:tasks.workunit.client.0.smithi046.stdout:3/831: creat d1/d1d/d27/d10f/f128 x:0 0 0 2024-03-04T09:37:14.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/768: mknod d0/d1f/d25/d50/c11f 0 2024-03-04T09:37:14.120 INFO:tasks.workunit.client.0.smithi046.stdout:8/706: truncate d7/de/d28/dab/f99 234581 0 2024-03-04T09:37:14.121 INFO:tasks.workunit.client.0.smithi046.stdout:8/707: readlink d7/de/d28/d36/l96 0 2024-03-04T09:37:14.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/615: rename d1/d92/lbd to d1/d92/d96/lc2 0 2024-03-04T09:37:14.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/769: dwrite d0/d1f/d25/d50/d119/d1e/d73/f9a [0,4194304] 0 2024-03-04T09:37:14.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/770: creat d0/d1f/d25/d7b/f120 x:0 0 0 2024-03-04T09:37:14.231 INFO:tasks.workunit.client.0.smithi046.stdout:8/708: dwrite d7/de/d28/d71/faa [0,4194304] 0 2024-03-04T09:37:14.419 INFO:tasks.workunit.client.0.smithi046.stdout:5/681: sync 2024-03-04T09:37:14.494 INFO:tasks.workunit.client.0.smithi046.stdout:0/738: rmdir d10/d12/d52/d78 39 2024-03-04T09:37:14.494 INFO:tasks.workunit.client.0.smithi046.stdout:7/665: sync 2024-03-04T09:37:14.494 INFO:tasks.workunit.client.0.smithi046.stdout:0/739: dread - d10/d36/d7a/ffd zero size 2024-03-04T09:37:14.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/834: dwrite da/dd/d39/d60/da0/ddd/fe4 [0,4194304] 0 2024-03-04T09:37:14.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/835: write da/d14/d1e/fb6 [520643,49161] 0 2024-03-04T09:37:14.581 INFO:tasks.workunit.client.0.smithi046.stdout:7/666: dwrite d0/d4/db/d12/f34 [0,4194304] 0 2024-03-04T09:37:14.581 INFO:tasks.workunit.client.0.smithi046.stdout:7/667: chown d0/f11 63 1 2024-03-04T09:37:14.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/832: mknod d1/d1d/d27/d40/d76/c129 0 2024-03-04T09:37:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/616: mknod d1/d92/d96/da7/cc3 0 2024-03-04T09:37:14.978 INFO:tasks.workunit.client.0.smithi046.stdout:4/771: rmdir d0/d1f/d25/d50/d119/d1e/da1/dc1 39 2024-03-04T09:37:15.002 INFO:tasks.workunit.client.0.smithi046.stdout:4/772: dread d0/d1f/d25/f9c [0,4194304] 0 2024-03-04T09:37:15.036 INFO:tasks.workunit.client.0.smithi046.stdout:8/709: creat d7/d53/fe9 x:0 0 0 2024-03-04T09:37:15.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/682: mkdir d1/d44/d69/dcd 0 2024-03-04T09:37:15.426 INFO:tasks.workunit.client.0.smithi046.stdout:0/740: creat d10/d12/d52/d78/d8a/f102 x:0 0 0 2024-03-04T09:37:15.426 INFO:tasks.workunit.client.0.smithi046.stdout:6/836: mknod da/d14/d1e/d8f/ddf/d103/d123/c12f 0 2024-03-04T09:37:15.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/833: creat d1/d1d/d27/d40/d76/dfd/f12a x:0 0 0 2024-03-04T09:37:15.739 INFO:tasks.workunit.client.0.smithi046.stdout:9/802: rename d1/d11/d6/d8/d12/d1c/dd1/d4c to d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe 0 2024-03-04T09:37:15.739 INFO:tasks.workunit.client.0.smithi046.stdout:9/803: stat d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe 0 2024-03-04T09:37:15.931 INFO:tasks.workunit.client.0.smithi046.stdout:8/710: truncate d7/de/d28/d3a/d6f/d84/fce 2045086 0 2024-03-04T09:37:16.010 INFO:tasks.workunit.client.0.smithi046.stdout:5/683: chown d1/d44/d81/d96/d20/d76/c51 4058416 1 2024-03-04T09:37:16.041 INFO:tasks.workunit.client.0.smithi046.stdout:5/684: dread d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/f23 [4194304,4194304] 0 2024-03-04T09:37:16.041 INFO:tasks.workunit.client.0.smithi046.stdout:5/685: stat d1/d44/d81/d96/d20/d5e/f74 0 2024-03-04T09:37:16.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/741: symlink d10/d12/d52/d78/d8a/l103 0 2024-03-04T09:37:16.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/837: rmdir da/dd/d39/d60/da0/ddd 39 2024-03-04T09:37:16.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/742: readlink d10/d12/d52/d78/d8a/l103 0 2024-03-04T09:37:16.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/838: fsync da/dd/d39/d60/da0/f5a 0 2024-03-04T09:37:16.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/839: dwrite da/dd/d39/d60/d7e/f119 [0,4194304] 0 2024-03-04T09:37:16.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/840: fdatasync da/dd/d46/f72 0 2024-03-04T09:37:16.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/735: rename d5/c48 to d5/d38/d54/dda/cef 0 2024-03-04T09:37:16.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/736: fsync d5/da/d1b/f30 0 2024-03-04T09:37:16.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/737: dwrite d5/da/f65 [0,4194304] 0 2024-03-04T09:37:16.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/804: symlink d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/lff 0 2024-03-04T09:37:16.849 INFO:tasks.workunit.client.0.smithi046.stdout:1/617: symlink d1/lc4 0 2024-03-04T09:37:16.999 INFO:tasks.workunit.client.0.smithi046.stdout:8/711: getdents d7/de/d28/dab 0 2024-03-04T09:37:17.417 INFO:tasks.workunit.client.0.smithi046.stdout:0/743: mkdir d10/d12/d52/d78/d8a/da2/d104 0 2024-03-04T09:37:17.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/668: write d0/d4/db/d12/d28/f4b [7904231,25626] 0 2024-03-04T09:37:18.806 INFO:tasks.workunit.client.0.smithi046.stdout:4/773: rename d0/d3/c82 to d0/d1f/d25/d50/d119/d1e/c121 0 2024-03-04T09:37:18.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/834: mkdir d1/d1d/d27/d40/d76/d8d/d95/d12b 0 2024-03-04T09:37:18.806 INFO:tasks.workunit.client.0.smithi046.stdout:4/774: fsync d0/f56 0 2024-03-04T09:37:19.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/738: creat d5/da/dbd/ff0 x:0 0 0 2024-03-04T09:37:19.196 INFO:tasks.workunit.client.0.smithi046.stdout:9/805: readlink d1/d11/d6/d8/d1d/d34/d4d/la4 0 2024-03-04T09:37:19.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/686: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f66 [0,4194304] 0 2024-03-04T09:37:19.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/618: symlink d1/d92/d96/lc5 0 2024-03-04T09:37:19.443 INFO:tasks.workunit.client.0.smithi046.stdout:6/841: dwrite da/dd/d39/d60/d7e/f119 [4194304,4194304] 0 2024-03-04T09:37:19.444 INFO:tasks.workunit.client.0.smithi046.stdout:6/842: readlink da/d14/d17/l4c 0 2024-03-04T09:37:19.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/712: mkdir d7/de/d28/dab/d2c/d64/dea 0 2024-03-04T09:37:19.935 INFO:tasks.workunit.client.0.smithi046.stdout:0/744: creat d10/d12/d9f/f105 x:0 0 0 2024-03-04T09:37:19.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/745: write d10/d12/d52/d5d/fcb [1484738,72911] 0 2024-03-04T09:37:19.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/746: stat d10/l97 0 2024-03-04T09:37:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:3/835: unlink d1/d21/d35/d43/cb5 0 2024-03-04T09:37:20.180 INFO:tasks.workunit.client.0.smithi046.stdout:3/836: write d1/d21/d35/d43/dd2/f3e [395883,19226] 0 2024-03-04T09:37:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/775: truncate d0/d1f/d25/d50/f51 4045792 0 2024-03-04T09:37:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/776: stat d0/d8e/f91 0 2024-03-04T09:37:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:2/739: truncate d5/d2c/d51/fad 11469 0 2024-03-04T09:37:20.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/687: unlink d1/d44/d81/d96/d20/d76/d6c/db2/cc1 0 2024-03-04T09:37:21.564 INFO:tasks.workunit.client.0.smithi046.stdout:1/619: creat d1/d28/d6f/dbe/fc6 x:0 0 0 2024-03-04T09:37:21.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/843: creat da/dd/d46/de6/f130 x:0 0 0 2024-03-04T09:37:21.587 INFO:tasks.workunit.client.0.smithi046.stdout:8/713: creat d7/de/d28/dab/d2c/feb x:0 0 0 2024-03-04T09:37:21.746 INFO:tasks.workunit.client.0.smithi046.stdout:7/669: symlink d0/d4/db/le5 0 2024-03-04T09:37:21.815 INFO:tasks.workunit.client.0.smithi046.stdout:7/670: dwrite d0/da/d46/d99/de2/db1/fb5 [0,4194304] 0 2024-03-04T09:37:21.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/837: mkdir d1/d88/d12c 0 2024-03-04T09:37:22.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/777: mkdir d0/d1f/d25/d50/d119/d1e/da1/dcc/d122 0 2024-03-04T09:37:22.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:37:22.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:37:22.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/688: link d1/d44/d81/d96/d20/d76/d6c/lc8 d1/d44/d81/d96/d20/d76/d6c/db2/lce 0 2024-03-04T09:37:22.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/740: creat d5/d2c/d51/d61/db5/ff1 x:0 0 0 2024-03-04T09:37:22.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/741: write d5/d2c/d51/d61/fb3 [532962,67357] 0 2024-03-04T09:37:22.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/742: getdents d5/d84/d88/d3f/dd3 0 2024-03-04T09:37:22.500 INFO:tasks.workunit.client.0.smithi046.stdout:6/844: getdents da/dd/d22/d12b/dab/ddc 0 2024-03-04T09:37:22.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/743: dwrite d5/d2c/f71 [0,4194304] 0 2024-03-04T09:37:22.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/744: readlink d5/d84/d7c/dae/laf 0 2024-03-04T09:37:22.564 INFO:tasks.workunit.client.0.smithi046.stdout:0/747: link d10/d12/l55 d10/d12/d52/d78/d8a/da2/l106 0 2024-03-04T09:37:23.385 INFO:tasks.workunit.client.0.smithi046.stdout:3/838: symlink d1/d1d/d123/l12d 0 2024-03-04T09:37:23.385 INFO:tasks.workunit.client.0.smithi046.stdout:3/839: chown d1/db0/fc2 60682978 1 2024-03-04T09:37:23.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/778: creat d0/d1f/d25/d50/d119/d1e/da1/dc1/f123 x:0 0 0 2024-03-04T09:37:23.593 INFO:tasks.workunit.client.0.smithi046.stdout:5/689: creat d1/d44/d81/d96/d20/fcf x:0 0 0 2024-03-04T09:37:23.693 INFO:tasks.workunit.client.0.smithi046.stdout:8/714: creat d7/de/fec x:0 0 0 2024-03-04T09:37:23.774 INFO:tasks.workunit.client.0.smithi046.stdout:1/620: link d1/d28/f6e d1/d92/d9a/fc7 0 2024-03-04T09:37:23.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/845: creat da/dd/d39/d60/da0/d67/d64/d82/d83/f131 x:0 0 0 2024-03-04T09:37:24.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/745: creat d5/d2c/d51/dca/ff2 x:0 0 0 2024-03-04T09:37:24.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/671: chown d0/d2d/d85/fa9 4 1 2024-03-04T09:37:24.507 INFO:tasks.workunit.client.0.smithi046.stdout:3/840: rename d1/d1d/d27/d4a/d78/de0/f104 to d1/d1d/d27/def/f12e 0 2024-03-04T09:37:24.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/779: mkdir d0/d5f/d124 0 2024-03-04T09:37:24.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/780: fdatasync d0/d1f/d25/d50/d119/d1e/da1/fce 0 2024-03-04T09:37:24.764 INFO:tasks.workunit.client.0.smithi046.stdout:4/781: dwrite d0/d3/d20/d96/d6e/d85/da7/fd3 [0,4194304] 0 2024-03-04T09:37:24.782 INFO:tasks.workunit.client.0.smithi046.stdout:4/782: dread d0/d3/d3b/fd9 [0,4194304] 0 2024-03-04T09:37:24.904 INFO:tasks.workunit.client.0.smithi046.stdout:1/621: write d1/f27 [1538222,23468] 0 2024-03-04T09:37:24.995 INFO:tasks.workunit.client.0.smithi046.stdout:2/746: mknod d5/d38/d54/dda/cf3 0 2024-03-04T09:37:25.035 INFO:tasks.workunit.client.0.smithi046.stdout:2/747: dread d5/d38/d54/f7a [0,4194304] 0 2024-03-04T09:37:25.035 INFO:tasks.workunit.client.0.smithi046.stdout:2/748: fsync d5/f10 0 2024-03-04T09:37:25.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/749: dread d5/d84/d88/d3f/f45 [0,4194304] 0 2024-03-04T09:37:25.246 INFO:tasks.workunit.client.0.smithi046.stdout:7/672: link d0/d4/d40/f49 d0/da/d46/fe6 0 2024-03-04T09:37:25.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/846: rename da/d14/d1e/d8f/ddf/d103/cca to da/dd/d22/d12b/dab/ddc/c132 0 2024-03-04T09:37:25.545 INFO:tasks.workunit.client.0.smithi046.stdout:9/806: sync 2024-03-04T09:37:25.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/841: mknod d1/db0/c12f 0 2024-03-04T09:37:25.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/842: readlink d1/d1d/d27/d40/d70/d7d/lf1 0 2024-03-04T09:37:26.259 INFO:tasks.workunit.client.0.smithi046.stdout:2/750: unlink d5/da/le9 0 2024-03-04T09:37:27.074 INFO:tasks.workunit.client.0.smithi046.stdout:3/843: rename d1/d1d/d27/def/c122 to d1/d1d/d27/d40/d92/c130 0 2024-03-04T09:37:27.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/690: rmdir d1/d44/d81/d8e 39 2024-03-04T09:37:27.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/622: truncate d1/f49 5168785 0 2024-03-04T09:37:27.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/751: rmdir d5/d84/d7c/dae 39 2024-03-04T09:37:27.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/807: symlink d1/d11/d6/d8/d1d/d34/d4d/l100 0 2024-03-04T09:37:28.359 INFO:tasks.workunit.client.0.smithi046.stdout:3/844: creat d1/d21/d35/d43/dd2/d9a/dbc/d106/f131 x:0 0 0 2024-03-04T09:37:28.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/623: symlink d1/d92/d96/lc8 0 2024-03-04T09:37:28.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/624: write d1/d28/f7f [687641,33131] 0 2024-03-04T09:37:28.776 INFO:tasks.workunit.client.0.smithi046.stdout:2/752: mkdir d5/d84/d7c/dd0/df4 0 2024-03-04T09:37:28.777 INFO:tasks.workunit.client.0.smithi046.stdout:2/753: creat d5/d84/d7c/ff5 x:0 0 0 2024-03-04T09:37:28.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/754: dread d5/f9d [0,4194304] 0 2024-03-04T09:37:28.839 INFO:tasks.workunit.client.0.smithi046.stdout:2/755: read d5/da/f14 [4272145,54581] 0 2024-03-04T09:37:29.289 INFO:tasks.workunit.client.0.smithi046.stdout:5/691: link d1/f7f d1/d44/d57/d70/da6/fd0 0 2024-03-04T09:37:29.289 INFO:tasks.workunit.client.0.smithi046.stdout:5/692: readlink d1/d44/d81/d8e/l93 0 2024-03-04T09:37:29.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/693: dread d1/d44/d81/d8e/d72/fa2 [0,4194304] 0 2024-03-04T09:37:29.831 INFO:tasks.workunit.client.0.smithi046.stdout:0/748: sync 2024-03-04T09:37:29.923 INFO:tasks.workunit.client.0.smithi046.stdout:2/756: symlink d5/d2c/d51/d7f/lf6 0 2024-03-04T09:37:29.928 INFO:tasks.workunit.client.0.smithi046.stdout:0/749: dwrite fc [0,4194304] 0 2024-03-04T09:37:29.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/750: write d10/d12/d9f/da6/fbb [328406,109505] 0 2024-03-04T09:37:29.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/845: symlink d1/d1d/d27/d40/d76/d8d/d95/dcf/l132 0 2024-03-04T09:37:29.945 INFO:tasks.workunit.client.0.smithi046.stdout:5/694: mkdir d1/d44/d81/d96/d20/d76/d6c/dd1 0 2024-03-04T09:37:30.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/846: dwrite d1/d1d/d27/d40/d76/f116 [0,4194304] 0 2024-03-04T09:37:30.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/625: truncate d1/d28/f60 782075 0 2024-03-04T09:37:30.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/757: chown d5/l16 16295 1 2024-03-04T09:37:30.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/758: stat d5/da/fbf 0 2024-03-04T09:37:30.426 INFO:tasks.workunit.client.0.smithi046.stdout:0/751: creat d10/d12/d9f/dca/f107 x:0 0 0 2024-03-04T09:37:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/759: dwrite d5/da/dbd/ff0 [0,4194304] 0 2024-03-04T09:37:30.484 INFO:tasks.workunit.client.0.smithi046.stdout:2/760: chown d5/d2c/d51/d7f/fe8 2 1 2024-03-04T09:37:30.500 INFO:tasks.workunit.client.0.smithi046.stdout:2/761: dread d5/da/fbf [0,4194304] 0 2024-03-04T09:37:31.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/715: unlink d7/de/d28/lcd 0 2024-03-04T09:37:31.188 INFO:tasks.workunit.client.0.smithi046.stdout:3/847: mknod d1/d1d/d27/d4a/d78/c133 0 2024-03-04T09:37:31.188 INFO:tasks.workunit.client.0.smithi046.stdout:3/848: readlink d1/d21/l22 0 2024-03-04T09:37:31.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/716: dwrite d7/de/d28/fe0 [0,4194304] 0 2024-03-04T09:37:31.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/717: write d7/de/d28/dab/d2c/fa3 [289593,98315] 0 2024-03-04T09:37:31.401 INFO:tasks.workunit.client.0.smithi046.stdout:1/626: symlink d1/d28/d6f/db1/lc9 0 2024-03-04T09:37:31.821 INFO:tasks.workunit.client.0.smithi046.stdout:7/673: dwrite d0/d4/db/d12/f75 [0,4194304] 0 2024-03-04T09:37:31.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/762: mkdir d5/db9/dd2/df7 0 2024-03-04T09:37:32.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/849: mkdir d1/db0/d134 0 2024-03-04T09:37:32.523 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:48:43.330 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.534 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:48:43.405 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.536 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:48:43.407 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.539 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:48:43.346 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.539 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:48:43.410 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.542 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:48:43.413 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.619 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:48:43.489 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.624 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:48:43.495 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:32.635 INFO:tasks.workunit.client.0.smithi046.stdout:1/627: readlink d1/d28/l2c 0 2024-03-04T09:37:32.753 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:48:43.560 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:37:33.319 INFO:tasks.workunit.client.0.smithi046.stdout:2/763: creat d5/d84/d7c/dae/ff8 x:0 0 0 2024-03-04T09:37:34.147 INFO:tasks.workunit.client.0.smithi046.stdout:7/674: rmdir d0/da/d4e 39 2024-03-04T09:37:34.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/764: mknod d5/d84/cf9 0 2024-03-04T09:37:34.661 INFO:tasks.workunit.client.0.smithi046.stdout:9/808: dwrite d1/d11/d6/d8/d12/d1c/f6e [0,4194304] 0 2024-03-04T09:37:34.710 INFO:tasks.workunit.client.0.smithi046.stdout:7/675: creat d0/d4/db/d38/d7e/fe7 x:0 0 0 2024-03-04T09:37:34.828 INFO:tasks.workunit.client.0.smithi046.stdout:5/695: link d1/d44/d81/faa d1/d44/d81/d96/d20/d76/d6c/db2/fd2 0 2024-03-04T09:37:34.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/765: mknod d5/d84/d88/d99/daa/cfa 0 2024-03-04T09:37:34.952 INFO:tasks.workunit.client.0.smithi046.stdout:2/766: dread d5/d84/d88/d47/f5c [0,4194304] 0 2024-03-04T09:37:35.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/676: unlink d0/d2d/c5d 0 2024-03-04T09:37:35.225 INFO:tasks.workunit.client.0.smithi046.stdout:9/809: truncate d1/d11/d6/d8/d1d/f77 4102709 0 2024-03-04T09:37:35.225 INFO:tasks.workunit.client.0.smithi046.stdout:7/677: chown d0/d4/db/d12/c22 57398 1 2024-03-04T09:37:35.344 INFO:tasks.workunit.client.0.smithi046.stdout:9/810: dwrite d1/d11/d6/d8/d12/d1c/dd1/f5f [8388608,4194304] 0 2024-03-04T09:37:35.344 INFO:tasks.workunit.client.0.smithi046.stdout:9/811: chown d1/d11/d6/f4e 72844782 1 2024-03-04T09:37:35.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/678: dwrite d0/d4/db/d38/d94/fa8 [0,4194304] 0 2024-03-04T09:37:35.369 INFO:tasks.workunit.client.0.smithi046.stdout:7/679: dread d0/d4/db/d12/d28/f5c [0,4194304] 0 2024-03-04T09:37:35.643 INFO:tasks.workunit.client.0.smithi046.stdout:9/812: creat d1/d11/d6/d8/d6f/d8c/d9a/ddc/f101 x:0 0 0 2024-03-04T09:37:36.098 INFO:tasks.workunit.client.0.smithi046.stdout:7/680: rmdir d0/da/d46/d99/de2 39 2024-03-04T09:37:36.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/813: link d1/d11/d6/d8/d6f/d8c/lb1 d1/d11/d6/d8/d13/d85/l102 0 2024-03-04T09:37:36.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/814: truncate d1/d11/d6/d8/d12/d1c/dd1/f8a 758428 0 2024-03-04T09:37:36.372 INFO:tasks.workunit.client.0.smithi046.stdout:6/847: sync 2024-03-04T09:37:36.372 INFO:tasks.workunit.client.0.smithi046.stdout:4/783: sync 2024-03-04T09:37:36.388 INFO:tasks.workunit.client.0.smithi046.stdout:6/848: dread da/dd/d39/f45 [0,4194304] 0 2024-03-04T09:37:37.095 INFO:tasks.workunit.client.0.smithi046.stdout:9/815: creat d1/d11/d6/d8/d12/f103 x:0 0 0 2024-03-04T09:37:37.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/816: write d1/d11/d6/d8/d1d/d34/d4d/d7e/f89 [2816424,55177] 0 2024-03-04T09:37:37.209 INFO:tasks.workunit.client.0.smithi046.stdout:0/752: creat d10/d12/d52/f108 x:0 0 0 2024-03-04T09:37:37.209 INFO:tasks.workunit.client.0.smithi046.stdout:0/753: creat d10/d12/d6e/d99/f109 x:0 0 0 2024-03-04T09:37:37.296 INFO:tasks.workunit.client.0.smithi046.stdout:6/849: creat da/d14/d1e/d27/f133 x:0 0 0 2024-03-04T09:37:37.296 INFO:tasks.workunit.client.0.smithi046.stdout:6/850: dread - da/d4e/d98/f10a zero size 2024-03-04T09:37:37.522 INFO:tasks.workunit.client.0.smithi046.stdout:8/718: write d7/de/f52 [321346,115971] 0 2024-03-04T09:37:37.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/817: write d1/d11/d6/d8/f62 [590462,24101] 0 2024-03-04T09:37:37.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/818: write d1/d11/d6/d8/d12/d1c/dd1/f8a [1478712,71739] 0 2024-03-04T09:37:38.069 INFO:tasks.workunit.client.0.smithi046.stdout:0/754: mkdir d10/d12/d9f/da6/d10a 0 2024-03-04T09:37:38.352 INFO:tasks.workunit.client.0.smithi046.stdout:6/851: creat da/d14/d17/f134 x:0 0 0 2024-03-04T09:37:38.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/719: link d7/de/d28/fe8 d7/de/d4c/d50/fed 0 2024-03-04T09:37:38.682 INFO:tasks.workunit.client.0.smithi046.stdout:1/628: write d1/fd [1666945,71693] 0 2024-03-04T09:37:38.949 INFO:tasks.workunit.client.0.smithi046.stdout:0/755: symlink d10/d12/d9f/da6/l10b 0 2024-03-04T09:37:38.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/756: chown d10/d12/d6e/lb7 7760 1 2024-03-04T09:37:39.057 INFO:tasks.workunit.client.0.smithi046.stdout:6/852: mkdir da/d14/d1e/d8f/ddf/d135 0 2024-03-04T09:37:39.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/853: dwrite da/dd/d39/d60/da0/fa5 [0,4194304] 0 2024-03-04T09:37:39.407 INFO:tasks.workunit.client.0.smithi046.stdout:8/720: mknod d7/de/d28/dab/cee 0 2024-03-04T09:37:39.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/629: creat d1/d28/d6a/fca x:0 0 0 2024-03-04T09:37:39.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/767: write d5/d2c/d51/fad [317279,14030] 0 2024-03-04T09:37:39.922 INFO:tasks.workunit.client.0.smithi046.stdout:5/696: write d1/d44/d81/d96/d20/d76/d6c/db2/f7c [4310054,86484] 0 2024-03-04T09:37:39.954 INFO:tasks.workunit.client.0.smithi046.stdout:5/697: write d1/f36 [3196884,76912] 0 2024-03-04T09:37:40.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/854: mknod da/d14/d1e/d27/d78/df5/c136 0 2024-03-04T09:37:40.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/855: dread - da/d14/d1e/d27/d78/f5f zero size 2024-03-04T09:37:40.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/721: mkdir d7/de/d28/dab/d3c/da5/def 0 2024-03-04T09:37:40.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/722: chown d7/de/d28/dab/d3c/da5/fb9 393 1 2024-03-04T09:37:40.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/723: dwrite d7/f46 [0,4194304] 0 2024-03-04T09:37:40.439 INFO:tasks.workunit.client.0.smithi046.stdout:8/724: dwrite d7/de/d28/fe8 [0,4194304] 0 2024-03-04T09:37:41.096 INFO:tasks.workunit.client.0.smithi046.stdout:0/757: rename d10/f45 to d10/d12/d52/d78/d8a/da2/f10c 0 2024-03-04T09:37:41.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/768: mknod d5/da/dbc/cfb 0 2024-03-04T09:37:41.198 INFO:tasks.workunit.client.0.smithi046.stdout:6/856: mkdir da/d14/d1e/d137 0 2024-03-04T09:37:41.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/758: mkdir d10/d36/d7a/dfc/d10d 0 2024-03-04T09:37:41.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/630: rename d1/d92/d96/lc2 to d1/d28/d6f/db7/lcb 0 2024-03-04T09:37:41.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/784: mkdir d0/d125 0 2024-03-04T09:37:41.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/785: fdatasync d0/d1f/f45 0 2024-03-04T09:37:41.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/857: fdatasync da/d14/d17/dd3/df3/f12c 0 2024-03-04T09:37:41.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/858: fdatasync da/d14/d1e/d27/d78/d66/faa 0 2024-03-04T09:37:41.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/859: fsync f5 0 2024-03-04T09:37:42.128 INFO:tasks.workunit.client.0.smithi046.stdout:0/759: mknod d10/dd5/c10e 0 2024-03-04T09:37:43.279 INFO:tasks.workunit.client.0.smithi046.stdout:8/725: rename d7/d53/d72/fb0 to d7/d53/d72/d93/dd7/dc9/ddc/ff0 0 2024-03-04T09:37:43.279 INFO:tasks.workunit.client.0.smithi046.stdout:1/631: mkdir d1/d28/d6f/dbe/dcc 0 2024-03-04T09:37:43.279 INFO:tasks.workunit.client.0.smithi046.stdout:8/726: write d7/de/d4c/d50/f6e [1383231,894] 0 2024-03-04T09:37:43.279 INFO:tasks.workunit.client.0.smithi046.stdout:8/727: creat d7/de/d28/d3a/d7d/ff1 x:0 0 0 2024-03-04T09:37:43.279 INFO:tasks.workunit.client.0.smithi046.stdout:8/728: creat d7/de/d12/ff2 x:0 0 0 2024-03-04T09:37:43.303 INFO:tasks.workunit.client.0.smithi046.stdout:8/729: dread d7/de/d28/dab/d2c/d62/f8d [0,4194304] 0 2024-03-04T09:37:43.310 INFO:tasks.workunit.client.0.smithi046.stdout:4/786: creat d0/d1f/d25/da6/f126 x:0 0 0 2024-03-04T09:37:43.329 INFO:tasks.workunit.client.0.smithi046.stdout:4/787: dread d0/d3/fc2 [0,4194304] 0 2024-03-04T09:37:43.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/698: rename d1/d44/d81/d8e/d63 to d1/d44/d81/d8e/dd3 0 2024-03-04T09:37:43.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/699: write d1/f82 [1745057,78615] 0 2024-03-04T09:37:44.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/860: mknod da/d14/d1e/d8f/c138 0 2024-03-04T09:37:44.279 INFO:tasks.workunit.client.0.smithi046.stdout:0/760: mknod d10/d12/d52/d5d/c10f 0 2024-03-04T09:37:44.452 INFO:tasks.workunit.client.0.smithi046.stdout:1/632: creat d1/d28/d6f/db7/fcd x:0 0 0 2024-03-04T09:37:44.627 INFO:tasks.workunit.client.0.smithi046.stdout:8/730: symlink d7/de/d28/dab/d2c/d64/lf3 0 2024-03-04T09:37:44.750 INFO:tasks.workunit.client.0.smithi046.stdout:4/788: mkdir d0/d1f/db9/ddd/d127 0 2024-03-04T09:37:44.906 INFO:tasks.workunit.client.0.smithi046.stdout:9/819: write d1/d11/d6/d8/d13/f24 [2942610,84678] 0 2024-03-04T09:37:45.133 INFO:tasks.workunit.client.0.smithi046.stdout:6/861: mknod da/d14/d1e/d8f/ddf/d103/c139 0 2024-03-04T09:37:45.767 INFO:tasks.workunit.client.0.smithi046.stdout:2/769: creat d5/d84/ffc x:0 0 0 2024-03-04T09:37:45.833 INFO:tasks.workunit.client.0.smithi046.stdout:8/731: rename d7/de/d28/d36/d7c/d89/ld3 to d7/d53/d72/d93/dd7/dc9/lf4 0 2024-03-04T09:37:45.907 INFO:tasks.workunit.client.0.smithi046.stdout:8/732: dwrite d7/de/d28/f37 [4194304,4194304] 0 2024-03-04T09:37:45.945 INFO:tasks.workunit.client.0.smithi046.stdout:8/733: dread d7/de/d4c/d50/fed [0,4194304] 0 2024-03-04T09:37:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:4/789: link d0/d1f/d25/d50/d119/d1e/cf4 d0/d1f/d25/d50/d119/d1e/da1/dcc/c128 0 2024-03-04T09:37:46.076 INFO:tasks.workunit.client.0.smithi046.stdout:5/700: creat d1/d44/d81/d96/d54/fd4 x:0 0 0 2024-03-04T09:37:46.396 INFO:tasks.workunit.client.0.smithi046.stdout:3/850: mkdir d1/d1d/d27/d135 0 2024-03-04T09:37:46.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/820: rename d1/d11/d6/ccc to d1/d11/d6/d8/d12/d1c/d26/dae/c104 0 2024-03-04T09:37:46.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/821: dread - d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/daf/fd2 zero size 2024-03-04T09:37:46.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/770: truncate d5/da/f23 519301 0 2024-03-04T09:37:47.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/734: readlink d7/de/d28/dab/d3c/l66 0 2024-03-04T09:37:47.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/790: getdents d0/d3/d20/d96/d6e/d85/da7 0 2024-03-04T09:37:47.105 INFO:tasks.workunit.client.0.smithi046.stdout:8/735: dwrite d7/de/d3e/da1/fa6 [0,4194304] 0 2024-03-04T09:37:47.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/701: creat d1/d44/d57/d70/fd5 x:0 0 0 2024-03-04T09:37:47.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/702: getdents d1/d44/d81/d96/d20/d76/d6c/db2/dcb 0 2024-03-04T09:37:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:3/851: rmdir d1/d1d/d27/d4a/d78/de0 39 2024-03-04T09:37:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/852: write d1/d1d/d27/f119 [57890,98618] 0 2024-03-04T09:37:47.683 INFO:tasks.workunit.client.0.smithi046.stdout:6/862: rename da/d14/d17/dd3/f117 to da/dd/d46/f13a 0 2024-03-04T09:37:47.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/771: rmdir d5/d84/d9a 39 2024-03-04T09:37:47.979 INFO:tasks.workunit.client.0.smithi046.stdout:2/772: read d5/d84/d88/d3f/f41 [3550348,122111] 0 2024-03-04T09:37:48.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/773: read d5/d38/f85 [3973437,4577] 0 2024-03-04T09:37:48.334 INFO:tasks.workunit.client.0.smithi046.stdout:4/791: getdents d0/d1f 0 2024-03-04T09:37:48.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/736: link d7/de/d28/dab/d3c/fb1 d7/de/d28/ff5 0 2024-03-04T09:37:48.597 INFO:tasks.workunit.client.0.smithi046.stdout:5/703: symlink d1/d44/d69/dcd/ld6 0 2024-03-04T09:37:49.314 INFO:tasks.workunit.client.0.smithi046.stdout:3/853: unlink d1/f1e 0 2024-03-04T09:37:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:6/863: rmdir da/d14/d1e/d8f 39 2024-03-04T09:37:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:2/774: mknod d5/d84/d88/cfd 0 2024-03-04T09:37:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:6/864: write da/dd/d39/d60/da0/d67/dcf/f127 [982045,40739] 0 2024-03-04T09:37:49.756 INFO:tasks.workunit.client.0.smithi046.stdout:4/792: link d0/d1f/d25/fc6 d0/d5f/d124/f129 0 2024-03-04T09:37:49.756 INFO:tasks.workunit.client.0.smithi046.stdout:4/793: fdatasync d0/d1f/d25/d7b/f110 0 2024-03-04T09:37:49.756 INFO:tasks.workunit.client.0.smithi046.stdout:4/794: dread - d0/d3/d20/d96/d6e/f81 zero size 2024-03-04T09:37:49.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/795: dread d0/d1f/d25/d50/fae [0,4194304] 0 2024-03-04T09:37:49.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/796: dread - d0/d5f/d6f/ff1 zero size 2024-03-04T09:37:50.531 INFO:tasks.workunit.client.0.smithi046.stdout:3/854: symlink d1/d1d/d27/d4a/d78/de0/l136 0 2024-03-04T09:37:50.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/737: rename d7/de/d4c/l6c to d7/de/d4c/d50/lf6 0 2024-03-04T09:37:50.999 INFO:tasks.workunit.client.0.smithi046.stdout:8/738: dwrite d7/de/f7b [0,4194304] 0 2024-03-04T09:37:50.999 INFO:tasks.workunit.client.0.smithi046.stdout:8/739: dread - d7/d53/fe9 zero size 2024-03-04T09:37:51.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/855: mkdir d1/d1d/d27/d40/d76/dfd/d137 0 2024-03-04T09:37:51.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/856: chown d1/d21/d35/d43/dd2/d51/da3/fcc 120723 1 2024-03-04T09:37:51.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/857: readlink d1/d1d/d27/d4a/d78/de0/l136 0 2024-03-04T09:37:51.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/858: chown d1/d1d/d27/d40/d76/d8d/d95/dcf/ff3 14 1 2024-03-04T09:37:51.518 INFO:tasks.workunit.client.0.smithi046.stdout:3/859: write d1/d21/d35/d43/f62 [3017377,23870] 0 2024-03-04T09:37:51.518 INFO:tasks.workunit.client.0.smithi046.stdout:3/860: write d1/d1d/d27/d40/d92/f10d [560609,24448] 0 2024-03-04T09:37:51.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/681: sync 2024-03-04T09:37:51.850 INFO:tasks.workunit.client.0.smithi046.stdout:8/740: link d7/de/d28/dab/d3c/lde d7/de/d12/da9/lf7 0 2024-03-04T09:37:51.885 INFO:tasks.workunit.client.0.smithi046.stdout:8/741: write d7/de/d28/dab/f38 [2521065,6658] 0 2024-03-04T09:37:52.156 INFO:tasks.workunit.client.0.smithi046.stdout:3/861: dread d1/d21/d26/f30 [0,4194304] 0 2024-03-04T09:37:52.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/775: getdents d5/d84/d88/d99 0 2024-03-04T09:37:52.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/776: chown d5/da/l26 331645 1 2024-03-04T09:37:52.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:37:52.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:37:52.301 INFO:tasks.workunit.client.0.smithi046.stdout:7/682: creat d0/d4/db/d38/d94/fe8 x:0 0 0 2024-03-04T09:37:52.570 INFO:tasks.workunit.client.0.smithi046.stdout:8/742: mkdir d7/de/d28/dab/d3c/da5/df8 0 2024-03-04T09:37:53.056 INFO:tasks.workunit.client.0.smithi046.stdout:5/704: rmdir d1/d44/d81/d96/d20/d76/d6c/d7b 39 2024-03-04T09:37:53.056 INFO:tasks.workunit.client.0.smithi046.stdout:5/705: truncate d1/d44/d81/d8e/dd3/fcc 894276 0 2024-03-04T09:37:53.305 INFO:tasks.workunit.client.0.smithi046.stdout:9/822: write d1/d11/fac [557281,2871] 0 2024-03-04T09:37:53.605 INFO:tasks.workunit.client.0.smithi046.stdout:6/865: rename da/d4e/d98 to da/dd/d39/d60/da0/d67/d64/d82/d13b 0 2024-03-04T09:37:53.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/683: unlink d0/d4/db/d12/f75 0 2024-03-04T09:37:53.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/743: stat d7/de/d28/dab/d2c/d62/l7f 0 2024-03-04T09:37:53.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/684: write d0/d4/d6e/fb6 [284820,11079] 0 2024-03-04T09:37:53.625 INFO:tasks.workunit.client.0.smithi046.stdout:9/823: mknod d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/c105 0 2024-03-04T09:37:54.303 INFO:tasks.workunit.client.0.smithi046.stdout:4/797: rename d0/d1f/d25/d50/ddb/ffb to d0/d1f/de8/f12a 0 2024-03-04T09:37:54.334 INFO:tasks.workunit.client.0.smithi046.stdout:6/866: truncate f9 3899980 0 2024-03-04T09:37:54.370 INFO:tasks.workunit.client.0.smithi046.stdout:6/867: dread da/dd/d39/d60/da0/f62 [0,4194304] 0 2024-03-04T09:37:54.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/685: creat d0/da/d46/d99/de2/de3/fe9 x:0 0 0 2024-03-04T09:37:54.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/686: chown d0/da/d46/d99/de2/db1/dc8 20 1 2024-03-04T09:37:54.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/744: creat d7/de/d28/d3a/d6f/ff9 x:0 0 0 2024-03-04T09:37:54.813 INFO:tasks.workunit.client.0.smithi046.stdout:8/745: dwrite d7/de/d12/fb7 [4194304,4194304] 0 2024-03-04T09:37:54.813 INFO:tasks.workunit.client.0.smithi046.stdout:8/746: chown d7/d53/la0 1556 1 2024-03-04T09:37:54.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/824: symlink d1/d11/d6/d8/d6f/l106 0 2024-03-04T09:37:55.023 INFO:tasks.workunit.client.0.smithi046.stdout:0/761: creat d10/d12/f110 x:0 0 0 2024-03-04T09:37:55.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/762: fdatasync d10/d12/d9a/fe5 0 2024-03-04T09:37:55.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/825: dwrite d1/d11/d6/d8/d13/d21/f69 [4194304,4194304] 0 2024-03-04T09:37:55.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/826: truncate d1/d11/d6/d8/d12/f103 999239 0 2024-03-04T09:37:55.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/827: write d1/d11/d6/d8/d1d/d34/d35/f90 [8936797,100571] 0 2024-03-04T09:37:55.078 INFO:tasks.workunit.client.0.smithi046.stdout:9/828: write d1/d11/d6/d8/d12/d1c/dd1/fce [3132819,114045] 0 2024-03-04T09:37:55.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/777: rename d5/d40/d5a/l7d to d5/d84/d88/d99/daa/lfe 0 2024-03-04T09:37:55.430 INFO:tasks.workunit.client.0.smithi046.stdout:4/798: unlink d0/d1f/d25/d50/d119/d1e/cac 0 2024-03-04T09:37:55.853 INFO:tasks.workunit.client.0.smithi046.stdout:7/687: symlink d0/da/d46/d99/lea 0 2024-03-04T09:37:55.861 INFO:tasks.workunit.client.0.smithi046.stdout:6/868: read da/f32 [542630,53534] 0 2024-03-04T09:37:55.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/688: dwrite d0/d4/db/d12/dc1/faa [0,4194304] 0 2024-03-04T09:37:55.928 INFO:tasks.workunit.client.0.smithi046.stdout:7/689: chown d0/c18 1703379 1 2024-03-04T09:37:55.928 INFO:tasks.workunit.client.0.smithi046.stdout:7/690: creat d0/da/d41/feb x:0 0 0 2024-03-04T09:37:56.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/829: stat d1/d11/d6/d8/lbd 0 2024-03-04T09:37:56.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/778: write d5/d84/d88/d47/f98 [734241,127704] 0 2024-03-04T09:37:56.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/799: symlink d0/d1f/d35/l12b 0 2024-03-04T09:37:56.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/800: dread - d0/d3/d20/d96/d6e/fe2 zero size 2024-03-04T09:37:56.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/801: chown d0/d1f/d25/cec 438032088 1 2024-03-04T09:37:56.764 INFO:tasks.workunit.client.0.smithi046.stdout:4/802: dread d0/f56 [0,4194304] 0 2024-03-04T09:37:56.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/803: readlink d0/d1f/d25/d50/lc8 0 2024-03-04T09:37:56.815 INFO:tasks.workunit.client.0.smithi046.stdout:6/869: mknod da/dd/d22/d12b/db2/d124/c13c 0 2024-03-04T09:37:56.845 INFO:tasks.workunit.client.0.smithi046.stdout:6/870: read da/dd/d39/d60/dac/daf/d11d/f11c [2224018,24384] 0 2024-03-04T09:37:56.845 INFO:tasks.workunit.client.0.smithi046.stdout:6/871: stat da/d14/d1e/d8f/ddf/d103 0 2024-03-04T09:37:56.887 INFO:tasks.workunit.client.0.smithi046.stdout:6/872: dread da/dd/d39/d60/d7e/f119 [4194304,4194304] 0 2024-03-04T09:37:57.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/830: getdents d1/d11 0 2024-03-04T09:37:57.215 INFO:tasks.workunit.client.0.smithi046.stdout:9/831: write d1/d11/d6/d8/d12/d1c/dd1/fce [4696493,29098] 0 2024-03-04T09:37:57.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/804: creat d0/d1f/d25/d50/d119/d1e/da1/dcc/d122/f12c x:0 0 0 2024-03-04T09:37:57.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/805: fdatasync d0/d1f/db9/ddd/d114/f11d 0 2024-03-04T09:37:57.597 INFO:tasks.workunit.client.0.smithi046.stdout:4/806: dwrite d0/d1f/d25/d50/d119/d1e/f36 [4194304,4194304] 0 2024-03-04T09:37:57.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/873: dread da/dd/d39/d60/f71 [0,4194304] 0 2024-03-04T09:37:57.823 INFO:tasks.workunit.client.0.smithi046.stdout:6/874: write da/d14/d1e/d27/d78/d66/d81/f93 [2360126,98383] 0 2024-03-04T09:37:57.824 INFO:tasks.workunit.client.0.smithi046.stdout:6/875: write da/d14/d1e/d2c/f35 [4795134,19826] 0 2024-03-04T09:37:57.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/779: truncate d5/d84/d88/d3f/f45 186163 0 2024-03-04T09:37:58.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/807: creat d0/d1f/d25/d50/d119/d1e/da1/d10b/f12d x:0 0 0 2024-03-04T09:37:58.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/876: creat da/dd/d39/d60/da0/d67/d64/d56/d86/f13d x:0 0 0 2024-03-04T09:37:59.038 INFO:tasks.workunit.client.0.smithi046.stdout:2/780: link d5/d2c/d51/d7f/fe8 d5/d40/d5a/fff 0 2024-03-04T09:37:59.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/877: rename da/dd/d39/d60/da0/d67/d64/c50 to da/dd/d39/d60/da0/d67/c13e 0 2024-03-04T09:37:59.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/878: fdatasync da/dd/d22/d12b/f6f 0 2024-03-04T09:38:00.406 INFO:tasks.workunit.client.0.smithi046.stdout:6/879: symlink da/dd/d22/d12b/l13f 0 2024-03-04T09:38:00.406 INFO:tasks.workunit.client.0.smithi046.stdout:6/880: write da/d14/d1e/d27/d78/d66/d81/f100 [193722,31659] 0 2024-03-04T09:38:00.452 INFO:tasks.workunit.client.0.smithi046.stdout:6/881: dwrite da/dd/d46/fd0 [0,4194304] 0 2024-03-04T09:38:00.452 INFO:tasks.workunit.client.0.smithi046.stdout:6/882: fdatasync da/d14/d1e/fb6 0 2024-03-04T09:38:00.452 INFO:tasks.workunit.client.0.smithi046.stdout:6/883: dread - da/d14/d17/f134 zero size 2024-03-04T09:38:00.896 INFO:tasks.workunit.client.0.smithi046.stdout:1/633: sync 2024-03-04T09:38:00.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/862: sync 2024-03-04T09:38:00.896 INFO:tasks.workunit.client.0.smithi046.stdout:1/634: chown d1/f23 11 1 2024-03-04T09:38:00.998 INFO:tasks.workunit.client.0.smithi046.stdout:5/706: write d1/d44/d81/d8e/f33 [11375,41989] 0 2024-03-04T09:38:01.037 INFO:tasks.workunit.client.0.smithi046.stdout:8/747: dwrite d7/de/d28/d3a/fe3 [0,4194304] 0 2024-03-04T09:38:01.039 INFO:tasks.workunit.client.0.smithi046.stdout:4/808: rmdir d0/d1f/d35 39 2024-03-04T09:38:01.040 INFO:tasks.workunit.client.0.smithi046.stdout:4/809: readlink d0/d1f/d25/d50/d119/l12 0 2024-03-04T09:38:01.110 INFO:tasks.workunit.client.0.smithi046.stdout:0/763: dwrite d10/d12/d52/d78/d8a/da2/fa9 [0,4194304] 0 2024-03-04T09:38:01.110 INFO:tasks.workunit.client.0.smithi046.stdout:0/764: chown d10/d12/l55 472637 1 2024-03-04T09:38:01.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/748: dwrite d7/de/d28/dab/d3c/da5/fb9 [4194304,4194304] 0 2024-03-04T09:38:01.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/749: chown d7/de/d28/cbe 12206 1 2024-03-04T09:38:01.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/765: dread d10/d12/d52/d78/d8a/da2/fa9 [0,4194304] 0 2024-03-04T09:38:01.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/766: read d10/d12/d52/d5d/f69 [49942,44225] 0 2024-03-04T09:38:01.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/767: fsync d10/d12/d9f/fd4 0 2024-03-04T09:38:01.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/750: dread d7/de/d28/fe8 [0,4194304] 0 2024-03-04T09:38:01.149 INFO:tasks.workunit.client.0.smithi046.stdout:0/768: dread d10/d12/d1f/d3f/f65 [0,4194304] 0 2024-03-04T09:38:01.150 INFO:tasks.workunit.client.0.smithi046.stdout:0/769: write d10/d12/d6e/d99/fa8 [341845,74121] 0 2024-03-04T09:38:01.429 INFO:tasks.workunit.client.0.smithi046.stdout:6/884: truncate da/f3a 4435685 0 2024-03-04T09:38:01.429 INFO:tasks.workunit.client.0.smithi046.stdout:2/781: rename d5/da/fbe to d5/da/f100 0 2024-03-04T09:38:01.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/691: write d0/da/d46/d99/fb8 [1210312,130236] 0 2024-03-04T09:38:01.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/692: chown d0/d2d/cca 29278556 1 2024-03-04T09:38:01.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/693: creat d0/d4/db/d38/d94/fec x:0 0 0 2024-03-04T09:38:01.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/694: creat d0/da/d46/fed x:0 0 0 2024-03-04T09:38:01.452 INFO:tasks.workunit.client.0.smithi046.stdout:6/885: dread da/dd/d22/d12b/d94/fbe [0,4194304] 0 2024-03-04T09:38:01.454 INFO:tasks.workunit.client.0.smithi046.stdout:2/782: write d5/f9d [403412,121915] 0 2024-03-04T09:38:01.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/783: write d5/d40/dde/fdb [204970,50989] 0 2024-03-04T09:38:02.260 INFO:tasks.workunit.client.0.smithi046.stdout:5/707: mknod d1/d44/d81/d8e/dd3/cd7 0 2024-03-04T09:38:02.260 INFO:tasks.workunit.client.0.smithi046.stdout:5/708: rename d1 to d1/d44/d81/d96/dd8 22 2024-03-04T09:38:02.530 INFO:tasks.workunit.client.0.smithi046.stdout:4/810: symlink d0/d8e/l12e 0 2024-03-04T09:38:03.085 INFO:tasks.workunit.client.0.smithi046.stdout:9/832: truncate d1/d11/d6/d8/d12/f103 325991 0 2024-03-04T09:38:03.136 INFO:tasks.workunit.client.0.smithi046.stdout:9/833: dwrite d1/d11/d6/d8/d6f/d8c/d9a/ddc/f101 [0,4194304] 0 2024-03-04T09:38:03.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/834: dwrite d1/d11/d6/d8/d12/d1c/dd1/f5f [8388608,4194304] 0 2024-03-04T09:38:03.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/751: truncate d7/de/d4c/d50/f85 200443 0 2024-03-04T09:38:03.292 INFO:tasks.workunit.client.0.smithi046.stdout:8/752: read d7/f46 [2555930,26953] 0 2024-03-04T09:38:03.761 INFO:tasks.workunit.client.0.smithi046.stdout:7/695: symlink d0/da/d46/lee 0 2024-03-04T09:38:03.883 INFO:tasks.workunit.client.0.smithi046.stdout:6/886: mkdir da/d14/d1e/d27/d78/d66/d11f/d140 0 2024-03-04T09:38:04.662 INFO:tasks.workunit.client.0.smithi046.stdout:4/811: symlink d0/d5f/l12f 0 2024-03-04T09:38:04.745 INFO:tasks.workunit.client.0.smithi046.stdout:4/812: dwrite d0/d3/d20/d96/d6e/d85/da7/fd3 [0,4194304] 0 2024-03-04T09:38:04.826 INFO:tasks.workunit.client.0.smithi046.stdout:4/813: dwrite d0/d1f/d25/d50/d119/d1e/da1/dc1/f117 [0,4194304] 0 2024-03-04T09:38:04.827 INFO:tasks.workunit.client.0.smithi046.stdout:4/814: dread - d0/d1f/db9/ddd/ff7 zero size 2024-03-04T09:38:05.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/835: dread d1/d11/d6/d8/d6f/f82 [0,4194304] 0 2024-03-04T09:38:05.699 INFO:tasks.workunit.client.0.smithi046.stdout:8/753: truncate d7/de/d12/fad 68980 0 2024-03-04T09:38:05.725 INFO:tasks.workunit.client.0.smithi046.stdout:8/754: dread d7/de/d3e/f49 [0,4194304] 0 2024-03-04T09:38:05.746 INFO:tasks.workunit.client.0.smithi046.stdout:8/755: dread d7/de/d28/dab/d3c/f9c [0,4194304] 0 2024-03-04T09:38:05.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/696: truncate d0/d4/db/d3b/f9e 1986476 0 2024-03-04T09:38:05.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/697: fdatasync d0/d4/db/d12/d28/fb3 0 2024-03-04T09:38:05.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/698: chown d0/d4/db/d12/c22 47347778 1 2024-03-04T09:38:05.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/699: fdatasync d0/f16 0 2024-03-04T09:38:05.906 INFO:tasks.workunit.client.0.smithi046.stdout:6/887: mkdir da/dd8/d141 0 2024-03-04T09:38:05.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/888: read da/dd/d46/fd0 [3170633,105686] 0 2024-03-04T09:38:06.276 INFO:tasks.workunit.client.0.smithi046.stdout:4/815: rename d0/d3/d20/d96/d6e/d85/l87 to d0/d3/d20/d96/d6e/d85/da7/l130 0 2024-03-04T09:38:06.276 INFO:tasks.workunit.client.0.smithi046.stdout:4/816: creat d0/d3/d3b/d9d/f131 x:0 0 0 2024-03-04T09:38:06.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/817: read d0/d3/f6 [1464798,110980] 0 2024-03-04T09:38:06.424 INFO:tasks.workunit.client.0.smithi046.stdout:9/836: unlink d1/d11/d6/d8/d12/d1c/f38 0 2024-03-04T09:38:06.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/837: dwrite d1/d11/d6/d8/d1d/d34/d4d/d7e/ff9 [0,4194304] 0 2024-03-04T09:38:06.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/635: sync 2024-03-04T09:38:06.810 INFO:tasks.workunit.client.0.smithi046.stdout:3/863: sync 2024-03-04T09:38:07.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/889: link da/d14/d1e/d27/d78/df5/c136 da/d14/d17/dd3/c142 0 2024-03-04T09:38:07.412 INFO:tasks.workunit.client.0.smithi046.stdout:4/818: rmdir d0/d3/d20 39 2024-03-04T09:38:07.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/819: dwrite d0/d1f/d25/d50/d119/f66 [0,4194304] 0 2024-03-04T09:38:07.587 INFO:tasks.workunit.client.0.smithi046.stdout:9/838: creat d1/d11/d6/d8/d1d/d34/d4d/f107 x:0 0 0 2024-03-04T09:38:07.588 INFO:tasks.workunit.client.0.smithi046.stdout:3/864: unlink d1/d74/fbf 0 2024-03-04T09:38:07.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/839: write d1/d11/d6/d8/d1d/d34/d4d/f107 [656016,109243] 0 2024-03-04T09:38:07.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/840: readlink d1/d11/d6/d8/d1d/d34/ld4 0 2024-03-04T09:38:07.708 INFO:tasks.workunit.client.0.smithi046.stdout:6/890: truncate da/dd/d39/d60/da0/ddd/f101 58947 0 2024-03-04T09:38:07.731 INFO:tasks.workunit.client.0.smithi046.stdout:6/891: dread da/dd/d39/fb7 [0,4194304] 0 2024-03-04T09:38:08.221 INFO:tasks.workunit.client.0.smithi046.stdout:8/756: creat d7/de/d4c/ffa x:0 0 0 2024-03-04T09:38:08.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/820: symlink d0/d1f/db9/ddd/l132 0 2024-03-04T09:38:08.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/865: getdents d1/d21 0 2024-03-04T09:38:08.774 INFO:tasks.workunit.client.0.smithi046.stdout:8/757: mknod d7/de/d28/dab/d2c/d62/ddb/cfb 0 2024-03-04T09:38:08.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/784: dwrite d5/d84/d88/d3f/f41 [0,4194304] 0 2024-03-04T09:38:09.135 INFO:tasks.workunit.client.0.smithi046.stdout:5/709: sync 2024-03-04T09:38:09.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/785: fdatasync d5/d84/d88/f3e 0 2024-03-04T09:38:09.838 INFO:tasks.workunit.client.0.smithi046.stdout:2/786: rmdir d5/d84/d88 39 2024-03-04T09:38:09.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/710: creat d1/d44/d57/d70/da6/fd9 x:0 0 0 2024-03-04T09:38:09.938 INFO:tasks.workunit.client.0.smithi046.stdout:0/770: write d10/d12/f81 [457643,105983] 0 2024-03-04T09:38:09.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/771: dread d10/d12/d52/f8c [0,4194304] 0 2024-03-04T09:38:09.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/772: write d10/d12/d52/f108 [878920,98302] 0 2024-03-04T09:38:10.052 INFO:tasks.workunit.client.0.smithi046.stdout:5/711: dwrite d1/d44/d81/fb5 [4194304,4194304] 0 2024-03-04T09:38:10.052 INFO:tasks.workunit.client.0.smithi046.stdout:5/712: chown d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/cc2 0 1 2024-03-04T09:38:10.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/787: symlink d5/d84/d88/d3f/dd3/l101 0 2024-03-04T09:38:10.482 INFO:tasks.workunit.client.0.smithi046.stdout:8/758: read d7/de/d12/fad [44452,13088] 0 2024-03-04T09:38:10.505 INFO:tasks.workunit.client.0.smithi046.stdout:9/841: rename d1/d11/d6/d8/lbd to d1/d11/d6/d8/d13/d85/l108 0 2024-03-04T09:38:10.517 INFO:tasks.workunit.client.0.smithi046.stdout:7/700: dread d0/d4/db/f25 [0,4194304] 0 2024-03-04T09:38:10.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/788: dwrite d5/f9d [0,4194304] 0 2024-03-04T09:38:10.536 INFO:tasks.workunit.client.0.smithi046.stdout:2/789: chown d5/d84/d88/cfd 6735569 1 2024-03-04T09:38:10.536 INFO:tasks.workunit.client.0.smithi046.stdout:2/790: creat d5/da/dbd/f102 x:0 0 0 2024-03-04T09:38:10.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/713: mkdir d1/d44/d81/d96/d20/d76/d6c/dda 0 2024-03-04T09:38:10.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/714: dread - d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/f95 zero size 2024-03-04T09:38:10.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/715: write d1/d44/d81/d96/d20/d76/d6c/fc0 [921807,99956] 0 2024-03-04T09:38:10.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/759: dread d7/de/d4c/f98 [0,4194304] 0 2024-03-04T09:38:11.185 INFO:tasks.workunit.client.0.smithi046.stdout:4/821: rename d0/d5f/d6f/c7a to d0/d1f/db9/ddd/d114/c133 0 2024-03-04T09:38:11.745 INFO:tasks.workunit.client.0.smithi046.stdout:2/791: mknod d5/db9/c103 0 2024-03-04T09:38:11.745 INFO:tasks.workunit.client.0.smithi046.stdout:5/716: chown d1/d44/d81/d8e/f2e 2 1 2024-03-04T09:38:11.985 INFO:tasks.workunit.client.0.smithi046.stdout:1/636: sync 2024-03-04T09:38:12.165 INFO:tasks.workunit.client.0.smithi046.stdout:8/760: stat d7/de/d28/d36/l4b 0 2024-03-04T09:38:12.239 INFO:tasks.workunit.client.0.smithi046.stdout:8/761: dwrite d7/de/d28/dab/d3c/f95 [0,4194304] 0 2024-03-04T09:38:12.397 INFO:tasks.workunit.client.0.smithi046.stdout:4/822: link d0/d3/d20/d96/d6e/lc3 d0/d3/d20/d96/d6e/d85/l134 0 2024-03-04T09:38:12.421 INFO:tasks.workunit.client.0.smithi046.stdout:4/823: dread d0/d1f/f44 [0,4194304] 0 2024-03-04T09:38:12.486 INFO:tasks.workunit.client.0.smithi046.stdout:4/824: dwrite d0/d1f/d25/d7b/f92 [4194304,4194304] 0 2024-03-04T09:38:12.487 INFO:tasks.workunit.client.0.smithi046.stdout:4/825: chown d0/d3/f4 45945 1 2024-03-04T09:38:12.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/866: rename d1/d21/d26/f61 to d1/db0/f138 0 2024-03-04T09:38:12.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/867: chown d1/d74/f99 0 1 2024-03-04T09:38:13.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/792: creat d5/d38/d54/f104 x:0 0 0 2024-03-04T09:38:13.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/637: getdents d1 0 2024-03-04T09:38:13.389 INFO:tasks.workunit.client.0.smithi046.stdout:8/762: mkdir d7/de/d28/dab/dc1/dfc 0 2024-03-04T09:38:13.498 INFO:tasks.workunit.client.0.smithi046.stdout:8/763: dwrite d7/f4e [0,4194304] 0 2024-03-04T09:38:13.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/826: dread d0/d5f/d6f/f107 [0,4194304] 0 2024-03-04T09:38:13.790 INFO:tasks.workunit.client.0.smithi046.stdout:3/868: truncate d1/d1d/f6b 2785985 0 2024-03-04T09:38:13.851 INFO:tasks.workunit.client.0.smithi046.stdout:5/717: creat d1/d44/d81/d8e/dbe/fdb x:0 0 0 2024-03-04T09:38:14.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/793: mkdir d5/db9/d105 0 2024-03-04T09:38:14.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/638: unlink d1/l20 0 2024-03-04T09:38:15.318 INFO:tasks.workunit.client.0.smithi046.stdout:4/827: creat d0/d1f/d25/d50/d119/d1e/d73/f135 x:0 0 0 2024-03-04T09:38:15.414 INFO:tasks.workunit.client.0.smithi046.stdout:4/828: dwrite d0/d1f/fb6 [0,4194304] 0 2024-03-04T09:38:15.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/773: rename d10/d12/d52/d5d/fac to d10/d36/d7a/f111 0 2024-03-04T09:38:15.704 INFO:tasks.workunit.client.0.smithi046.stdout:0/774: dwrite d10/d12/d9a/ff6 [0,4194304] 0 2024-03-04T09:38:15.705 INFO:tasks.workunit.client.0.smithi046.stdout:0/775: write d10/d36/d87/ff0 [82699,86684] 0 2024-03-04T09:38:15.705 INFO:tasks.workunit.client.0.smithi046.stdout:0/776: chown d10/d12/d1f/d3f/d7e 1864739 1 2024-03-04T09:38:15.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/869: creat d1/d1d/d27/d40/d76/f139 x:0 0 0 2024-03-04T09:38:15.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/870: dread d1/d1d/d27/d40/d70/d105/fee [0,4194304] 0 2024-03-04T09:38:15.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/871: dwrite d1/fd3 [0,4194304] 0 2024-03-04T09:38:16.176 INFO:tasks.workunit.client.0.smithi046.stdout:9/842: creat d1/d11/d6/f109 x:0 0 0 2024-03-04T09:38:16.177 INFO:tasks.workunit.client.0.smithi046.stdout:9/843: write d1/ffa [725205,32792] 0 2024-03-04T09:38:17.091 INFO:tasks.workunit.client.0.smithi046.stdout:4/829: stat d0/d3/d20/d96/d6e/d85/l134 0 2024-03-04T09:38:17.091 INFO:tasks.workunit.client.0.smithi046.stdout:4/830: creat d0/d1f/db9/ddd/f136 x:0 0 0 2024-03-04T09:38:17.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/777: symlink d10/d12/d9a/dd8/l112 0 2024-03-04T09:38:17.743 INFO:tasks.workunit.client.0.smithi046.stdout:6/892: creat da/d14/d1e/f143 x:0 0 0 2024-03-04T09:38:17.743 INFO:tasks.workunit.client.0.smithi046.stdout:6/893: read - da/d14/d1e/d27/f133 zero size 2024-03-04T09:38:18.279 INFO:tasks.workunit.client.0.smithi046.stdout:1/639: dread d1/d28/f69 [0,4194304] 0 2024-03-04T09:38:18.568 INFO:tasks.workunit.client.0.smithi046.stdout:4/831: symlink d0/d1f/de8/l137 0 2024-03-04T09:38:18.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/832: fsync d0/d1f/f102 0 2024-03-04T09:38:18.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/833: dread - d0/d3/d3b/d9d/ff2 zero size 2024-03-04T09:38:18.669 INFO:tasks.workunit.client.0.smithi046.stdout:7/701: rename d0/da/d4e/f88 to d0/d4/db/d12/d28/fef 0 2024-03-04T09:38:18.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/794: unlink d5/d84/d88/f44 0 2024-03-04T09:38:18.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/795: write d5/da/f2b [587769,97778] 0 2024-03-04T09:38:18.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/796: chown d5/f4e 28 1 2024-03-04T09:38:18.914 INFO:tasks.workunit.client.0.smithi046.stdout:0/778: mknod d10/d12/d1f/d3f/d7e/c113 0 2024-03-04T09:38:19.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/894: mknod da/dd/d22/d12b/dab/ddc/c144 0 2024-03-04T09:38:19.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/895: dread da/dd/f36 [0,4194304] 0 2024-03-04T09:38:19.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/896: fdatasync da/d14/d1e/d27/d78/d66/fad 0 2024-03-04T09:38:19.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/897: fsync da/d14/d17/f134 0 2024-03-04T09:38:19.199 INFO:tasks.workunit.client.0.smithi046.stdout:6/898: dwrite da/dd/d39/d60/da0/d67/d64/d56/fb4 [0,4194304] 0 2024-03-04T09:38:19.225 INFO:tasks.workunit.client.0.smithi046.stdout:3/872: symlink d1/d21/d35/d2b/l13a 0 2024-03-04T09:38:19.548 INFO:tasks.workunit.client.0.smithi046.stdout:1/640: dread d1/f19 [0,4194304] 0 2024-03-04T09:38:19.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/834: creat d0/d1f/d25/d50/f138 x:0 0 0 2024-03-04T09:38:20.257 INFO:tasks.workunit.client.0.smithi046.stdout:8/764: rename d7/de/d28/d3a/d6f/dd0/fd8 to d7/de/d28/d3a/d7d/ffd 0 2024-03-04T09:38:20.376 INFO:tasks.workunit.client.0.smithi046.stdout:7/702: link d0/d4/db/cd0 d0/da/d46/d99/de2/db1/dc8/cf0 0 2024-03-04T09:38:20.519 INFO:tasks.workunit.client.0.smithi046.stdout:2/797: creat d5/d84/d88/d3f/dd3/f106 x:0 0 0 2024-03-04T09:38:20.632 INFO:tasks.workunit.client.0.smithi046.stdout:0/779: dread d10/d12/d1f/d3f/f66 [0,4194304] 0 2024-03-04T09:38:21.035 INFO:tasks.workunit.client.0.smithi046.stdout:1/641: chown d1/d92/la4 948652 1 2024-03-04T09:38:21.883 INFO:tasks.workunit.client.0.smithi046.stdout:7/703: link d0/c71 d0/d4/db/d38/dc0/cf1 0 2024-03-04T09:38:21.884 INFO:tasks.workunit.client.0.smithi046.stdout:2/798: link d5/ce d5/d2c/d51/dca/c107 0 2024-03-04T09:38:21.884 INFO:tasks.workunit.client.0.smithi046.stdout:2/799: readlink d5/d84/d88/d47/dcc/ld8 0 2024-03-04T09:38:21.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/704: dwrite d0/da/d46/d99/de2/f5b [0,4194304] 0 2024-03-04T09:38:21.996 INFO:tasks.workunit.client.0.smithi046.stdout:0/780: mknod d10/d12/d9f/da6/d10a/c114 0 2024-03-04T09:38:21.997 INFO:tasks.workunit.client.0.smithi046.stdout:3/873: link d1/d1d/d27/d40/d76/d8d/d95/lff d1/d1d/l13b 0 2024-03-04T09:38:21.997 INFO:tasks.workunit.client.0.smithi046.stdout:3/874: write d1/f20 [1944157,42096] 0 2024-03-04T09:38:22.011 INFO:tasks.workunit.client.0.smithi046.stdout:0/781: dread d10/d36/f76 [0,4194304] 0 2024-03-04T09:38:22.011 INFO:tasks.workunit.client.0.smithi046.stdout:0/782: chown d10/d12/d52/d78/l5a 13185 1 2024-03-04T09:38:22.012 INFO:tasks.workunit.client.0.smithi046.stdout:0/783: creat d10/d12/d1f/d3f/d4b/f115 x:0 0 0 2024-03-04T09:38:22.012 INFO:tasks.workunit.client.0.smithi046.stdout:0/784: chown d10/d12/d1f/d3b 12 1 2024-03-04T09:38:22.045 INFO:tasks.workunit.client.0.smithi046.stdout:7/705: dwrite d0/d4/db/d38/d94/fa8 [0,4194304] 0 2024-03-04T09:38:22.262 INFO:tasks.workunit.client.0.smithi046.stdout:1/642: dread d1/f49 [0,4194304] 0 2024-03-04T09:38:22.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/718: write d1/d44/d81/d96/f4c [4833862,1333] 0 2024-03-04T09:38:22.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/719: write d1/d44/d57/d70/fd5 [200545,58776] 0 2024-03-04T09:38:22.272 INFO:tasks.workunit.client.0.smithi046.stdout:5/720: chown d1/d44/d81/d96/d20/d76/d6c/db2/fc9 1963375329 1 2024-03-04T09:38:22.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/721: dread d1/f7f [0,4194304] 0 2024-03-04T09:38:22.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:38:22.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:38:22.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/875: creat d1/d1d/d27/d4a/d78/f13c x:0 0 0 2024-03-04T09:38:22.913 INFO:tasks.workunit.client.0.smithi046.stdout:0/785: mkdir d10/d12/d1f/d3b/def/d116 0 2024-03-04T09:38:23.173 INFO:tasks.workunit.client.0.smithi046.stdout:7/706: creat d0/da/d46/ff2 x:0 0 0 2024-03-04T09:38:23.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/643: dread d1/d92/f9b [0,4194304] 0 2024-03-04T09:38:23.239 INFO:tasks.workunit.client.0.smithi046.stdout:7/707: dwrite d0/d4/fd [4194304,4194304] 0 2024-03-04T09:38:23.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/876: link d1/d88/f9f d1/d74/f13d 0 2024-03-04T09:38:23.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/786: rmdir d10/d12/d1f/d3b 39 2024-03-04T09:38:23.506 INFO:tasks.workunit.client.0.smithi046.stdout:3/877: dread d1/d21/d35/d43/dd2/d51/da3/fae [0,4194304] 0 2024-03-04T09:38:23.506 INFO:tasks.workunit.client.0.smithi046.stdout:3/878: readlink d1/d1d/d27/d4a/l100 0 2024-03-04T09:38:23.834 INFO:tasks.workunit.client.0.smithi046.stdout:8/765: link d7/d53/d72/d93/fd5 d7/de/d28/ffe 0 2024-03-04T09:38:23.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/844: write d1/d11/d6/d8/d13/d21/f69 [3260097,123726] 0 2024-03-04T09:38:24.158 INFO:tasks.workunit.client.0.smithi046.stdout:1/644: creat d1/d28/fce x:0 0 0 2024-03-04T09:38:24.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/708: mkdir d0/d8f/df3 0 2024-03-04T09:38:24.250 INFO:tasks.workunit.client.0.smithi046.stdout:0/787: mknod d10/d36/d7a/dfc/c117 0 2024-03-04T09:38:24.250 INFO:tasks.workunit.client.0.smithi046.stdout:3/879: unlink d1/d1d/d27/d4a/lf6 0 2024-03-04T09:38:24.316 INFO:tasks.workunit.client.0.smithi046.stdout:0/788: dwrite d10/dd5/fe3 [0,4194304] 0 2024-03-04T09:38:24.317 INFO:tasks.workunit.client.0.smithi046.stdout:0/789: creat d10/d12/d52/d78/d8a/f118 x:0 0 0 2024-03-04T09:38:24.365 INFO:tasks.workunit.client.0.smithi046.stdout:8/766: mkdir d7/de/d4c/d50/dff 0 2024-03-04T09:38:25.078 INFO:tasks.workunit.client.0.smithi046.stdout:5/722: link d1/d44/d81/d96/d20/d76/d6c/d7b/l85 d1/d44/d81/d96/d9a/ldc 0 2024-03-04T09:38:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:7/709: creat d0/d4/db/d38/dc0/ff4 x:0 0 0 2024-03-04T09:38:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:7/710: readlink d0/d4/db/d12/d28/lb7 0 2024-03-04T09:38:25.692 INFO:tasks.workunit.client.0.smithi046.stdout:1/645: creat d1/d28/d8d/fcf x:0 0 0 2024-03-04T09:38:25.693 INFO:tasks.workunit.client.0.smithi046.stdout:3/880: creat d1/d21/d35/d127/f13e x:0 0 0 2024-03-04T09:38:26.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/790: symlink d10/d12/d52/d5d/l119 0 2024-03-04T09:38:26.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/791: write d10/d12/d9f/da6/fbb [737280,16286] 0 2024-03-04T09:38:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:0/792: dread f1 [0,4194304] 0 2024-03-04T09:38:26.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/767: creat d7/d53/d72/f100 x:0 0 0 2024-03-04T09:38:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/723: truncate d1/d44/d57/d70/da6/fd0 2095609 0 2024-03-04T09:38:27.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/711: unlink d0/d4/db/l91 0 2024-03-04T09:38:27.076 INFO:tasks.workunit.client.0.smithi046.stdout:1/646: dread d1/f48 [0,4194304] 0 2024-03-04T09:38:27.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/712: write d0/d4/d6e/fa0 [3509304,77649] 0 2024-03-04T09:38:27.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/713: creat d0/d4/db/d38/d7e/dc5/ff5 x:0 0 0 2024-03-04T09:38:27.088 INFO:tasks.workunit.client.0.smithi046.stdout:3/881: creat d1/d1d/d27/d40/d70/d7d/f13f x:0 0 0 2024-03-04T09:38:27.123 INFO:tasks.workunit.client.0.smithi046.stdout:8/768: unlink d7/de/d12/f59 0 2024-03-04T09:38:27.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/714: dwrite d0/d4/d40/f49 [0,4194304] 0 2024-03-04T09:38:27.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/715: chown d0/d4/d6e/f84 1651 1 2024-03-04T09:38:27.957 INFO:tasks.workunit.client.0.smithi046.stdout:1/647: unlink d1/f49 0 2024-03-04T09:38:28.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/800: dwrite d5/da/d1b/f4f [4194304,4194304] 0 2024-03-04T09:38:28.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/835: rename d0/d3/d20/d96/d6e/f81 to d0/d3/d20/d96/d6e/f139 0 2024-03-04T09:38:28.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/836: chown d0/l9 252563 1 2024-03-04T09:38:28.368 INFO:tasks.workunit.client.0.smithi046.stdout:4/837: dwrite d0/d3/fc2 [0,4194304] 0 2024-03-04T09:38:28.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/882: mknod d1/d21/d26/c140 0 2024-03-04T09:38:28.578 INFO:tasks.workunit.client.0.smithi046.stdout:8/769: link d7/de/d28/dab/d2c/fa3 d7/de/d28/dab/d2c/d62/f101 0 2024-03-04T09:38:28.578 INFO:tasks.workunit.client.0.smithi046.stdout:8/770: chown d7/de/d3e/f57 178275119 1 2024-03-04T09:38:28.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/716: truncate d0/d4/db/d12/dc1/f93 1617448 0 2024-03-04T09:38:28.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/717: fsync d0/da/d46/f5e 0 2024-03-04T09:38:28.930 INFO:tasks.workunit.client.0.smithi046.stdout:1/648: unlink d1/d28/d6f/d74/c87 0 2024-03-04T09:38:29.353 INFO:tasks.workunit.client.0.smithi046.stdout:3/883: truncate d1/d21/d26/f30 1201175 0 2024-03-04T09:38:29.384 INFO:tasks.workunit.client.0.smithi046.stdout:3/884: write d1/d1d/f7a [1802930,80940] 0 2024-03-04T09:38:29.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/885: dwrite d1/d21/d35/d127/f13e [0,4194304] 0 2024-03-04T09:38:29.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/886: dread - d1/d1d/d27/d40/d70/d7d/f108 zero size 2024-03-04T09:38:29.531 INFO:tasks.workunit.client.0.smithi046.stdout:8/771: mknod d7/de/d28/d36/d7c/d89/c102 0 2024-03-04T09:38:30.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/718: unlink d0/da/d4e/ccd 0 2024-03-04T09:38:30.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/719: chown d0/da/c21 11782 1 2024-03-04T09:38:30.825 INFO:tasks.workunit.client.0.smithi046.stdout:9/845: write d1/d11/d6/d8/d6f/f82 [3958161,63962] 0 2024-03-04T09:38:30.920 INFO:tasks.workunit.client.0.smithi046.stdout:3/887: mknod d1/d1d/d27/d4a/d78/c141 0 2024-03-04T09:38:31.141 INFO:tasks.workunit.client.0.smithi046.stdout:8/772: link d7/de/d28/dab/d2c/lc8 d7/de/d4c/de4/l103 0 2024-03-04T09:38:31.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/773: rmdir d7/de/d28/d3a/d6f/dd0 39 2024-03-04T09:38:31.903 INFO:tasks.workunit.client.0.smithi046.stdout:8/774: write d7/d53/fe9 [370404,83834] 0 2024-03-04T09:38:31.903 INFO:tasks.workunit.client.0.smithi046.stdout:8/775: stat d7/d53/d72/d93/dd7/dc9/ddc 0 2024-03-04T09:38:32.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/720: mkdir d0/d4/db/d12/d28/df6 0 2024-03-04T09:38:32.152 INFO:tasks.workunit.client.0.smithi046.stdout:8/776: creat d7/de/d28/dab/d2c/d64/dea/f104 x:0 0 0 2024-03-04T09:38:32.538 INFO:tasks.workunit.client.0.smithi046.stdout:2/801: unlink d5/f1d 0 2024-03-04T09:38:32.870 INFO:tasks.workunit.client.0.smithi046.stdout:2/802: symlink d5/d40/d5a/l108 0 2024-03-04T09:38:32.890 INFO:tasks.workunit.client.0.smithi046.stdout:2/803: write d5/d38/f76 [2379002,63043] 0 2024-03-04T09:38:33.064 INFO:tasks.workunit.client.0.smithi046.stdout:5/724: unlink d1/d44/d57/d70/da6/fd0 0 2024-03-04T09:38:33.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/721: mknod d0/d2d/d85/cf7 0 2024-03-04T09:38:33.064 INFO:tasks.workunit.client.0.smithi046.stdout:5/725: write d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/fa5 [725540,69504] 0 2024-03-04T09:38:33.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/804: creat d5/d84/d88/f109 x:0 0 0 2024-03-04T09:38:33.995 INFO:tasks.workunit.client.0.smithi046.stdout:5/726: mknod d1/d44/d81/d96/d20/cdd 0 2024-03-04T09:38:34.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/727: dwrite d1/d44/d81/d96/d20/d76/d6c/f8c [0,4194304] 0 2024-03-04T09:38:34.190 INFO:tasks.workunit.client.0.smithi046.stdout:2/805: mknod d5/d84/d7c/dd0/df4/c10a 0 2024-03-04T09:38:34.775 INFO:tasks.workunit.client.0.smithi046.stdout:5/728: mknod d1/d44/d81/d8e/dd3/cde 0 2024-03-04T09:38:35.062 INFO:tasks.workunit.client.0.smithi046.stdout:5/729: mkdir d1/d44/d81/d96/d20/d76/d6c/ddf 0 2024-03-04T09:38:35.479 INFO:tasks.workunit.client.0.smithi046.stdout:5/730: write d1/d44/d81/d8e/fac [55309,11413] 0 2024-03-04T09:38:35.864 INFO:tasks.workunit.client.0.smithi046.stdout:5/731: creat d1/d44/d81/d8e/dbe/fe0 x:0 0 0 2024-03-04T09:38:35.864 INFO:tasks.workunit.client.0.smithi046.stdout:5/732: chown d1/d44/d81/d96/d20/c25 254 1 2024-03-04T09:38:35.864 INFO:tasks.workunit.client.0.smithi046.stdout:5/733: truncate d1/d44/d81/d96/d20/d76/d6c/db2/f64 5132384 0 2024-03-04T09:38:35.892 INFO:tasks.workunit.client.0.smithi046.stdout:5/734: write d1/d44/d81/d96/d20/f42 [4531659,118090] 0 2024-03-04T09:38:35.892 INFO:tasks.workunit.client.0.smithi046.stdout:5/735: stat d1/d44/d81/d96/d20/d76/d6c/fc0 0 2024-03-04T09:38:35.979 INFO:tasks.workunit.client.0.smithi046.stdout:6/899: rename da/dd/f2a to da/dd/d39/d60/da0/d67/f145 0 2024-03-04T09:38:36.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/736: getdents d1/d44 0 2024-03-04T09:38:36.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/846: rename d1/d11/d6/d8/d12/d1c/f7b to d1/d11/d6/d8/d6f/d8c/d9a/ddc/f10a 0 2024-03-04T09:38:36.781 INFO:tasks.workunit.client.0.smithi046.stdout:6/900: rmdir da/dd/d22/d12b/dab/ddc 39 2024-03-04T09:38:36.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/737: truncate d1/f5 1311331 0 2024-03-04T09:38:36.819 INFO:tasks.workunit.client.0.smithi046.stdout:6/901: write da/dd/d39/d60/d7e/f119 [5856434,9399] 0 2024-03-04T09:38:36.826 INFO:tasks.workunit.client.0.smithi046.stdout:9/847: dwrite d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/daf/fd2 [0,4194304] 0 2024-03-04T09:38:36.826 INFO:tasks.workunit.client.0.smithi046.stdout:9/848: dread - d1/d11/d6/d8/d12/fe9 zero size 2024-03-04T09:38:36.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/902: write da/dd/d39/fdb [713365,39283] 0 2024-03-04T09:38:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:1/649: dwrite d1/d28/f6e [0,4194304] 0 2024-03-04T09:38:36.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/849: dwrite d1/d11/d6/d8/d12/d1c/ff6 [0,4194304] 0 2024-03-04T09:38:37.491 INFO:tasks.workunit.client.0.smithi046.stdout:7/722: rename d0/d4/db/d3b/d6b/fa7 to d0/da/d4e/ff8 0 2024-03-04T09:38:38.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/903: symlink da/d14/d1e/d27/da3/l146 0 2024-03-04T09:38:38.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/904: creat da/dd/d39/d60/da0/d67/d64/d82/f147 x:0 0 0 2024-03-04T09:38:39.702 INFO:tasks.workunit.client.0.smithi046.stdout:2/806: rename d5/da/f14 to d5/d2c/d51/d7f/d92/f10b 0 2024-03-04T09:38:39.702 INFO:tasks.workunit.client.0.smithi046.stdout:2/807: chown d5/da/f24 3 1 2024-03-04T09:38:40.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/905: creat da/d14/d1e/d8f/ddf/d103/d123/f148 x:0 0 0 2024-03-04T09:38:40.230 INFO:tasks.workunit.client.0.smithi046.stdout:6/906: dread da/dd/d39/fdb [0,4194304] 0 2024-03-04T09:38:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:2/808: rename d5/d38/d54/dda/cef to d5/d38/d54/c10c 0 2024-03-04T09:38:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:2/809: write d5/d40/d5a/fff [375279,81909] 0 2024-03-04T09:38:41.086 INFO:tasks.workunit.client.0.smithi046.stdout:3/888: sync 2024-03-04T09:38:41.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/838: sync 2024-03-04T09:38:41.086 INFO:tasks.workunit.client.0.smithi046.stdout:0/793: sync 2024-03-04T09:38:41.086 INFO:tasks.workunit.client.0.smithi046.stdout:3/889: creat d1/d1d/d27/d10f/f142 x:0 0 0 2024-03-04T09:38:41.154 INFO:tasks.workunit.client.0.smithi046.stdout:4/839: dwrite d0/d1f/d25/d7b/f92 [0,4194304] 0 2024-03-04T09:38:41.177 INFO:tasks.workunit.client.0.smithi046.stdout:0/794: dwrite d10/d36/f76 [0,4194304] 0 2024-03-04T09:38:41.308 INFO:tasks.workunit.client.0.smithi046.stdout:6/907: symlink da/l149 0 2024-03-04T09:38:41.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/908: write da/d14/d17/f134 [30169,98916] 0 2024-03-04T09:38:41.390 INFO:tasks.workunit.client.0.smithi046.stdout:6/909: dwrite da/d14/d1e/d2c/f35 [0,4194304] 0 2024-03-04T09:38:41.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/910: dwrite da/d14/d1e/d27/d78/d66/faa [0,4194304] 0 2024-03-04T09:38:41.802 INFO:tasks.workunit.client.0.smithi046.stdout:2/810: creat d5/d2c/d51/d61/f10d x:0 0 0 2024-03-04T09:38:41.830 INFO:tasks.workunit.client.0.smithi046.stdout:2/811: dread d5/f10 [0,4194304] 0 2024-03-04T09:38:41.831 INFO:tasks.workunit.client.0.smithi046.stdout:2/812: dread - d5/d84/d7c/fed zero size 2024-03-04T09:38:42.121 INFO:tasks.workunit.client.0.smithi046.stdout:4/840: symlink d0/d1f/d25/d7b/l13a 0 2024-03-04T09:38:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/738: dwrite d1/d44/d81/d96/d20/d76/d6c/d7b/f61 [0,4194304] 0 2024-03-04T09:38:42.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/739: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/f37 [0,4194304] 0 2024-03-04T09:38:42.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/795: getdents d10/d12/d1f/d3b/d6b 0 2024-03-04T09:38:42.563 INFO:tasks.workunit.client.0.smithi046.stdout:0/796: fdatasync d10/d36/d87/ff0 0 2024-03-04T09:38:42.563 INFO:tasks.workunit.client.0.smithi046.stdout:0/797: fsync d10/d12/d1f/ffa 0 2024-03-04T09:38:42.563 INFO:tasks.workunit.client.0.smithi046.stdout:0/798: fdatasync d10/d12/d1f/ffa 0 2024-03-04T09:38:42.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/799: dread d10/d12/fb3 [0,4194304] 0 2024-03-04T09:38:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/911: mknod da/d14/d1e/d27/c14a 0 2024-03-04T09:38:42.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/912: dread da/f32 [0,4194304] 0 2024-03-04T09:38:43.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/813: rmdir d5/da/d1b 39 2024-03-04T09:38:43.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/814: creat d5/da/dbd/f10e x:0 0 0 2024-03-04T09:38:43.129 INFO:tasks.workunit.client.0.smithi046.stdout:2/815: dread d5/f1f [0,4194304] 0 2024-03-04T09:38:43.178 INFO:tasks.workunit.client.0.smithi046.stdout:3/890: truncate d1/d21/d35/d24/f18 4568944 0 2024-03-04T09:38:43.178 INFO:tasks.workunit.client.0.smithi046.stdout:3/891: read - d1/db0/fc4 zero size 2024-03-04T09:38:43.347 INFO:tasks.workunit.client.0.smithi046.stdout:4/841: mkdir d0/d1f/d13b 0 2024-03-04T09:38:44.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/777: unlink d7/de/d28/fe8 0 2024-03-04T09:38:44.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/740: rmdir d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d 39 2024-03-04T09:38:44.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/778: fsync d7/de/d3e/f57 0 2024-03-04T09:38:44.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/779: stat d7/de/d12/da9/fc4 0 2024-03-04T09:38:44.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/800: creat d10/d12/d1f/d3b/d6b/f11a x:0 0 0 2024-03-04T09:38:44.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/913: mknod da/d14/d1e/d8f/ddf/c14b 0 2024-03-04T09:38:45.041 INFO:tasks.workunit.client.0.smithi046.stdout:2/816: mkdir d5/d84/d7c/d10f 0 2024-03-04T09:38:45.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/892: rmdir d1/d21/d35/d43/dd2 39 2024-03-04T09:38:45.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/893: readlink d1/d1d/d123/l12d 0 2024-03-04T09:38:45.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/894: creat d1/d1d/d27/d40/d76/dfd/f143 x:0 0 0 2024-03-04T09:38:45.356 INFO:tasks.workunit.client.0.smithi046.stdout:9/850: write d1/d11/d6/d8/d12/d1c/dd1/d5e/fcb [963773,41909] 0 2024-03-04T09:38:45.581 INFO:tasks.workunit.client.0.smithi046.stdout:4/842: mknod d0/d1f/c13c 0 2024-03-04T09:38:45.582 INFO:tasks.workunit.client.0.smithi046.stdout:8/780: rename d7/de/d28/f2e to d7/de/d28/dab/d3c/da5/df8/f105 0 2024-03-04T09:38:46.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/650: write d1/f68 [120547,92922] 0 2024-03-04T09:38:46.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/914: getdents da/dd/d22/d12b 0 2024-03-04T09:38:46.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/915: write da/dd/d39/d60/d7e/f119 [4892550,119344] 0 2024-03-04T09:38:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:3/895: dread - d1/d1d/d27/d40/d76/d8d/d95/f103 zero size 2024-03-04T09:38:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:3/896: dwrite d1/d21/d35/d127/f13e [0,4194304] 0 2024-03-04T09:38:46.964 INFO:tasks.workunit.client.0.smithi046.stdout:4/843: creat d0/d5f/f13d x:0 0 0 2024-03-04T09:38:47.457 INFO:tasks.workunit.client.0.smithi046.stdout:1/651: symlink d1/d92/d96/da7/ld0 0 2024-03-04T09:38:47.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/916: mkdir da/dd/d46/d14c 0 2024-03-04T09:38:47.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/917: write da/dd/d22/f70 [5031567,70848] 0 2024-03-04T09:38:47.848 INFO:tasks.workunit.client.0.smithi046.stdout:3/897: symlink d1/d21/d35/d24/l144 0 2024-03-04T09:38:47.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/844: creat d0/d3/d3b/d8d/f13e x:0 0 0 2024-03-04T09:38:47.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/845: chown d0/d8e/cca 2656 1 2024-03-04T09:38:48.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/846: dwrite d0/d1f/d25/d7b/f110 [0,4194304] 0 2024-03-04T09:38:48.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/847: truncate d0/d3/d20/fc9 592344 0 2024-03-04T09:38:48.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/848: fsync d0/d1f/d25/d50/df5/f10f 0 2024-03-04T09:38:48.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/849: unlink d0/d1f/d25/d50/d119/d1e/l10e 0 2024-03-04T09:38:48.606 INFO:tasks.workunit.client.0.smithi046.stdout:1/652: symlink d1/d28/d6f/db7/ld1 0 2024-03-04T09:38:48.606 INFO:tasks.workunit.client.0.smithi046.stdout:1/653: write d1/f68 [204837,55935] 0 2024-03-04T09:38:48.606 INFO:tasks.workunit.client.0.smithi046.stdout:4/850: write d0/d1f/f10c [640749,79443] 0 2024-03-04T09:38:48.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/851: write d0/d5f/d6f/f7f [588821,79411] 0 2024-03-04T09:38:48.628 INFO:tasks.workunit.client.0.smithi046.stdout:3/898: creat d1/d1d/d27/d4a/d78/de0/d107/d114/f145 x:0 0 0 2024-03-04T09:38:48.628 INFO:tasks.workunit.client.0.smithi046.stdout:3/899: stat d1/d1d/d27/d40/d70/fa8 0 2024-03-04T09:38:48.628 INFO:tasks.workunit.client.0.smithi046.stdout:3/900: chown d1/d21/d35/d24/ff0 6510 1 2024-03-04T09:38:48.809 INFO:tasks.workunit.client.0.smithi046.stdout:7/723: creat d0/d4/ff9 x:0 0 0 2024-03-04T09:38:49.451 INFO:tasks.workunit.client.0.smithi046.stdout:1/654: creat d1/fd2 x:0 0 0 2024-03-04T09:38:49.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/852: symlink d0/d1f/d25/d50/d119/d1e/da1/l13f 0 2024-03-04T09:38:49.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/853: chown d0/d1f/f4d 155432088 1 2024-03-04T09:38:50.232 INFO:tasks.workunit.client.0.smithi046.stdout:7/724: mkdir d0/da/d46/d99/de2/db1/dfa 0 2024-03-04T09:38:50.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/725: unlink d0/da/d46/f8b 0 2024-03-04T09:38:50.974 INFO:tasks.workunit.client.0.smithi046.stdout:0/801: write d10/d12/d52/d78/d8a/da2/fee [828256,42018] 0 2024-03-04T09:38:51.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/851: rmdir d1/d11 39 2024-03-04T09:38:51.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/852: readlink d1/d11/d6/d8/d12/d1c/dd1/d5e/l81 0 2024-03-04T09:38:51.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/726: symlink d0/da/d46/d99/de2/db1/lfb 0 2024-03-04T09:38:52.116 INFO:tasks.workunit.client.0.smithi046.stdout:0/802: rmdir d10/d12/d52/d78/d8a/da2 39 2024-03-04T09:38:52.116 INFO:tasks.workunit.client.0.smithi046.stdout:0/803: fdatasync f7 0 2024-03-04T09:38:52.116 INFO:tasks.workunit.client.0.smithi046.stdout:0/804: stat d10/d12/d9f/da6/fdd 0 2024-03-04T09:38:52.456 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:38:52.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:38:52.994 INFO:tasks.workunit.client.0.smithi046.stdout:9/853: creat d1/d11/d6/d8/d12/d1c/dd1/f10b x:0 0 0 2024-03-04T09:38:53.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/781: rename d7/f23 to d7/de/d28/d71/f106 0 2024-03-04T09:38:53.010 INFO:tasks.workunit.client.0.smithi046.stdout:5/741: sync 2024-03-04T09:38:53.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/901: write d1/d1d/d27/d4a/f7b [7665797,75145] 0 2024-03-04T09:38:53.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/727: mkdir d0/da/d4e/dd2/dfc 0 2024-03-04T09:38:53.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/728: write d0/d4/d40/f49 [5954971,18849] 0 2024-03-04T09:38:53.579 INFO:tasks.workunit.client.0.smithi046.stdout:0/805: symlink d10/d12/d1f/d3f/l11b 0 2024-03-04T09:38:53.674 INFO:tasks.workunit.client.0.smithi046.stdout:0/806: dwrite d10/f2e [0,4194304] 0 2024-03-04T09:38:53.933 INFO:tasks.workunit.client.0.smithi046.stdout:2/817: rmdir d5/d84/d7c 39 2024-03-04T09:38:54.197 INFO:tasks.workunit.client.0.smithi046.stdout:6/918: rename da/dd/d39/d60/da0/d67/d64/d82/d83/f8d to da/d14/de0/f14d 0 2024-03-04T09:38:54.198 INFO:tasks.workunit.client.0.smithi046.stdout:6/919: write da/dd/d39/d60/da0/d67/d64/d82/d83/f131 [716353,22041] 0 2024-03-04T09:38:54.309 INFO:tasks.workunit.client.0.smithi046.stdout:8/782: creat d7/d53/d72/d93/dd7/dc9/f107 x:0 0 0 2024-03-04T09:38:54.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/742: mknod d1/d44/d69/dcd/ce1 0 2024-03-04T09:38:54.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/743: readlink d1/d44/d81/d96/d20/d76/d6c/db2/lce 0 2024-03-04T09:38:54.565 INFO:tasks.workunit.client.0.smithi046.stdout:3/902: creat d1/d1d/d27/d4a/f146 x:0 0 0 2024-03-04T09:38:54.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/729: unlink d0/d4/db/d3b/f9e 0 2024-03-04T09:38:54.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/730: read - d0/da/d46/ff2 zero size 2024-03-04T09:38:54.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/731: fsync d0/d4/d6e/fb6 0 2024-03-04T09:38:54.947 INFO:tasks.workunit.client.0.smithi046.stdout:0/807: mkdir d10/d12/d1f/d3b/d6b/d11c 0 2024-03-04T09:38:55.371 INFO:tasks.workunit.client.0.smithi046.stdout:4/854: rename d0/d3/d20/d96/d6e/f139 to d0/d1f/d25/d7b/f140 0 2024-03-04T09:38:55.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/855: dwrite d0/d1f/d25/d50/d119/f66 [0,4194304] 0 2024-03-04T09:38:55.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/856: fsync d0/d1f/f102 0 2024-03-04T09:38:55.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/920: creat da/d14/d1e/d137/f14e x:0 0 0 2024-03-04T09:38:55.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/655: dwrite d1/f4d [0,4194304] 0 2024-03-04T09:38:55.722 INFO:tasks.workunit.client.0.smithi046.stdout:5/744: link d1/d44/d81/d8e/fac d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/fe2 0 2024-03-04T09:38:55.756 INFO:tasks.workunit.client.0.smithi046.stdout:7/732: creat d0/d58/ffd x:0 0 0 2024-03-04T09:38:56.334 INFO:tasks.workunit.client.0.smithi046.stdout:2/818: rmdir d5/d2c/d51/d61 39 2024-03-04T09:38:56.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/854: rename d1/d11/d3e/fa6 to d1/d11/d6/d8/d12/d1c/f10c 0 2024-03-04T09:38:56.663 INFO:tasks.workunit.client.0.smithi046.stdout:4/857: mknod d0/d1f/db9/ddd/c141 0 2024-03-04T09:38:56.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/858: dwrite d0/d3/d3b/d9d/f131 [0,4194304] 0 2024-03-04T09:38:56.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/859: chown d0/d3/fc2 33 1 2024-03-04T09:38:56.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/860: truncate d0/d5f/d6f/ff1 2720 0 2024-03-04T09:38:56.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/783: getdents d7/de/d28/d3a/d6f 0 2024-03-04T09:38:56.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/921: mknod da/dd8/d141/c14f 0 2024-03-04T09:38:56.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/922: fdatasync da/d14/d1e/d27/f55 0 2024-03-04T09:38:56.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/784: dwrite d7/de/f75 [0,4194304] 0 2024-03-04T09:38:56.959 INFO:tasks.workunit.client.0.smithi046.stdout:8/785: creat d7/de/d12/f108 x:0 0 0 2024-03-04T09:38:57.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/903: truncate d1/d21/ff9 1869425 0 2024-03-04T09:38:57.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/745: symlink d1/d44/d69/dcd/le3 0 2024-03-04T09:38:57.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/746: write d1/d44/d81/d96/d20/d76/fb6 [1730175,24491] 0 2024-03-04T09:38:58.278 INFO:tasks.workunit.client.0.smithi046.stdout:2/819: creat d5/db9/d105/f110 x:0 0 0 2024-03-04T09:38:58.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/820: dwrite d5/db9/dd2/fd7 [0,4194304] 0 2024-03-04T09:38:58.428 INFO:tasks.workunit.client.0.smithi046.stdout:9/855: read d1/d11/fac [164106,25247] 0 2024-03-04T09:38:59.250 INFO:tasks.workunit.client.0.smithi046.stdout:4/861: mknod d0/d1f/d25/d50/d119/d1e/da1/dc1/d100/c142 0 2024-03-04T09:38:59.336 INFO:tasks.workunit.client.0.smithi046.stdout:4/862: dwrite d0/d1f/d25/d50/d119/d1e/f36 [4194304,4194304] 0 2024-03-04T09:38:59.336 INFO:tasks.workunit.client.0.smithi046.stdout:4/863: write d0/d1f/d25/d50/fdf [842988,25078] 0 2024-03-04T09:38:59.945 INFO:tasks.workunit.client.0.smithi046.stdout:0/808: write d10/d12/f82 [193612,16526] 0 2024-03-04T09:39:00.192 INFO:tasks.workunit.client.0.smithi046.stdout:3/904: unlink d1/d1d/d27/d40/d70/c118 0 2024-03-04T09:39:00.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/923: rename da/d14/d1e/d2c to da/dd/d39/d60/da0/ddd/d150 0 2024-03-04T09:39:00.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/747: fsync d1/d44/d81/d96/d20/d76/d6c/d7b/f8d 0 2024-03-04T09:39:00.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/748: fsync d1/d44/d81/d96/d20/d76/f65 0 2024-03-04T09:39:00.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/856: symlink d1/d11/d6/d8/d1d/d34/d35/l10d 0 2024-03-04T09:39:00.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/821: read d5/d38/f66 [142803,92083] 0 2024-03-04T09:39:01.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/864: mknod d0/d1f/d25/d50/d119/d1e/da1/c143 0 2024-03-04T09:39:01.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/865: dread - d0/d1f/d25/d50/ddb/f112 zero size 2024-03-04T09:39:01.304 INFO:tasks.workunit.client.0.smithi046.stdout:0/809: creat d10/d12/f11d x:0 0 0 2024-03-04T09:39:01.386 INFO:tasks.workunit.client.0.smithi046.stdout:6/924: truncate da/dd/d39/d60/f71 1648868 0 2024-03-04T09:39:01.676 INFO:tasks.workunit.client.0.smithi046.stdout:5/749: truncate d1/d44/d81/d96/d20/d76/d6c/db2/f7c 2471605 0 2024-03-04T09:39:01.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/750: dread d1/d44/d81/d96/d20/d5e/f74 [0,4194304] 0 2024-03-04T09:39:01.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/751: write d1/d44/d81/d8e/dbe/fdb [709886,105077] 0 2024-03-04T09:39:01.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/857: rename d1/d11/d6/d8/d1d/d34/d4d/l100 to d1/d11/d6/d8/d6f/d8c/d9a/l10e 0 2024-03-04T09:39:02.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/822: creat d5/db9/f111 x:0 0 0 2024-03-04T09:39:02.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/823: fsync d5/d2c/f2e 0 2024-03-04T09:39:02.353 INFO:tasks.workunit.client.0.smithi046.stdout:0/810: unlink d10/d12/d9f/da6/d10a/c114 0 2024-03-04T09:39:02.361 INFO:tasks.workunit.client.0.smithi046.stdout:0/811: dread d10/d12/f82 [0,4194304] 0 2024-03-04T09:39:02.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/733: sync 2024-03-04T09:39:02.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/656: sync 2024-03-04T09:39:02.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/734: chown d0/d4/db/c55 0 1 2024-03-04T09:39:02.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/735: chown d0/d4/db/d38/l45 2 1 2024-03-04T09:39:03.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/824: creat d5/db9/dd2/df7/f112 x:0 0 0 2024-03-04T09:39:03.654 INFO:tasks.workunit.client.0.smithi046.stdout:2/825: dread d5/d2c/d51/fc7 [0,4194304] 0 2024-03-04T09:39:03.857 INFO:tasks.workunit.client.0.smithi046.stdout:7/736: chown d0/d2d/d85/fa9 6142 1 2024-03-04T09:39:03.857 INFO:tasks.workunit.client.0.smithi046.stdout:1/657: write d1/d28/f41 [829791,33025] 0 2024-03-04T09:39:04.004 INFO:tasks.workunit.client.0.smithi046.stdout:9/858: truncate d1/d11/d6/d8/d1d/d34/d4d/f55 8464583 0 2024-03-04T09:39:04.519 INFO:tasks.workunit.client.0.smithi046.stdout:7/737: creat d0/d58/ffe x:0 0 0 2024-03-04T09:39:04.519 INFO:tasks.workunit.client.0.smithi046.stdout:7/738: chown d0/d58 1 1 2024-03-04T09:39:04.546 INFO:tasks.workunit.client.0.smithi046.stdout:7/739: read d0/d4/d40/f49 [236050,86266] 0 2024-03-04T09:39:04.755 INFO:tasks.workunit.client.0.smithi046.stdout:9/859: link d1/d11/d6/d8/d1d/d34/c72 d1/d11/d6/d8/d1d/d34/d7f/dfc/c10f 0 2024-03-04T09:39:04.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/860: dread d1/d11/d6/d8/d12/d1c/f48 [0,4194304] 0 2024-03-04T09:39:04.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/861: fsync d1/d11/d6/d8/d12/d1c/fd3 0 2024-03-04T09:39:04.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/862: chown d1/d11/d6/d8/d12/f29 1575487 1 2024-03-04T09:39:04.887 INFO:tasks.workunit.client.0.smithi046.stdout:7/740: link d0/d4/f86 d0/d4/db/d38/fff 0 2024-03-04T09:39:05.080 INFO:tasks.workunit.client.0.smithi046.stdout:8/786: dwrite d7/de/d4c/f98 [0,4194304] 0 2024-03-04T09:39:05.417 INFO:tasks.workunit.client.0.smithi046.stdout:7/741: symlink d0/da/d46/d99/de2/db1/l100 0 2024-03-04T09:39:05.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/742: dwrite d0/da/d46/d99/fb2 [0,4194304] 0 2024-03-04T09:39:05.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/743: chown d0/da 1356876 1 2024-03-04T09:39:05.940 INFO:tasks.workunit.client.0.smithi046.stdout:8/787: mkdir d7/de/d28/dab/d2c/d64/db8/d109 0 2024-03-04T09:39:05.940 INFO:tasks.workunit.client.0.smithi046.stdout:8/788: chown d7/f5f 5 1 2024-03-04T09:39:06.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/789: unlink d7/de/d28/l6d 0 2024-03-04T09:39:06.306 INFO:tasks.workunit.client.0.smithi046.stdout:8/790: read d7/de/d28/d3a/fe3 [2394958,79722] 0 2024-03-04T09:39:06.565 INFO:tasks.workunit.client.0.smithi046.stdout:7/744: mkdir d0/d4/db/d12/d101 0 2024-03-04T09:39:07.333 INFO:tasks.workunit.client.0.smithi046.stdout:4/866: write d0/d1f/fcd [366500,106970] 0 2024-03-04T09:39:07.581 INFO:tasks.workunit.client.0.smithi046.stdout:3/905: symlink d1/l147 0 2024-03-04T09:39:09.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/925: rename da/d14/lf4 to da/dd/d22/d12b/dab/ddc/l151 0 2024-03-04T09:39:09.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/926: write da/dd/d39/d60/dac/daf/d11d/f11c [239167,79467] 0 2024-03-04T09:39:09.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/752: creat d1/d44/d81/d96/d20/d76/d6c/fe4 x:0 0 0 2024-03-04T09:39:09.172 INFO:tasks.workunit.client.0.smithi046.stdout:0/812: mkdir d10/d12/d11e 0 2024-03-04T09:39:09.220 INFO:tasks.workunit.client.0.smithi046.stdout:4/867: dwrite d0/d1f/d25/d50/d119/d1e/da1/dc1/f117 [0,4194304] 0 2024-03-04T09:39:09.220 INFO:tasks.workunit.client.0.smithi046.stdout:4/868: chown d0/d3/d20/d96/d6e/f9e 101649 1 2024-03-04T09:39:09.319 INFO:tasks.workunit.client.0.smithi046.stdout:4/869: dwrite d0/d1f/fcd [0,4194304] 0 2024-03-04T09:39:09.337 INFO:tasks.workunit.client.0.smithi046.stdout:4/870: dread d0/d3/f4 [0,4194304] 0 2024-03-04T09:39:09.474 INFO:tasks.workunit.client.0.smithi046.stdout:6/927: unlink da/d14/d1e/d27/d4b/c9c 0 2024-03-04T09:39:09.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/813: mknod d10/d12/c11f 0 2024-03-04T09:39:09.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/814: creat d10/d12/d1f/d3f/f120 x:0 0 0 2024-03-04T09:39:09.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/815: write d10/d12/d9a/dd8/fe0 [249451,7731] 0 2024-03-04T09:39:09.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/928: dwrite da/dd/d39/fb7 [4194304,4194304] 0 2024-03-04T09:39:09.734 INFO:tasks.workunit.client.0.smithi046.stdout:5/753: creat d1/d44/d81/d96/d9a/da0/fe5 x:0 0 0 2024-03-04T09:39:09.987 INFO:tasks.workunit.client.0.smithi046.stdout:4/871: stat d0/d1f/d25/d7b/lbe 0 2024-03-04T09:39:09.987 INFO:tasks.workunit.client.0.smithi046.stdout:4/872: dread - d0/d1f/db9/fc0 zero size 2024-03-04T09:39:09.987 INFO:tasks.workunit.client.0.smithi046.stdout:4/873: stat d0/d3/d20/ld6 0 2024-03-04T09:39:09.989 INFO:tasks.workunit.client.0.smithi046.stdout:0/816: symlink d10/d12/d52/d5d/d83/l121 0 2024-03-04T09:39:10.045 INFO:tasks.workunit.client.0.smithi046.stdout:4/874: dwrite d0/d5f/f86 [0,4194304] 0 2024-03-04T09:39:10.059 INFO:tasks.workunit.client.0.smithi046.stdout:6/929: creat da/dd/d22/d12b/f152 x:0 0 0 2024-03-04T09:39:10.086 INFO:tasks.workunit.client.0.smithi046.stdout:6/930: read da/d14/d1e/f30 [4099103,73145] 0 2024-03-04T09:39:10.246 INFO:tasks.workunit.client.0.smithi046.stdout:5/754: unlink d1/d44/d81/d8e/f33 0 2024-03-04T09:39:10.378 INFO:tasks.workunit.client.0.smithi046.stdout:1/658: rename d1/d28/d6a/f78 to d1/d28/d8d/fd3 0 2024-03-04T09:39:10.418 INFO:tasks.workunit.client.0.smithi046.stdout:0/817: creat d10/d12/d52/d78/f122 x:0 0 0 2024-03-04T09:39:10.418 INFO:tasks.workunit.client.0.smithi046.stdout:0/818: readlink d10/d12/d1f/d3b/l4d 0 2024-03-04T09:39:10.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/863: sync 2024-03-04T09:39:10.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/791: sync 2024-03-04T09:39:10.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/826: sync 2024-03-04T09:39:10.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/864: write d1/d11/d6/d8/d36/f65 [12720086,78096] 0 2024-03-04T09:39:10.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/931: mkdir da/dd/d46/d153 0 2024-03-04T09:39:10.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/932: chown da/d14/d1e/d8f/ddf/d135 59 1 2024-03-04T09:39:11.369 INFO:tasks.workunit.client.0.smithi046.stdout:7/745: rename d0/d4/f5 to d0/da/d46/d99/de2/db1/f102 0 2024-03-04T09:39:11.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/792: creat d7/de/d28/dab/d2c/dd9/f10a x:0 0 0 2024-03-04T09:39:11.370 INFO:tasks.workunit.client.0.smithi046.stdout:8/793: write d7/de/d28/dab/d2c/dd9/f10a [732612,74102] 0 2024-03-04T09:39:11.478 INFO:tasks.workunit.client.0.smithi046.stdout:2/827: truncate f3 1327960 0 2024-03-04T09:39:11.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/828: write d5/d38/fdc [555348,40332] 0 2024-03-04T09:39:12.264 INFO:tasks.workunit.client.0.smithi046.stdout:4/875: dwrite d0/d3/d3b/d8d/f68 [4194304,4194304] 0 2024-03-04T09:39:12.264 INFO:tasks.workunit.client.0.smithi046.stdout:4/876: fdatasync d0/d1f/d25/d50/d119/d1e/da1/dcc/d122/f12c 0 2024-03-04T09:39:12.371 INFO:tasks.workunit.client.0.smithi046.stdout:3/906: rename d1/d1d/d27/f2d to d1/d74/f148 0 2024-03-04T09:39:12.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/907: dwrite d1/d1d/d27/d40/d92/f10d [0,4194304] 0 2024-03-04T09:39:12.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/908: truncate d1/d1d/d27/def/f112 312977 0 2024-03-04T09:39:12.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/819: mkdir d10/d12/d52/d78/d8a/da2/d123 0 2024-03-04T09:39:12.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/820: read - d10/f96 zero size 2024-03-04T09:39:12.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/821: chown d10/d12/d52/c79 7 1 2024-03-04T09:39:12.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/822: dwrite d10/d12/d52/d78/f122 [0,4194304] 0 2024-03-04T09:39:12.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/794: mknod d7/de/d28/dab/d2c/d64/db8/c10b 0 2024-03-04T09:39:12.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/795: chown d7/d53/d72/d93/dd7/l70 217 1 2024-03-04T09:39:13.140 INFO:tasks.workunit.client.0.smithi046.stdout:9/865: truncate d1/d11/d6/d8/fd 3881830 0 2024-03-04T09:39:13.140 INFO:tasks.workunit.client.0.smithi046.stdout:9/866: dread - d1/d11/d6/d8/d12/d1c/dd1/ff7 zero size 2024-03-04T09:39:13.214 INFO:tasks.workunit.client.0.smithi046.stdout:9/867: dwrite d1/d11/d6/d8/d13/d92/fcd [4194304,4194304] 0 2024-03-04T09:39:13.215 INFO:tasks.workunit.client.0.smithi046.stdout:9/868: readlink d1/d11/d6/d8/d1d/l4b 0 2024-03-04T09:39:13.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/877: rename d0/d1f/d25/d50/d119/f66 to d0/d1f/d25/d50/d119/f144 0 2024-03-04T09:39:13.918 INFO:tasks.workunit.client.0.smithi046.stdout:5/755: rename d1/c6b to d1/d44/d81/d96/d20/d76/d6c/dd1/ce6 0 2024-03-04T09:39:14.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/746: mkdir d0/d58/d103 0 2024-03-04T09:39:14.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/747: dwrite d0/da/d4e/dd2/fd9 [0,4194304] 0 2024-03-04T09:39:14.676 INFO:tasks.workunit.client.0.smithi046.stdout:8/796: creat d7/d53/d72/d93/dd7/dc9/ddc/f10c x:0 0 0 2024-03-04T09:39:14.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/829: symlink d5/da/d1b/l113 0 2024-03-04T09:39:14.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/830: truncate d5/d38/f90 1815163 0 2024-03-04T09:39:15.101 INFO:tasks.workunit.client.0.smithi046.stdout:9/869: creat d1/d11/d6/d8/d1d/d34/d7f/ded/f110 x:0 0 0 2024-03-04T09:39:15.414 INFO:tasks.workunit.client.0.smithi046.stdout:4/878: symlink d0/d5f/da2/l145 0 2024-03-04T09:39:15.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/879: creat d0/d1f/d25/d50/d119/d1e/d73/f146 x:0 0 0 2024-03-04T09:39:15.604 INFO:tasks.workunit.client.0.smithi046.stdout:5/756: chown d1/d44/d57/d70/l94 30 1 2024-03-04T09:39:15.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/933: rename da/f3a to da/d14/d1e/d27/da3/d111/f154 0 2024-03-04T09:39:15.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/934: chown da/dd/d46/f72 6478 1 2024-03-04T09:39:15.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/935: read - da/dd/d39/d60/da0/d67/d64/d82/d13b/f10a zero size 2024-03-04T09:39:15.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/936: chown da/dd/d22 784593340 1 2024-03-04T09:39:15.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/937: write da/dd/d46/de6/f130 [813847,4141] 0 2024-03-04T09:39:16.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/797: symlink d7/de/d12/da9/l10d 0 2024-03-04T09:39:16.292 INFO:tasks.workunit.client.0.smithi046.stdout:2/831: link d5/d2c/d51/d61/f10d d5/d38/d54/f114 0 2024-03-04T09:39:16.292 INFO:tasks.workunit.client.0.smithi046.stdout:9/870: mknod d1/d11/d6/d8/d6f/c111 0 2024-03-04T09:39:16.488 INFO:tasks.workunit.client.0.smithi046.stdout:4/880: rmdir d0/d3/d20/d96/d6e 39 2024-03-04T09:39:16.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/659: write d1/f5e [765154,76100] 0 2024-03-04T09:39:16.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/909: rename d1/d1d/d27/d4a/d78/l84 to d1/d1d/d27/d40/d76/d8d/d95/dcf/l149 0 2024-03-04T09:39:16.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/910: dwrite d1/f39 [4194304,4194304] 0 2024-03-04T09:39:17.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/798: mknod d7/de/d28/d36/d7c/c10e 0 2024-03-04T09:39:17.335 INFO:tasks.workunit.client.0.smithi046.stdout:6/938: dread da/d14/f19 [4194304,4194304] 0 2024-03-04T09:39:17.526 INFO:tasks.workunit.client.0.smithi046.stdout:2/832: creat d5/d84/d9a/f115 x:0 0 0 2024-03-04T09:39:17.595 INFO:tasks.workunit.client.0.smithi046.stdout:2/833: dwrite d5/d38/f85 [0,4194304] 0 2024-03-04T09:39:17.622 INFO:tasks.workunit.client.0.smithi046.stdout:9/871: getdents d1/d11/d6/d8/d1d/d34/d35 0 2024-03-04T09:39:17.647 INFO:tasks.workunit.client.0.smithi046.stdout:4/881: chown d0/d1f/d5b/c80 107315 1 2024-03-04T09:39:17.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/882: write d0/d1f/d35/f6b [3426008,44686] 0 2024-03-04T09:39:17.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/883: truncate d0/d3/ffe 375020 0 2024-03-04T09:39:17.824 INFO:tasks.workunit.client.0.smithi046.stdout:0/823: rename d10/d12/d1f/d3b/def/d116 to d10/d12/d6e/d99/d124 0 2024-03-04T09:39:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:0/824: dwrite d10/d12/d9f/da6/fdd [0,4194304] 0 2024-03-04T09:39:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/825: creat d10/d12/d1f/d3f/d7e/f125 x:0 0 0 2024-03-04T09:39:17.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/911: getdents d1/d1d/d27/d40/d92 0 2024-03-04T09:39:17.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/912: write d1/d1d/d27/d40/d70/d105/ff5 [839919,10171] 0 2024-03-04T09:39:17.984 INFO:tasks.workunit.client.0.smithi046.stdout:0/826: dwrite d10/d12/d52/d5d/f6f [0,4194304] 0 2024-03-04T09:39:18.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/913: dwrite d1/d21/d35/d43/f63 [0,4194304] 0 2024-03-04T09:39:18.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/827: dwrite d10/d12/d9f/da6/fbb [0,4194304] 0 2024-03-04T09:39:18.397 INFO:tasks.workunit.client.0.smithi046.stdout:6/939: mkdir da/dd/d39/d60/da0/ddd/d150/d155 0 2024-03-04T09:39:18.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/872: link d1/d11/d6/d8/d12/d1c/d26/c28 d1/d11/d6/d8/d6f/d8c/d9a/c112 0 2024-03-04T09:39:18.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/873: truncate d1/d11/d6/d8/d36/fcf 1030393 0 2024-03-04T09:39:19.738 INFO:tasks.workunit.client.0.smithi046.stdout:3/914: creat d1/d1d/d27/d40/f14a x:0 0 0 2024-03-04T09:39:19.738 INFO:tasks.workunit.client.0.smithi046.stdout:3/915: dread - d1/d1d/d27/d4a/d78/f13c zero size 2024-03-04T09:39:19.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/748: dwrite d0/d4/db/d12/dc1/f93 [0,4194304] 0 2024-03-04T09:39:19.939 INFO:tasks.workunit.client.0.smithi046.stdout:0/828: truncate d10/d12/fb3 97971 0 2024-03-04T09:39:20.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/940: creat da/dd/d22/d12b/d94/f156 x:0 0 0 2024-03-04T09:39:20.860 INFO:tasks.workunit.client.0.smithi046.stdout:8/799: write d7/de/d28/f37 [235924,77711] 0 2024-03-04T09:39:21.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/874: mknod d1/d11/d6/d8/d12/d1c/dd1/c113 0 2024-03-04T09:39:21.260 INFO:tasks.workunit.client.0.smithi046.stdout:2/834: dwrite d5/da/f24 [0,4194304] 0 2024-03-04T09:39:21.260 INFO:tasks.workunit.client.0.smithi046.stdout:2/835: fsync d5/d2c/d51/f58 0 2024-03-04T09:39:21.260 INFO:tasks.workunit.client.0.smithi046.stdout:2/836: write d5/d38/fb2 [104191,47465] 0 2024-03-04T09:39:21.466 INFO:tasks.workunit.client.0.smithi046.stdout:3/916: creat d1/db0/f14b x:0 0 0 2024-03-04T09:39:21.579 INFO:tasks.workunit.client.0.smithi046.stdout:4/884: dwrite d0/d5f/d6f/ff1 [0,4194304] 0 2024-03-04T09:39:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/885: dread d0/d5f/f86 [0,4194304] 0 2024-03-04T09:39:21.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/886: dwrite d0/d1f/fb6 [0,4194304] 0 2024-03-04T09:39:21.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/887: dread - d0/d3/d20/d96/d6e/fe2 zero size 2024-03-04T09:39:21.724 INFO:tasks.workunit.client.0.smithi046.stdout:4/888: dwrite d0/d1f/f102 [0,4194304] 0 2024-03-04T09:39:21.724 INFO:tasks.workunit.client.0.smithi046.stdout:4/889: write d0/d1f/d25/d50/df5/f10f [662417,69974] 0 2024-03-04T09:39:21.747 INFO:tasks.workunit.client.0.smithi046.stdout:7/749: mknod d0/d3c/c104 0 2024-03-04T09:39:21.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/750: chown d0/d4/db/d38/c82 1412936 1 2024-03-04T09:39:21.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/751: creat d0/d4/d40/f105 x:0 0 0 2024-03-04T09:39:21.876 INFO:tasks.workunit.client.0.smithi046.stdout:6/941: dwrite da/d14/d17/f1b [0,4194304] 0 2024-03-04T09:39:22.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/800: unlink d7/de/d28/dab/d2c/lc8 0 2024-03-04T09:39:22.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:39:22.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:39:22.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/757: rename d1/d44/d57/d70/da6 to d1/d44/d57/dc7/de7 0 2024-03-04T09:39:22.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/758: dread - d1/d44/d57/dc7/de7/fd9 zero size 2024-03-04T09:39:22.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/759: dwrite d1/d44/d81/d96/d20/f5d [0,4194304] 0 2024-03-04T09:39:22.817 INFO:tasks.workunit.client.0.smithi046.stdout:3/917: dread d1/d1d/d27/d4a/d78/fa2 [0,4194304] 0 2024-03-04T09:39:23.454 INFO:tasks.workunit.client.0.smithi046.stdout:1/660: mknod d1/cd4 0 2024-03-04T09:39:23.805 INFO:tasks.workunit.client.0.smithi046.stdout:6/942: symlink da/d4e/l157 0 2024-03-04T09:39:24.098 INFO:tasks.workunit.client.0.smithi046.stdout:8/801: mkdir d7/de/d28/d3a/d10f 0 2024-03-04T09:39:24.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/875: mknod d1/d11/d6/d8/d12/d1c/dd1/d5e/dde/c114 0 2024-03-04T09:39:24.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/876: readlink d1/d11/d6/d8/d12/le4 0 2024-03-04T09:39:24.255 INFO:tasks.workunit.client.0.smithi046.stdout:9/877: dwrite d1/d11/d6/d8/d1d/d34/d4d/d7e/ff9 [0,4194304] 0 2024-03-04T09:39:24.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/837: mkdir d5/da/d1b/d116 0 2024-03-04T09:39:24.525 INFO:tasks.workunit.client.0.smithi046.stdout:0/829: rename d10/d12/l55 to d10/d12/d1f/l126 0 2024-03-04T09:39:24.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/830: dread d10/d12/d52/d78/f50 [0,4194304] 0 2024-03-04T09:39:24.663 INFO:tasks.workunit.client.0.smithi046.stdout:0/831: dwrite d10/f2e [0,4194304] 0 2024-03-04T09:39:24.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/832: write d10/d12/d1f/d3f/fc5 [647665,11422] 0 2024-03-04T09:39:24.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/833: creat d10/d12/d6e/f127 x:0 0 0 2024-03-04T09:39:24.796 INFO:tasks.workunit.client.0.smithi046.stdout:5/760: truncate d1/d44/d81/fb5 831905 0 2024-03-04T09:39:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:3/918: creat d1/d1d/d27/d40/d76/d8d/d95/dcf/f14c x:0 0 0 2024-03-04T09:39:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:3/919: chown d1/d1d/d27/c66 0 1 2024-03-04T09:39:25.385 INFO:tasks.workunit.client.0.smithi046.stdout:6/943: rmdir da/d14/d1e/d27/d78/d66/d11f/d140 0 2024-03-04T09:39:25.429 INFO:tasks.workunit.client.0.smithi046.stdout:6/944: dwrite da/dd/d39/d60/da0/d67/dcf/f127 [0,4194304] 0 2024-03-04T09:39:25.870 INFO:tasks.workunit.client.0.smithi046.stdout:2/838: rename d5/d84/d88/d99 to d5/d40/d117 0 2024-03-04T09:39:25.870 INFO:tasks.workunit.client.0.smithi046.stdout:2/839: dread - d5/d84/d7c/fed zero size 2024-03-04T09:39:25.871 INFO:tasks.workunit.client.0.smithi046.stdout:2/840: read - d5/d38/d54/f104 zero size 2024-03-04T09:39:26.241 INFO:tasks.workunit.client.0.smithi046.stdout:3/920: creat d1/d1d/d27/d135/f14d x:0 0 0 2024-03-04T09:39:26.241 INFO:tasks.workunit.client.0.smithi046.stdout:8/802: mkdir d7/de/d4c/d50/d110 0 2024-03-04T09:39:26.260 INFO:tasks.workunit.client.0.smithi046.stdout:8/803: write d7/de/d28/dab/d3c/da5/fbc [504257,99750] 0 2024-03-04T09:39:26.615 INFO:tasks.workunit.client.0.smithi046.stdout:5/761: rename d1/d44/d81/d96/d20/d76/d6c/d7b/f8d to d1/d44/d81/d96/d20/d76/d6c/dd1/fe8 0 2024-03-04T09:39:26.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/841: creat d5/d84/d9a/f118 x:0 0 0 2024-03-04T09:39:26.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/842: fdatasync d5/fb4 0 2024-03-04T09:39:26.639 INFO:tasks.workunit.client.0.smithi046.stdout:2/843: dread d5/d40/d5a/f6d [4194304,4194304] 0 2024-03-04T09:39:26.646 INFO:tasks.workunit.client.0.smithi046.stdout:5/762: read d1/d44/d81/f91 [112845,95157] 0 2024-03-04T09:39:26.646 INFO:tasks.workunit.client.0.smithi046.stdout:5/763: chown d1/d44/d81/d96/d20/fcf 100 1 2024-03-04T09:39:26.677 INFO:tasks.workunit.client.0.smithi046.stdout:5/764: dread d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/f37 [0,4194304] 0 2024-03-04T09:39:26.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/890: creat d0/f147 x:0 0 0 2024-03-04T09:39:26.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/891: readlink d0/d3/d20/l32 0 2024-03-04T09:39:26.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/834: creat d10/d12/d52/d78/d8a/da2/dc8/f128 x:0 0 0 2024-03-04T09:39:29.309 INFO:tasks.workunit.client.0.smithi046.stdout:1/661: write d1/d28/d6a/fb3 [380618,67310] 0 2024-03-04T09:39:29.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/752: dwrite d0/da/d46/d99/de2/fdd [0,4194304] 0 2024-03-04T09:39:29.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/753: chown d0/da/d46/fe6 443603363 1 2024-03-04T09:39:30.202 INFO:tasks.workunit.client.0.smithi046.stdout:6/945: rename da/dd/d39/d60/da0/c76 to da/dd/d39/d60/da9/c158 0 2024-03-04T09:39:30.205 INFO:tasks.workunit.client.0.smithi046.stdout:9/878: write d1/d11/d6/d8/d12/f1e [1722999,128452] 0 2024-03-04T09:39:30.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/946: write da/d14/de0/f14d [1380809,118732] 0 2024-03-04T09:39:30.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/947: creat da/d14/d1e/d27/f159 x:0 0 0 2024-03-04T09:39:30.378 INFO:tasks.workunit.client.0.smithi046.stdout:2/844: mkdir d5/d2c/d91/d119 0 2024-03-04T09:39:30.511 INFO:tasks.workunit.client.0.smithi046.stdout:5/765: creat d1/d44/d81/d96/d4f/d8f/fe9 x:0 0 0 2024-03-04T09:39:30.511 INFO:tasks.workunit.client.0.smithi046.stdout:5/766: dread - d1/d44/d81/d96/d20/d5e/f7e zero size 2024-03-04T09:39:30.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/767: dwrite d1/d44/d81/d96/d20/d76/fb6 [0,4194304] 0 2024-03-04T09:39:30.593 INFO:tasks.workunit.client.0.smithi046.stdout:5/768: read d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/fa5 [311177,59867] 0 2024-03-04T09:39:30.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/892: symlink d0/d1f/d25/d50/d119/de5/l148 0 2024-03-04T09:39:30.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/893: readlink d0/d3/d3b/l30 0 2024-03-04T09:39:30.710 INFO:tasks.workunit.client.0.smithi046.stdout:4/894: dwrite d0/d1f/d25/d7b/f120 [0,4194304] 0 2024-03-04T09:39:30.857 INFO:tasks.workunit.client.0.smithi046.stdout:8/804: unlink d7/de/d28/dab/d2c/c32 0 2024-03-04T09:39:30.857 INFO:tasks.workunit.client.0.smithi046.stdout:8/805: creat d7/de/d28/dab/d2c/dd9/f111 x:0 0 0 2024-03-04T09:39:31.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/662: dread - d1/d28/d6f/d74/f88 zero size 2024-03-04T09:39:31.318 INFO:tasks.workunit.client.0.smithi046.stdout:7/754: symlink d0/da/d46/d99/de2/db1/dc8/l106 0 2024-03-04T09:39:31.348 INFO:tasks.workunit.client.0.smithi046.stdout:7/755: dread d0/da/d46/d99/de2/f5b [0,4194304] 0 2024-03-04T09:39:31.370 INFO:tasks.workunit.client.0.smithi046.stdout:7/756: dread d0/da/f29 [0,4194304] 0 2024-03-04T09:39:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:0/835: mknod d10/c129 0 2024-03-04T09:39:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:0/836: truncate d10/d12/d1f/d3f/d4b/f7f 4924571 0 2024-03-04T09:39:32.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/948: creat da/dd/d39/d60/dac/dcb/f15a x:0 0 0 2024-03-04T09:39:32.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/949: chown da/d14/d1e/d8f/ddf/d135 867400 1 2024-03-04T09:39:32.513 INFO:tasks.workunit.client.0.smithi046.stdout:2/845: creat d5/db9/dd2/f11a x:0 0 0 2024-03-04T09:39:32.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/769: symlink d1/d44/d81/d8e/dbe/lea 0 2024-03-04T09:39:33.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/895: mkdir d0/d3/d149 0 2024-03-04T09:39:34.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/846: unlink d5/d84/d88/d47/lc6 0 2024-03-04T09:39:34.083 INFO:tasks.workunit.client.0.smithi046.stdout:2/847: dread d5/d2c/f6a [0,4194304] 0 2024-03-04T09:39:34.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/770: creat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/feb x:0 0 0 2024-03-04T09:39:34.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/757: rename d0/da/d46/d99/de2/db1/ce0 to d0/d58/c107 0 2024-03-04T09:39:34.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/758: fsync d0/d4/db/d38/d94/fec 0 2024-03-04T09:39:34.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/759: creat d0/d4/db/d3b/d6b/f108 x:0 0 0 2024-03-04T09:39:34.955 INFO:tasks.workunit.client.0.smithi046.stdout:3/921: sync 2024-03-04T09:39:34.956 INFO:tasks.workunit.client.0.smithi046.stdout:3/922: fsync d1/d88/fd4 0 2024-03-04T09:39:35.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/896: link d0/d5f/d6f/fd7 d0/d3/d3b/f14a 0 2024-03-04T09:39:35.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/923: getdents d1/d21/d35 0 2024-03-04T09:39:35.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/924: fdatasync d1/db0/fc4 0 2024-03-04T09:39:35.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/925: dwrite d1/d88/f117 [0,4194304] 0 2024-03-04T09:39:35.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/926: dread - d1/d1d/d27/d40/d76/dfd/f143 zero size 2024-03-04T09:39:35.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/927: write d1/d1d/d27/d40/d76/d8d/fd6 [721246,130529] 0 2024-03-04T09:39:35.785 INFO:tasks.workunit.client.0.smithi046.stdout:4/897: symlink d0/d1f/d35/d111/l14b 0 2024-03-04T09:39:36.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/928: creat d1/d21/d35/d43/dd2/d9a/f14e x:0 0 0 2024-03-04T09:39:36.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/929: chown d1/d21/d35/d43/dd2/c34 28929 1 2024-03-04T09:39:36.348 INFO:tasks.workunit.client.0.smithi046.stdout:4/898: symlink d0/d1f/d35/d111/l14c 0 2024-03-04T09:39:36.348 INFO:tasks.workunit.client.0.smithi046.stdout:4/899: read - d0/d3/d20/d96/d6e/f9e zero size 2024-03-04T09:39:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/930: mkdir d1/db0/d134/d14f 0 2024-03-04T09:39:37.147 INFO:tasks.workunit.client.0.smithi046.stdout:4/900: mknod d0/d5f/d124/c14d 0 2024-03-04T09:39:37.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/879: dwrite d1/d11/d6/d8/d12/f103 [0,4194304] 0 2024-03-04T09:39:38.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/880: getdents d1/d11/d6/d8/d1d 0 2024-03-04T09:39:38.293 INFO:tasks.workunit.client.0.smithi046.stdout:3/931: getdents d1/d1d/d27/d10f 0 2024-03-04T09:39:38.293 INFO:tasks.workunit.client.0.smithi046.stdout:3/932: truncate d1/d1d/d27/d40/d70/d105/de3/f111 982420 0 2024-03-04T09:39:38.293 INFO:tasks.workunit.client.0.smithi046.stdout:3/933: readlink d1/d1d/d27/d40/d76/d8d/la0 0 2024-03-04T09:39:38.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/901: rename d0/d3/d3b/l11a to d0/d1f/d5b/l14e 0 2024-03-04T09:39:38.328 INFO:tasks.workunit.client.0.smithi046.stdout:4/902: chown d0/d3 165590 1 2024-03-04T09:39:38.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/934: truncate d1/d1d/d27/d40/d70/d105/fe2 3361310 0 2024-03-04T09:39:38.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/935: dread - d1/db0/f14b zero size 2024-03-04T09:39:38.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/936: creat d1/d1d/d27/d40/d70/d105/de3/f150 x:0 0 0 2024-03-04T09:39:38.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/881: rename d1/d11/d6/d8/d12/d1c/f10c to d1/d11/d6/d8/d13/f115 0 2024-03-04T09:39:38.752 INFO:tasks.workunit.client.0.smithi046.stdout:4/903: creat d0/d125/f14f x:0 0 0 2024-03-04T09:39:39.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/882: mknod d1/d11/d6/d8/d13/c116 0 2024-03-04T09:39:39.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/883: fdatasync d1/d11/d6/d8/d36/fd8 0 2024-03-04T09:39:39.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/884: write d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/fdb [3731733,97288] 0 2024-03-04T09:39:39.043 INFO:tasks.workunit.client.0.smithi046.stdout:1/663: write d1/d28/f47 [2863888,85331] 0 2024-03-04T09:39:39.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/904: creat d0/d3/d20/d96/d6e/d85/f150 x:0 0 0 2024-03-04T09:39:39.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/885: mkdir d1/d11/d6/d8/d12/d117 0 2024-03-04T09:39:39.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/886: stat d1/d11/d6/d8/d1d/d34/d35/lc8 0 2024-03-04T09:39:40.036 INFO:tasks.workunit.client.0.smithi046.stdout:2/848: write d5/da/f23 [663331,40752] 0 2024-03-04T09:39:40.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/849: dread d5/d2c/d51/d7f/fe8 [0,4194304] 0 2024-03-04T09:39:40.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/850: dread - d5/d84/d9a/f118 zero size 2024-03-04T09:39:40.304 INFO:tasks.workunit.client.0.smithi046.stdout:8/806: creat d7/de/d4c/f112 x:0 0 0 2024-03-04T09:39:40.335 INFO:tasks.workunit.client.0.smithi046.stdout:5/771: dwrite d1/f1b [0,4194304] 0 2024-03-04T09:39:40.339 INFO:tasks.workunit.client.0.smithi046.stdout:7/760: dwrite d0/d2d/d85/fa9 [0,4194304] 0 2024-03-04T09:39:40.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/851: creat d5/d2c/d51/d7f/d92/f11b x:0 0 0 2024-03-04T09:39:40.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/852: chown d5/d40/d5a/l108 6 1 2024-03-04T09:39:41.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/853: symlink d5/da/dbc/l11c 0 2024-03-04T09:39:42.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/807: link d7/de/d28/dab/d3c/lde d7/de/d4c/d50/l113 0 2024-03-04T09:39:42.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/808: readlink d7/de/d28/dab/d3c/da5/ld4 0 2024-03-04T09:39:42.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/809: truncate d7/de/d12/da9/fc4 1019095 0 2024-03-04T09:39:42.039 INFO:tasks.workunit.client.0.smithi046.stdout:8/810: fsync d7/de/d4c/ffa 0 2024-03-04T09:39:42.054 INFO:tasks.workunit.client.0.smithi046.stdout:5/772: symlink d1/d44/d57/d70/lec 0 2024-03-04T09:39:42.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/761: link d0/d58/l4f d0/da/l109 0 2024-03-04T09:39:42.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/762: write d0/d4/db/d38/d7e/fe7 [654877,48204] 0 2024-03-04T09:39:42.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/763: chown d0/d4/f86 3143391 1 2024-03-04T09:39:42.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/764: dread d0/d4/db/d38/f3f [0,4194304] 0 2024-03-04T09:39:42.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/765: dwrite d0/d4/db/d38/d7e/fcf [0,4194304] 0 2024-03-04T09:39:42.518 INFO:tasks.workunit.client.0.smithi046.stdout:2/854: mkdir d5/d84/d88/d47/dcc/d11d 0 2024-03-04T09:39:42.518 INFO:tasks.workunit.client.0.smithi046.stdout:2/855: fdatasync d5/d38/f8d 0 2024-03-04T09:39:42.874 INFO:tasks.workunit.client.0.smithi046.stdout:8/811: unlink d7/de/d28/dab/d3c/lde 0 2024-03-04T09:39:42.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/812: dread d7/de/f4a [0,4194304] 0 2024-03-04T09:39:43.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/905: write d0/d3/d20/f38 [1035526,40500] 0 2024-03-04T09:39:43.030 INFO:tasks.workunit.client.0.smithi046.stdout:1/664: dwrite d1/f4d [0,4194304] 0 2024-03-04T09:39:43.686 INFO:tasks.workunit.client.0.smithi046.stdout:7/766: creat d0/d2d/f10a x:0 0 0 2024-03-04T09:39:43.930 INFO:tasks.workunit.client.0.smithi046.stdout:2/856: creat d5/d84/d88/d47/dcc/d11d/f11e x:0 0 0 2024-03-04T09:39:43.930 INFO:tasks.workunit.client.0.smithi046.stdout:0/837: sync 2024-03-04T09:39:43.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/950: sync 2024-03-04T09:39:43.931 INFO:tasks.workunit.client.0.smithi046.stdout:2/857: chown d5/db9/lcf 4464144 1 2024-03-04T09:39:43.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/951: fsync da/d14/d1e/d27/d78/d66/d11f/f129 0 2024-03-04T09:39:43.961 INFO:tasks.workunit.client.0.smithi046.stdout:8/813: dwrite d7/de/d28/dab/d2c/fae [0,4194304] 0 2024-03-04T09:39:43.961 INFO:tasks.workunit.client.0.smithi046.stdout:8/814: chown d7/de/d28/f2b 832593876 1 2024-03-04T09:39:44.032 INFO:tasks.workunit.client.0.smithi046.stdout:2/858: write d5/d40/d5a/f63 [351784,98254] 0 2024-03-04T09:39:44.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/838: dwrite d10/d12/d52/f108 [0,4194304] 0 2024-03-04T09:39:44.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/839: read - d10/d12/f11d zero size 2024-03-04T09:39:44.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/840: dread d10/d12/d9f/fd4 [0,4194304] 0 2024-03-04T09:39:44.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/906: symlink d0/d1f/d25/d50/d119/ddc/l151 0 2024-03-04T09:39:44.155 INFO:tasks.workunit.client.0.smithi046.stdout:0/841: dwrite d10/d12/f82 [0,4194304] 0 2024-03-04T09:39:44.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/665: unlink d1/cd4 0 2024-03-04T09:39:44.471 INFO:tasks.workunit.client.0.smithi046.stdout:6/952: symlink da/dd/d46/d14c/l15b 0 2024-03-04T09:39:44.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/767: creat d0/da/d46/f10b x:0 0 0 2024-03-04T09:39:44.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/768: dread d0/da/d46/d99/fb8 [0,4194304] 0 2024-03-04T09:39:44.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/953: dread da/dd/d39/d60/da0/ddd/d150/f5b [0,4194304] 0 2024-03-04T09:39:44.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/954: dread - da/d14/d1e/f143 zero size 2024-03-04T09:39:44.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/955: stat da/d4e 0 2024-03-04T09:39:44.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/956: chown da/d14/c23 133657 1 2024-03-04T09:39:44.496 INFO:tasks.workunit.client.0.smithi046.stdout:7/769: dread d0/da/d46/d99/de2/f5b [4194304,4194304] 0 2024-03-04T09:39:44.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/770: dread - d0/d4/db/d38/d94/fec zero size 2024-03-04T09:39:44.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/771: chown d0/d4/l8 498216 1 2024-03-04T09:39:44.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/772: chown d0/d4/db/d12/d28/lb7 248005652 1 2024-03-04T09:39:44.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/815: fsync d7/de/d28/dab/d2c/fa3 0 2024-03-04T09:39:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/907: symlink d0/d3/d20/d96/d6e/d85/l152 0 2024-03-04T09:39:45.266 INFO:tasks.workunit.client.0.smithi046.stdout:0/842: dread d10/d36/d7a/f111 [0,4194304] 0 2024-03-04T09:39:45.266 INFO:tasks.workunit.client.0.smithi046.stdout:0/843: creat d10/d12/d52/d78/d8a/da2/dc8/f12a x:0 0 0 2024-03-04T09:39:45.387 INFO:tasks.workunit.client.0.smithi046.stdout:0/844: dwrite f1 [0,4194304] 0 2024-03-04T09:39:45.414 INFO:tasks.workunit.client.0.smithi046.stdout:0/845: dread d10/d12/d1f/d3f/f65 [0,4194304] 0 2024-03-04T09:39:45.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/773: mkdir d0/d8f/d10c 0 2024-03-04T09:39:45.715 INFO:tasks.workunit.client.0.smithi046.stdout:7/774: dwrite d0/da/d46/d99/de2/fba [0,4194304] 0 2024-03-04T09:39:45.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/816: mkdir d7/d53/d72/d93/dd7/d74/d114 0 2024-03-04T09:39:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:2/859: getdents d5/d2c/d51/dca 0 2024-03-04T09:39:46.117 INFO:tasks.workunit.client.0.smithi046.stdout:4/908: mkdir d0/d5f/da2/d153 0 2024-03-04T09:39:46.395 INFO:tasks.workunit.client.0.smithi046.stdout:1/666: truncate d1/f56 2004337 0 2024-03-04T09:39:46.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/846: unlink d10/d12/d9f/da6/fff 0 2024-03-04T09:39:46.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/847: write d10/d12/d52/d78/d8a/da2/dc8/f12a [104132,14599] 0 2024-03-04T09:39:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/957: rmdir da/d4e 39 2024-03-04T09:39:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/958: chown da/d14/d1e/d8f 1 1 2024-03-04T09:39:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/959: dread da/dd/d39/d60/da0/d67/d64/d82/d83/f131 [0,4194304] 0 2024-03-04T09:39:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/960: chown da/dd/d22/f92 756539 1 2024-03-04T09:39:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/961: read - da/dd/d22/d12b/d94/f156 zero size 2024-03-04T09:39:46.653 INFO:tasks.workunit.client.0.smithi046.stdout:3/937: rename d1/d1d/d27/d40/d70/d105/de3/f150 to d1/d1d/d27/d40/f151 0 2024-03-04T09:39:46.653 INFO:tasks.workunit.client.0.smithi046.stdout:3/938: stat d1/c6 0 2024-03-04T09:39:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/775: creat d0/da/d46/d99/de2/db1/dc8/dcb/f10d x:0 0 0 2024-03-04T09:39:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/776: stat d0/d4/db/d38/d7e 0 2024-03-04T09:39:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/777: creat d0/d4/db/d3b/f10e x:0 0 0 2024-03-04T09:39:46.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/778: dread d0/da/d41/f95 [0,4194304] 0 2024-03-04T09:39:47.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/860: symlink d5/d84/d7c/dd0/l11f 0 2024-03-04T09:39:47.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/861: stat d5/d84/d7c/dd0 0 2024-03-04T09:39:47.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/862: creat d5/db9/dd2/df7/f120 x:0 0 0 2024-03-04T09:39:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/817: mknod d7/de/d28/d36/d7c/c115 0 2024-03-04T09:39:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/848: creat d10/d12/d1f/d3b/f12b x:0 0 0 2024-03-04T09:39:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/849: fdatasync d10/d12/d52/d78/d8a/f102 0 2024-03-04T09:39:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/850: readlink d10/d12/d52/d78/lde 0 2024-03-04T09:39:47.308 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:50:58.115 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.314 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:50:58.121 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.364 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:50:58.234 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.365 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:50:58.235 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.393 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:50:58.264 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.395 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:50:58.266 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.413 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:50:58.284 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.422 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:50:58.229 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.459 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:50:58.329 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:39:47.518 INFO:tasks.workunit.client.0.smithi046.stdout:9/887: mkdir d1/d11/d6/d118 0 2024-03-04T09:39:47.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/888: dwrite d1/d11/d6/d8/d1d/d34/d4d/d7e/ff9 [0,4194304] 0 2024-03-04T09:39:48.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/962: creat da/dd/d39/d60/da0/ddd/f15c x:0 0 0 2024-03-04T09:39:48.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/963: readlink da/d14/d1e/d27/d78/d66/d81/lbc 0 2024-03-04T09:39:48.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/939: creat d1/d1d/d27/d4a/d78/de0/d107/f152 x:0 0 0 2024-03-04T09:39:48.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/779: symlink d0/d4/db/d38/d7e/dc5/l10f 0 2024-03-04T09:39:48.806 INFO:tasks.workunit.client.0.smithi046.stdout:5/773: dwrite d1/d44/d81/faa [0,4194304] 0 2024-03-04T09:39:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:2/863: creat d5/d2c/d51/dca/f121 x:0 0 0 2024-03-04T09:39:49.075 INFO:tasks.workunit.client.0.smithi046.stdout:0/851: readlink d10/d12/d1f/d3b/l4d 0 2024-03-04T09:39:49.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/909: creat d0/d1f/f154 x:0 0 0 2024-03-04T09:39:49.434 INFO:tasks.workunit.client.0.smithi046.stdout:6/964: symlink da/dd/d39/d60/da9/l15d 0 2024-03-04T09:39:49.519 INFO:tasks.workunit.client.0.smithi046.stdout:3/940: mknod d1/d21/d35/d43/dd2/d51/c153 0 2024-03-04T09:39:49.547 INFO:tasks.workunit.client.0.smithi046.stdout:3/941: dread d1/d74/f99 [0,4194304] 0 2024-03-04T09:39:49.597 INFO:tasks.workunit.client.0.smithi046.stdout:7/780: symlink d0/d4/db/d38/d7e/l110 0 2024-03-04T09:39:49.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/774: truncate d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f46 560805 0 2024-03-04T09:39:50.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/775: dread d1/d44/d81/faa [0,4194304] 0 2024-03-04T09:39:50.038 INFO:tasks.workunit.client.0.smithi046.stdout:2/864: creat d5/d2c/d51/d61/db5/f122 x:0 0 0 2024-03-04T09:39:50.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/865: dread d5/d40/d117/fdf [0,4194304] 0 2024-03-04T09:39:50.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/818: rmdir d7/de/d28/dab/d2c/d62/ddb 39 2024-03-04T09:39:50.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/819: write d7/de/d28/dab/f88 [154927,35848] 0 2024-03-04T09:39:50.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/820: stat d7/de/d12/c34 0 2024-03-04T09:39:50.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/910: creat d0/d3/d20/d96/d6e/f155 x:0 0 0 2024-03-04T09:39:50.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/965: truncate da/dd/d46/f72 2223903 0 2024-03-04T09:39:50.585 INFO:tasks.workunit.client.0.smithi046.stdout:3/942: symlink d1/d21/d35/d43/dd2/l154 0 2024-03-04T09:39:50.628 INFO:tasks.workunit.client.0.smithi046.stdout:3/943: dwrite d1/d21/d35/f90 [0,4194304] 0 2024-03-04T09:39:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/781: mkdir d0/d8f/d111 0 2024-03-04T09:39:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/782: creat d0/d4/db/d38/d94/f112 x:0 0 0 2024-03-04T09:39:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/783: write d0/da/f7d [671411,73394] 0 2024-03-04T09:39:50.721 INFO:tasks.workunit.client.0.smithi046.stdout:7/784: write d0/da/d46/d99/de2/fba [4038253,77594] 0 2024-03-04T09:39:50.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/785: write d0/da/f42 [1234416,112730] 0 2024-03-04T09:39:50.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/786: write d0/d4/db/d38/d94/fe8 [828006,103276] 0 2024-03-04T09:39:50.912 INFO:tasks.workunit.client.0.smithi046.stdout:2/866: mknod d5/d84/d88/d47/dcc/d11d/c123 0 2024-03-04T09:39:51.057 INFO:tasks.workunit.client.0.smithi046.stdout:8/821: getdents d7/de/d28/dab/d2c/d62 0 2024-03-04T09:39:51.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/966: mkdir da/dd/d39/d60/dac/daf/d15e 0 2024-03-04T09:39:52.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/787: mkdir d0/d4/db/d38/d94/d113 0 2024-03-04T09:39:52.105 INFO:tasks.workunit.client.0.smithi046.stdout:7/788: write d0/da/d4e/dd2/fd9 [3702075,2041] 0 2024-03-04T09:39:52.105 INFO:tasks.workunit.client.0.smithi046.stdout:7/789: creat d0/d4/db/d38/d94/f114 x:0 0 0 2024-03-04T09:39:52.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/867: creat d5/d40/d117/f124 x:0 0 0 2024-03-04T09:39:52.434 INFO:tasks.workunit.client.0.smithi046.stdout:8/822: mkdir d7/de/d28/dca/d116 0 2024-03-04T09:39:52.504 INFO:tasks.workunit.client.0.smithi046.stdout:6/967: mkdir da/dd/d39/d60/da9/d15f 0 2024-03-04T09:39:52.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:39:52.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:39:52.802 INFO:tasks.workunit.client.0.smithi046.stdout:8/823: dread d7/d53/fe9 [0,4194304] 0 2024-03-04T09:39:52.802 INFO:tasks.workunit.client.0.smithi046.stdout:8/824: chown d7/de/d12/da9/l10d 598287 1 2024-03-04T09:39:53.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/790: getdents d0/d58 0 2024-03-04T09:39:53.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/791: write d0/da/f29 [4315620,1134] 0 2024-03-04T09:39:54.039 INFO:tasks.workunit.client.0.smithi046.stdout:2/868: mknod d5/d84/d7c/dae/c125 0 2024-03-04T09:39:54.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/869: dwrite d5/d40/dde/fdb [0,4194304] 0 2024-03-04T09:39:54.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/870: readlink d5/d2c/d51/d7f/d92/la3 0 2024-03-04T09:39:54.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/871: chown d5/da/d1b/d116 9 1 2024-03-04T09:39:54.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/872: chown d5/d40/d5a/fff 737198 1 2024-03-04T09:39:54.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/825: mknod d7/d53/d72/d93/dd7/c117 0 2024-03-04T09:39:54.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/826: dread - d7/d53/d72/d93/fd5 zero size 2024-03-04T09:39:54.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/827: write d7/de/d28/dab/d2c/d62/f101 [1408664,31416] 0 2024-03-04T09:39:54.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/828: readlink d7/de/l47 0 2024-03-04T09:39:54.538 INFO:tasks.workunit.client.0.smithi046.stdout:5/776: rename d1/d44/d81/d96/d20/l52 to d1/d44/d81/d96/d20/d5e/led 0 2024-03-04T09:39:54.955 INFO:tasks.workunit.client.0.smithi046.stdout:9/889: unlink d1/d11/d6/d8/d12/lb2 0 2024-03-04T09:39:54.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/890: dread d1/ffa [0,4194304] 0 2024-03-04T09:39:55.017 INFO:tasks.workunit.client.0.smithi046.stdout:2/873: chown d5/d84/d88/fc1 40 1 2024-03-04T09:39:55.378 INFO:tasks.workunit.client.0.smithi046.stdout:8/829: mknod d7/de/d28/dab/d3c/da5/c118 0 2024-03-04T09:39:55.378 INFO:tasks.workunit.client.0.smithi046.stdout:4/911: rename d0/d1f/d25/d50/d119/d1e/f36 to d0/d3/d20/d96/f156 0 2024-03-04T09:39:55.378 INFO:tasks.workunit.client.0.smithi046.stdout:4/912: chown d0/d1f/db9/ddd/d114/f11d 72 1 2024-03-04T09:39:55.378 INFO:tasks.workunit.client.0.smithi046.stdout:8/830: fdatasync d7/de/f7b 0 2024-03-04T09:39:55.379 INFO:tasks.workunit.client.0.smithi046.stdout:8/831: getdents d7/de/d28/dab/d2c/d62 0 2024-03-04T09:39:55.379 INFO:tasks.workunit.client.0.smithi046.stdout:8/832: write d7/de/f1b [550813,13273] 0 2024-03-04T09:39:55.411 INFO:tasks.workunit.client.0.smithi046.stdout:8/833: dread d7/de/f18 [0,4194304] 0 2024-03-04T09:39:55.411 INFO:tasks.workunit.client.0.smithi046.stdout:8/834: fdatasync d7/de/d3e/f91 0 2024-03-04T09:39:55.411 INFO:tasks.workunit.client.0.smithi046.stdout:8/835: fdatasync d7/fd 0 2024-03-04T09:39:55.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/874: unlink d5/d84/d88/cfd 0 2024-03-04T09:39:55.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/875: chown d5/d40/d117/daa 21890 1 2024-03-04T09:39:55.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/876: readlink d5/da/d1b/l113 0 2024-03-04T09:39:55.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/792: rename d0/d4/db/d12/d28/f5c to d0/da/d46/d99/de2/de3/f115 0 2024-03-04T09:39:55.875 INFO:tasks.workunit.client.0.smithi046.stdout:7/793: dread d0/d4/db/d38/f57 [0,4194304] 0 2024-03-04T09:39:56.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/836: creat d7/de/d28/dab/dc1/dfc/f119 x:0 0 0 2024-03-04T09:39:56.303 INFO:tasks.workunit.client.0.smithi046.stdout:8/837: dwrite d7/de/d28/d3a/d6f/d84/f8e [0,4194304] 0 2024-03-04T09:39:56.326 INFO:tasks.workunit.client.0.smithi046.stdout:8/838: read d7/de/d28/dab/d2c/fae [902618,99864] 0 2024-03-04T09:39:56.326 INFO:tasks.workunit.client.0.smithi046.stdout:8/839: chown d7/de/d28/dab/dc1/dfc/f119 11 1 2024-03-04T09:39:56.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/877: dread d5/da/dbd/fcd [0,4194304] 0 2024-03-04T09:39:56.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/878: fdatasync d5/d40/d117/f124 0 2024-03-04T09:39:56.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/879: truncate d5/d84/d9a/f115 199689 0 2024-03-04T09:39:56.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/667: sync 2024-03-04T09:39:56.955 INFO:tasks.workunit.client.0.smithi046.stdout:4/913: getdents d0/d1f/de8 0 2024-03-04T09:39:56.978 INFO:tasks.workunit.client.0.smithi046.stdout:4/914: read d0/d1f/d25/d7b/f110 [3794737,35508] 0 2024-03-04T09:39:56.978 INFO:tasks.workunit.client.0.smithi046.stdout:4/915: chown d0/d1f/d25/c34 27943 1 2024-03-04T09:39:56.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/794: link d0/d4/db/f25 d0/d2d/f116 0 2024-03-04T09:39:57.014 INFO:tasks.workunit.client.0.smithi046.stdout:8/840: read d7/de/d12/fb7 [2618699,95968] 0 2024-03-04T09:39:57.083 INFO:tasks.workunit.client.0.smithi046.stdout:2/880: creat d5/d2c/d51/d61/f126 x:0 0 0 2024-03-04T09:39:57.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/668: chown d1/c15 50997 1 2024-03-04T09:39:57.288 INFO:tasks.workunit.client.0.smithi046.stdout:5/777: rename d1/d44/d81/d96/d20/c25 to d1/d44/d81/d96/d54/cee 0 2024-03-04T09:39:57.288 INFO:tasks.workunit.client.0.smithi046.stdout:5/778: readlink d1/d44/d81/d96/d20/d76/d6c/db2/lce 0 2024-03-04T09:39:57.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/852: write fc [2182598,126077] 0 2024-03-04T09:39:57.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/853: dread - d10/d12/d1f/d3f/d4b/f115 zero size 2024-03-04T09:39:57.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/854: write f7 [4499112,85667] 0 2024-03-04T09:39:57.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/855: write d10/d12/d1f/d3f/f120 [296357,57652] 0 2024-03-04T09:39:57.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/944: write d1/d21/ff9 [329270,59079] 0 2024-03-04T09:39:57.865 INFO:tasks.workunit.client.0.smithi046.stdout:8/841: truncate d7/d53/fe9 215821 0 2024-03-04T09:39:58.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/881: getdents d5/da 0 2024-03-04T09:39:58.315 INFO:tasks.workunit.client.0.smithi046.stdout:1/669: symlink d1/d28/d6f/db1/ld5 0 2024-03-04T09:39:58.623 INFO:tasks.workunit.client.0.smithi046.stdout:0/856: mknod d10/d12/d1f/d3f/c12c 0 2024-03-04T09:39:58.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/945: link d1/d21/d35/d43/fbd d1/d1d/d27/def/f155 0 2024-03-04T09:39:59.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/842: fsync d7/de/d4c/d50/f7a 0 2024-03-04T09:39:59.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/843: dread d7/fc [4194304,4194304] 0 2024-03-04T09:39:59.388 INFO:tasks.workunit.client.0.smithi046.stdout:6/968: dwrite da/dd/d39/d60/da0/f88 [0,4194304] 0 2024-03-04T09:39:59.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/882: symlink d5/d84/l127 0 2024-03-04T09:39:59.611 INFO:tasks.workunit.client.0.smithi046.stdout:1/670: creat d1/d28/d6f/db7/dba/fd6 x:0 0 0 2024-03-04T09:39:59.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/779: mkdir d1/d44/d57/d70/d86/def 0 2024-03-04T09:39:59.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/780: write d1/d44/d81/d96/d9a/da0/fe5 [261390,126360] 0 2024-03-04T09:40:00.997 INFO:tasks.workunit.client.0.smithi046.stdout:1/671: creat d1/d92/d9a/fd7 x:0 0 0 2024-03-04T09:40:01.207 INFO:tasks.workunit.client.0.smithi046.stdout:5/781: creat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/ff0 x:0 0 0 2024-03-04T09:40:01.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/857: mkdir d10/d12/d1f/d3b/d6b/d12d 0 2024-03-04T09:40:01.346 INFO:tasks.workunit.client.0.smithi046.stdout:0/858: stat d10/d12/d6e/c90 0 2024-03-04T09:40:01.639 INFO:tasks.workunit.client.0.smithi046.stdout:8/844: mkdir d7/de/d28/dab/d2c/d11a 0 2024-03-04T09:40:02.066 INFO:tasks.workunit.client.0.smithi046.stdout:2/883: unlink d5/d84/d7c/dae/ff8 0 2024-03-04T09:40:02.066 INFO:tasks.workunit.client.0.smithi046.stdout:1/672: link d1/d92/d96/da7/lb0 d1/d28/d6f/ld8 0 2024-03-04T09:40:02.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/782: mkdir d1/d44/d69/dcd/df1 0 2024-03-04T09:40:02.087 INFO:tasks.workunit.client.0.smithi046.stdout:0/859: getdents d10/d36 0 2024-03-04T09:40:02.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/845: link d7/d53/lda d7/de/d28/dab/dc1/dfc/l11b 0 2024-03-04T09:40:02.544 INFO:tasks.workunit.client.0.smithi046.stdout:6/969: rename da/dd/d39/cd9 to da/c160 0 2024-03-04T09:40:02.569 INFO:tasks.workunit.client.0.smithi046.stdout:9/891: write d1/d11/d6/d8/d13/d92/fcd [11539655,54175] 0 2024-03-04T09:40:02.592 INFO:tasks.workunit.client.0.smithi046.stdout:6/970: dwrite da/dd/d39/d60/da0/d67/d64/d56/d86/f95 [0,4194304] 0 2024-03-04T09:40:02.592 INFO:tasks.workunit.client.0.smithi046.stdout:6/971: truncate da/d14/d1e/d8f/ddf/d103/d123/f148 483482 0 2024-03-04T09:40:02.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/884: symlink d5/d84/d7c/dd0/l128 0 2024-03-04T09:40:02.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/673: mknod d1/d28/d6f/dbe/cd9 0 2024-03-04T09:40:02.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/674: creat d1/d28/d6f/db7/dba/fda x:0 0 0 2024-03-04T09:40:02.818 INFO:tasks.workunit.client.0.smithi046.stdout:5/783: read d1/d44/d81/fb5 [661796,127555] 0 2024-03-04T09:40:02.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/860: rmdir d10/d12/d52/d78/d8a/da2 39 2024-03-04T09:40:02.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/861: dread d10/d12/d9f/fd4 [0,4194304] 0 2024-03-04T09:40:03.154 INFO:tasks.workunit.client.0.smithi046.stdout:9/892: truncate d1/d11/d6/d8/d1d/d34/d7f/fbf 550398 0 2024-03-04T09:40:03.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/972: rename da/d14/d1e/d27/d78/f5f to da/dd/d39/d60/da0/ddd/d150/d155/f161 0 2024-03-04T09:40:03.949 INFO:tasks.workunit.client.0.smithi046.stdout:1/675: getdents d1/d92/d96/da7 0 2024-03-04T09:40:04.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/784: mknod d1/d44/d81/d96/d4f/cf2 0 2024-03-04T09:40:04.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/862: unlink d10/d12/d1f/d3f/d7e/lc6 0 2024-03-04T09:40:04.547 INFO:tasks.workunit.client.0.smithi046.stdout:6/973: creat da/dd/d46/d14c/f162 x:0 0 0 2024-03-04T09:40:04.573 INFO:tasks.workunit.client.0.smithi046.stdout:4/916: dwrite d0/d5f/d6f/f107 [0,4194304] 0 2024-03-04T09:40:04.587 INFO:tasks.workunit.client.0.smithi046.stdout:6/974: write da/dd/f36 [422101,100560] 0 2024-03-04T09:40:05.279 INFO:tasks.workunit.client.0.smithi046.stdout:4/917: mkdir d0/d1f/d25/d50/d119/d1e/da1/dcc/d157 0 2024-03-04T09:40:06.610 INFO:tasks.workunit.client.0.smithi046.stdout:4/918: mkdir d0/d3/d3b/d158 0 2024-03-04T09:40:06.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/885: rename d5/d84/d7c/dae to d5/da/d129 0 2024-03-04T09:40:06.611 INFO:tasks.workunit.client.0.smithi046.stdout:4/919: dread - d0/d3/d3b/d9d/f109 zero size 2024-03-04T09:40:06.611 INFO:tasks.workunit.client.0.smithi046.stdout:4/920: dread - d0/d3/d3b/d8d/f13e zero size 2024-03-04T09:40:06.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/886: rmdir d5/d2c 39 2024-03-04T09:40:06.999 INFO:tasks.workunit.client.0.smithi046.stdout:4/921: write d0/d3/d20/f64 [4494359,11076] 0 2024-03-04T09:40:07.235 INFO:tasks.workunit.client.0.smithi046.stdout:8/846: write d7/de/d28/d3a/d6f/d84/fce [2687584,130909] 0 2024-03-04T09:40:07.295 INFO:tasks.workunit.client.0.smithi046.stdout:4/922: read d0/d3/d20/d96/d6e/d85/da7/fd3 [3201341,3553] 0 2024-03-04T09:40:07.295 INFO:tasks.workunit.client.0.smithi046.stdout:4/923: creat d0/d3/d20/d96/d6e/d85/f159 x:0 0 0 2024-03-04T09:40:07.295 INFO:tasks.workunit.client.0.smithi046.stdout:8/847: dwrite d7/de/d12/fad [0,4194304] 0 2024-03-04T09:40:07.302 INFO:tasks.workunit.client.0.smithi046.stdout:8/848: fdatasync d7/de/d28/d3a/d6f/d84/fce 0 2024-03-04T09:40:07.464 INFO:tasks.workunit.client.0.smithi046.stdout:2/887: truncate f3 1530386 0 2024-03-04T09:40:08.134 INFO:tasks.workunit.client.0.smithi046.stdout:4/924: symlink d0/d5f/da2/d153/l15a 0 2024-03-04T09:40:08.134 INFO:tasks.workunit.client.0.smithi046.stdout:4/925: fsync d0/d1f/de8/ffa 0 2024-03-04T09:40:08.677 INFO:tasks.workunit.client.0.smithi046.stdout:4/926: unlink d0/d3/d20/d96/d6e/d85/da7/c10d 0 2024-03-04T09:40:08.980 INFO:tasks.workunit.client.0.smithi046.stdout:8/849: mknod d7/de/d4c/d50/c11c 0 2024-03-04T09:40:09.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/893: write d1/d11/d6/d8/d36/fcf [383802,96469] 0 2024-03-04T09:40:09.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/946: symlink d1/l156 0 2024-03-04T09:40:09.316 INFO:tasks.workunit.client.0.smithi046.stdout:3/947: chown d1/c7 1 1 2024-03-04T09:40:09.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/894: mknod d1/d11/d6/d8/d12/d1c/c119 0 2024-03-04T09:40:09.658 INFO:tasks.workunit.client.0.smithi046.stdout:3/948: chown d1/d1d/d27/d40/d76/d8d/d95/f9e 13661083 1 2024-03-04T09:40:09.786 INFO:tasks.workunit.client.0.smithi046.stdout:9/895: mknod d1/d11/d6/d8/d36/c11a 0 2024-03-04T09:40:10.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/949: mknod d1/d1d/d27/d40/d76/c157 0 2024-03-04T09:40:10.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/950: chown d1/d1d/d27/d4a/d78/fdd 84112483 1 2024-03-04T09:40:10.418 INFO:tasks.workunit.client.0.smithi046.stdout:9/896: creat d1/d11/d6/d8/d13/d85/f11b x:0 0 0 2024-03-04T09:40:10.418 INFO:tasks.workunit.client.0.smithi046.stdout:9/897: chown d1/d11/d6/d8/d1d/d34/d4d 1520 1 2024-03-04T09:40:10.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/795: symlink d0/d4/db/d38/l117 0 2024-03-04T09:40:10.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/796: readlink d0/d4/db/d3b/d6b/lcc 0 2024-03-04T09:40:11.073 INFO:tasks.workunit.client.0.smithi046.stdout:3/951: link d1/d1d/d27/d4a/d78/de0/d107/d114/f145 d1/db0/d134/d14f/f158 0 2024-03-04T09:40:11.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/952: dread d1/d21/d35/d24/ff0 [0,4194304] 0 2024-03-04T09:40:11.109 INFO:tasks.workunit.client.0.smithi046.stdout:3/953: dread d1/d74/f99 [0,4194304] 0 2024-03-04T09:40:11.228 INFO:tasks.workunit.client.0.smithi046.stdout:7/797: creat d0/d58/d103/f118 x:0 0 0 2024-03-04T09:40:11.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/798: dwrite d0/d4/db/d38/d94/f112 [0,4194304] 0 2024-03-04T09:40:11.323 INFO:tasks.workunit.client.0.smithi046.stdout:7/799: dread d0/da/fac [4194304,4194304] 0 2024-03-04T09:40:11.323 INFO:tasks.workunit.client.0.smithi046.stdout:7/800: truncate d0/da/d46/ff2 56064 0 2024-03-04T09:40:11.394 INFO:tasks.workunit.client.0.smithi046.stdout:7/801: dwrite d0/da/d46/d99/de2/fdd [0,4194304] 0 2024-03-04T09:40:11.610 INFO:tasks.workunit.client.0.smithi046.stdout:2/888: dwrite d5/d2c/d51/d61/f64 [0,4194304] 0 2024-03-04T09:40:11.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/889: dwrite d5/d38/f8d [0,4194304] 0 2024-03-04T09:40:11.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/890: write d5/d2c/d51/fad [1315456,59769] 0 2024-03-04T09:40:11.677 INFO:tasks.workunit.client.0.smithi046.stdout:2/891: dread d5/d2c/f6a [0,4194304] 0 2024-03-04T09:40:12.108 INFO:tasks.workunit.client.0.smithi046.stdout:7/802: mkdir d0/d4/db/d12/d28/df6/d119 0 2024-03-04T09:40:12.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/803: dread d0/f16 [0,4194304] 0 2024-03-04T09:40:12.167 INFO:tasks.workunit.client.0.smithi046.stdout:7/804: write d0/d4/db/d38/d7e/fcf [766111,93718] 0 2024-03-04T09:40:12.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/805: dread d0/f11 [4194304,4194304] 0 2024-03-04T09:40:12.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/806: write d0/da/d46/f10b [27497,31134] 0 2024-03-04T09:40:12.222 INFO:tasks.workunit.client.0.smithi046.stdout:7/807: write d0/da/d41/f95 [492569,110171] 0 2024-03-04T09:40:12.241 INFO:tasks.workunit.client.0.smithi046.stdout:7/808: write d0/f16 [16445,34550] 0 2024-03-04T09:40:12.242 INFO:tasks.workunit.client.0.smithi046.stdout:7/809: write d0/da/d46/fce [971476,97641] 0 2024-03-04T09:40:13.597 INFO:tasks.workunit.client.0.smithi046.stdout:5/785: rename d1/d44/d81/d96/d20/fcf to d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/ff3 0 2024-03-04T09:40:13.790 INFO:tasks.workunit.client.0.smithi046.stdout:1/676: sync 2024-03-04T09:40:14.336 INFO:tasks.workunit.client.0.smithi046.stdout:5/786: creat d1/d44/d81/d96/d20/d76/d6c/db2/dcb/ff4 x:0 0 0 2024-03-04T09:40:14.836 INFO:tasks.workunit.client.0.smithi046.stdout:5/787: creat d1/d44/d81/d96/d9a/ff5 x:0 0 0 2024-03-04T09:40:15.257 INFO:tasks.workunit.client.0.smithi046.stdout:3/954: mkdir d1/d1d/d27/d159 0 2024-03-04T09:40:15.276 INFO:tasks.workunit.client.0.smithi046.stdout:3/955: dread d1/d21/ff9 [0,4194304] 0 2024-03-04T09:40:15.456 INFO:tasks.workunit.client.0.smithi046.stdout:2/892: write d5/d84/d88/fc1 [959343,35241] 0 2024-03-04T09:40:15.805 INFO:tasks.workunit.client.0.smithi046.stdout:5/788: link d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f66 d1/d44/d81/d96/d20/d76/d6c/db2/dcb/ff6 0 2024-03-04T09:40:15.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/956: mkdir d1/d1d/d27/d40/d70/d105/de3/d15a 0 2024-03-04T09:40:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:5/789: truncate d1/d44/d81/d96/d20/f42 4069164 0 2024-03-04T09:40:16.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/863: rename d10/d12/f11d to d10/d12/d1f/d3b/f12e 0 2024-03-04T09:40:16.921 INFO:tasks.workunit.client.0.smithi046.stdout:5/790: unlink d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/cae 0 2024-03-04T09:40:17.133 INFO:tasks.workunit.client.0.smithi046.stdout:6/975: rename c1 to da/d14/de0/c163 0 2024-03-04T09:40:17.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/810: sync 2024-03-04T09:40:17.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/976: unlink da/dd/d39/d60/da0/d67/d64/d56/fb4 0 2024-03-04T09:40:18.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/811: mknod d0/da/d46/d99/de2/db1/dc8/c11a 0 2024-03-04T09:40:18.103 INFO:tasks.workunit.client.0.smithi046.stdout:7/812: dread d0/da/d41/f95 [0,4194304] 0 2024-03-04T09:40:18.103 INFO:tasks.workunit.client.0.smithi046.stdout:7/813: creat d0/da/d46/f11b x:0 0 0 2024-03-04T09:40:18.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/791: symlink d1/d44/d81/d96/d54/lf7 0 2024-03-04T09:40:18.205 INFO:tasks.workunit.client.0.smithi046.stdout:7/814: dwrite d0/da/d46/d99/de2/fba [0,4194304] 0 2024-03-04T09:40:18.206 INFO:tasks.workunit.client.0.smithi046.stdout:7/815: write d0/d4/db/d38/d94/fe8 [1387271,69470] 0 2024-03-04T09:40:18.409 INFO:tasks.workunit.client.0.smithi046.stdout:6/977: rmdir da/dd8/d141 39 2024-03-04T09:40:18.409 INFO:tasks.workunit.client.0.smithi046.stdout:6/978: readlink da/d14/d1e/d27/da3/l146 0 2024-03-04T09:40:18.409 INFO:tasks.workunit.client.0.smithi046.stdout:6/979: write da/d14/d1e/d8f/ddf/f12d [1559210,4097] 0 2024-03-04T09:40:18.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/980: dwrite da/dd/d39/d60/dac/daf/d11d/f11c [0,4194304] 0 2024-03-04T09:40:18.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/981: stat da/dd/d39/d60/da0/d67/d64/d82/l97 0 2024-03-04T09:40:18.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/982: write da/dd/d39/d60/da0/fa5 [1143943,37711] 0 2024-03-04T09:40:18.641 INFO:tasks.workunit.client.0.smithi046.stdout:5/792: rmdir d1/d44/d57/dc7/de7 39 2024-03-04T09:40:19.338 INFO:tasks.workunit.client.0.smithi046.stdout:4/927: rename d0/d1f/db9/ddd to d0/d1f/d25/d50/d119/d76/d15b 0 2024-03-04T09:40:19.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/864: sync 2024-03-04T09:40:19.882 INFO:tasks.workunit.client.0.smithi046.stdout:6/983: mknod da/dd/d22/d12b/dab/ddc/c164 0 2024-03-04T09:40:20.386 INFO:tasks.workunit.client.0.smithi046.stdout:0/865: read d10/d12/fb3 [60261,77171] 0 2024-03-04T09:40:20.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/850: rename d7/de/d28/dab/d2c/d64/dea/f104 to d7/de/d4c/f11d 0 2024-03-04T09:40:20.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/851: chown d7/de/d28/dab/d3c/da5/def 1245486202 1 2024-03-04T09:40:20.792 INFO:tasks.workunit.client.0.smithi046.stdout:8/852: dread d7/de/d3e/da1/fa6 [0,4194304] 0 2024-03-04T09:40:20.826 INFO:tasks.workunit.client.0.smithi046.stdout:8/853: write d7/de/d28/f58 [3054195,58944] 0 2024-03-04T09:40:20.968 INFO:tasks.workunit.client.0.smithi046.stdout:0/866: creat d10/d12/d9f/f12f x:0 0 0 2024-03-04T09:40:21.324 INFO:tasks.workunit.client.0.smithi046.stdout:9/898: rename d1/d11/d6/d8/d1d/d34/d35/f76 to d1/d11/d6/d118/f11c 0 2024-03-04T09:40:21.324 INFO:tasks.workunit.client.0.smithi046.stdout:9/899: chown d1/d11/d6/d8/d36/c11a 1274894 1 2024-03-04T09:40:21.324 INFO:tasks.workunit.client.0.smithi046.stdout:9/900: readlink d1/d11/d6/d8/d12/d1c/dd1/l5c 0 2024-03-04T09:40:21.324 INFO:tasks.workunit.client.0.smithi046.stdout:9/901: read - d1/d11/d6/d8/d36/fd8 zero size 2024-03-04T09:40:21.389 INFO:tasks.workunit.client.0.smithi046.stdout:9/902: dwrite d1/d11/d6/d8/d36/fcf [0,4194304] 0 2024-03-04T09:40:21.411 INFO:tasks.workunit.client.0.smithi046.stdout:9/903: write d1/d11/d6/d8/d6f/d8c/d9a/ddc/f101 [376706,69552] 0 2024-03-04T09:40:21.412 INFO:tasks.workunit.client.0.smithi046.stdout:9/904: write d1/fc5 [598156,111049] 0 2024-03-04T09:40:21.412 INFO:tasks.workunit.client.0.smithi046.stdout:9/905: write d1/d11/d6/d8/d12/d1c/d26/fb9 [838689,7960] 0 2024-03-04T09:40:21.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/854: rmdir d7/de/d28 39 2024-03-04T09:40:21.470 INFO:tasks.workunit.client.0.smithi046.stdout:0/867: symlink d10/d12/d1f/d3b/d6b/l130 0 2024-03-04T09:40:21.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/855: write d7/f1a [4462541,68247] 0 2024-03-04T09:40:21.471 INFO:tasks.workunit.client.0.smithi046.stdout:0/868: write d10/d12/d6e/d99/fa8 [1054277,74181] 0 2024-03-04T09:40:21.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/856: chown d7/de/c25 1424 1 2024-03-04T09:40:21.491 INFO:tasks.workunit.client.0.smithi046.stdout:8/857: write f2 [3534922,120947] 0 2024-03-04T09:40:22.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/793: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/fc9 [0,4194304] 0 2024-03-04T09:40:22.491 INFO:tasks.workunit.client.0.smithi046.stdout:9/906: unlink d1/d11/d6/d8/d12/d1c/dd1/d5e/fbe 0 2024-03-04T09:40:22.491 INFO:tasks.workunit.client.0.smithi046.stdout:9/907: creat d1/d11/d6/d8/d12/d1c/d26/f11d x:0 0 0 2024-03-04T09:40:22.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/984: dwrite da/dd/d39/d60/da0/ddd/f101 [0,4194304] 0 2024-03-04T09:40:22.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/985: dread - da/dd/d39/d60/da0/d67/d64/d82/d13b/f113 zero size 2024-03-04T09:40:22.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/986: chown da/dd/f36 0 1 2024-03-04T09:40:22.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/987: fdatasync da/dd/d39/d60/da0/d67/dcf/f127 0 2024-03-04T09:40:22.843 INFO:tasks.workunit.client.0.smithi046.stdout:1/677: rename d1/d28/f5b to d1/d92/d96/da7/fdb 0 2024-03-04T09:40:22.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:40:22.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:40:22.960 INFO:tasks.workunit.client.0.smithi046.stdout:5/794: creat d1/d44/d81/d96/d20/d76/d6c/ff8 x:0 0 0 2024-03-04T09:40:23.289 INFO:tasks.workunit.client.0.smithi046.stdout:7/816: rmdir d0/da/d46 39 2024-03-04T09:40:23.289 INFO:tasks.workunit.client.0.smithi046.stdout:7/817: chown d0/d4/db/d38/l45 112 1 2024-03-04T09:40:23.366 INFO:tasks.workunit.client.0.smithi046.stdout:7/818: dwrite d0/d4/db/d38/d7e/dc5/fdf [0,4194304] 0 2024-03-04T09:40:23.366 INFO:tasks.workunit.client.0.smithi046.stdout:7/819: stat d0/da/d46/l83 0 2024-03-04T09:40:23.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/893: rename d5/f9d to d5/d40/da8/f12a 0 2024-03-04T09:40:23.752 INFO:tasks.workunit.client.0.smithi046.stdout:1/678: mknod d1/d28/d6f/db7/cdc 0 2024-03-04T09:40:24.496 INFO:tasks.workunit.client.0.smithi046.stdout:7/820: creat d0/da/d4e/dd2/f11c x:0 0 0 2024-03-04T09:40:24.696 INFO:tasks.workunit.client.0.smithi046.stdout:9/908: mkdir d1/d11/d6/d8/d1d/d34/d4d/d11e 0 2024-03-04T09:40:24.777 INFO:tasks.workunit.client.0.smithi046.stdout:8/858: dwrite d7/de/d28/dab/f35 [0,4194304] 0 2024-03-04T09:40:24.777 INFO:tasks.workunit.client.0.smithi046.stdout:8/859: readlink d7/de/d28/d3a/d6f/l8f 0 2024-03-04T09:40:24.777 INFO:tasks.workunit.client.0.smithi046.stdout:8/860: creat d7/de/d28/dab/dc1/f11e x:0 0 0 2024-03-04T09:40:24.855 INFO:tasks.workunit.client.0.smithi046.stdout:8/861: dwrite d7/de/d28/dab/d2c/d62/f8d [4194304,4194304] 0 2024-03-04T09:40:25.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/957: rename d1/d88/cb9 to d1/d21/d35/d43/dd2/d9a/d11d/c15b 0 2024-03-04T09:40:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/958: write d1/d1d/d27/d4a/f126 [3835965,34945] 0 2024-03-04T09:40:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/959: chown d1/d1d/d27/d4a/c67 1 1 2024-03-04T09:40:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/960: write d1/d1d/f6b [106157,53897] 0 2024-03-04T09:40:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/961: chown d1/d1d/d27/d4a/c67 217143 1 2024-03-04T09:40:25.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/679: chown d1/l51 19487 1 2024-03-04T09:40:26.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/821: mknod d0/d3c/c11d 0 2024-03-04T09:40:26.349 INFO:tasks.workunit.client.0.smithi046.stdout:9/909: creat d1/d11/d6/d118/f11f x:0 0 0 2024-03-04T09:40:26.723 INFO:tasks.workunit.client.0.smithi046.stdout:8/862: unlink d7/d53/d72/fa8 0 2024-03-04T09:40:26.746 INFO:tasks.workunit.client.0.smithi046.stdout:8/863: dread d7/de/d28/d3a/d6f/d84/fbb [0,4194304] 0 2024-03-04T09:40:27.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/928: rename d0/d1f/d25/d50/d119/d1e/da1/l13f to d0/d5f/da2/l15c 0 2024-03-04T09:40:27.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/929: write d0/d1f/d35/f118 [125748,46591] 0 2024-03-04T09:40:27.153 INFO:tasks.workunit.client.0.smithi046.stdout:3/962: mkdir d1/d74/d15c 0 2024-03-04T09:40:27.586 INFO:tasks.workunit.client.0.smithi046.stdout:9/910: link d1/d11/d6/d8/d1d/d34/d7f/dfc/c10f d1/d11/d6/d8/d1d/d34/d7f/c120 0 2024-03-04T09:40:27.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/864: mkdir d7/de/d28/dab/d2c/d64/db8/d11f 0 2024-03-04T09:40:27.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/865: write d7/de/d3e/f80 [1046609,114725] 0 2024-03-04T09:40:27.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/930: unlink d0/d1f/d25/c2f 0 2024-03-04T09:40:27.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/963: symlink d1/d1d/d27/d40/d76/dfd/l15d 0 2024-03-04T09:40:27.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/964: getdents d1/d21/d35 0 2024-03-04T09:40:27.654 INFO:tasks.workunit.client.0.smithi046.stdout:8/866: dwrite d7/de/f75 [0,4194304] 0 2024-03-04T09:40:27.655 INFO:tasks.workunit.client.0.smithi046.stdout:8/867: creat d7/de/d28/d3a/d7d/f120 x:0 0 0 2024-03-04T09:40:27.990 INFO:tasks.workunit.client.0.smithi046.stdout:9/911: mknod d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/daf/c121 0 2024-03-04T09:40:27.990 INFO:tasks.workunit.client.0.smithi046.stdout:9/912: fsync d1/d11/d6/d8/d12/d1c/d26/fb9 0 2024-03-04T09:40:27.990 INFO:tasks.workunit.client.0.smithi046.stdout:5/795: write d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/ff3 [92828,11293] 0 2024-03-04T09:40:28.010 INFO:tasks.workunit.client.0.smithi046.stdout:9/913: dread d1/d11/d6/d8/d12/f103 [0,4194304] 0 2024-03-04T09:40:28.010 INFO:tasks.workunit.client.0.smithi046.stdout:9/914: dread - d1/d11/d3e/fdf zero size 2024-03-04T09:40:28.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/915: write d1/d11/d6/d8/d12/d1c/d26/fb9 [24202,63131] 0 2024-03-04T09:40:28.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/916: dwrite d1/d11/d6/d8/fef [0,4194304] 0 2024-03-04T09:40:28.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/965: rmdir d1/d1d/d27/d40/d70/d7d 39 2024-03-04T09:40:29.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/966: creat d1/d74/d15c/f15e x:0 0 0 2024-03-04T09:40:30.038 INFO:tasks.workunit.client.0.smithi046.stdout:0/869: rename d10/d12/d6e/d99/dea to d10/d131 0 2024-03-04T09:40:30.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/680: dwrite d1/d92/f9b [0,4194304] 0 2024-03-04T09:40:31.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/988: rename da/d14/de0 to da/dd/d39/d60/da0/d67/d165 0 2024-03-04T09:40:31.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/894: rename d5/d40/d5a/fff to d5/d38/d54/dda/f12b 0 2024-03-04T09:40:31.807 INFO:tasks.workunit.client.0.smithi046.stdout:7/822: mkdir d0/d11e 0 2024-03-04T09:40:31.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/823: readlink d0/d4/l8 0 2024-03-04T09:40:31.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/824: read d0/d4/f1f [587502,129238] 0 2024-03-04T09:40:31.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/825: chown d0/d4/db/d38/c61 89 1 2024-03-04T09:40:31.834 INFO:tasks.workunit.client.0.smithi046.stdout:7/826: write d0/d4/db/d38/f3f [2451301,22143] 0 2024-03-04T09:40:31.834 INFO:tasks.workunit.client.0.smithi046.stdout:7/827: readlink d0/d8f/laf 0 2024-03-04T09:40:31.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/828: dread d0/d4/db/d12/f30 [4194304,4194304] 0 2024-03-04T09:40:31.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/829: dread - d0/da/d46/f11b zero size 2024-03-04T09:40:31.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/830: chown d0/d4/fd 0 1 2024-03-04T09:40:31.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/831: fsync d0/d4/db/d12/d28/fb3 0 2024-03-04T09:40:31.865 INFO:tasks.workunit.client.0.smithi046.stdout:7/832: truncate d0/da/fbd 320165 0 2024-03-04T09:40:32.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/917: write d1/d11/d6/d8/d12/d1c/dd1/d5e/f8d [111509,82233] 0 2024-03-04T09:40:33.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/870: sync 2024-03-04T09:40:33.132 INFO:tasks.workunit.client.0.smithi046.stdout:5/796: sync 2024-03-04T09:40:33.132 INFO:tasks.workunit.client.0.smithi046.stdout:8/868: sync 2024-03-04T09:40:33.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/895: write d5/d84/d88/d3f/f45 [139711,74190] 0 2024-03-04T09:40:33.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/896: readlink d5/d40/lc3 0 2024-03-04T09:40:33.585 INFO:tasks.workunit.client.0.smithi046.stdout:4/931: rename d0/d1f/f102 to d0/d1f/d25/d50/ddb/f15d 0 2024-03-04T09:40:33.585 INFO:tasks.workunit.client.0.smithi046.stdout:4/932: chown d0/d1f/c106 0 1 2024-03-04T09:40:33.660 INFO:tasks.workunit.client.0.smithi046.stdout:4/933: dwrite d0/d1f/d25/d50/d119/d1e/d73/f146 [0,4194304] 0 2024-03-04T09:40:33.784 INFO:tasks.workunit.client.0.smithi046.stdout:0/871: link d10/d12/d52/c79 d10/d12/d52/d5d/c132 0 2024-03-04T09:40:33.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/797: write d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/f37 [2633703,22488] 0 2024-03-04T09:40:34.048 INFO:tasks.workunit.client.0.smithi046.stdout:8/869: creat d7/de/d28/dab/f121 x:0 0 0 2024-03-04T09:40:34.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/897: mkdir d5/d40/da8/d12c 0 2024-03-04T09:40:34.243 INFO:tasks.workunit.client.0.smithi046.stdout:2/898: dread d5/da/f65 [0,4194304] 0 2024-03-04T09:40:34.243 INFO:tasks.workunit.client.0.smithi046.stdout:2/899: dread - d5/d38/d54/f114 zero size 2024-03-04T09:40:35.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/934: rmdir d0/d5f/d6f 39 2024-03-04T09:40:35.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/935: fsync d0/d3/d20/d96/d6e/f155 0 2024-03-04T09:40:35.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/872: truncate d10/d12/d52/f108 2026738 0 2024-03-04T09:40:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:8/870: creat d7/de/d28/dca/d116/f122 x:0 0 0 2024-03-04T09:40:35.784 INFO:tasks.workunit.client.0.smithi046.stdout:8/871: getdents d7/de/d28/dab/d3c/da5/def 0 2024-03-04T09:40:35.896 INFO:tasks.workunit.client.0.smithi046.stdout:2/900: symlink d5/d40/l12d 0 2024-03-04T09:40:36.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/681: rename d1/d28/c36 to d1/d28/d6f/db1/cdd 0 2024-03-04T09:40:36.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/682: dread d1/f68 [0,4194304] 0 2024-03-04T09:40:37.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/873: mknod d10/d36/d87/c133 0 2024-03-04T09:40:37.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/874: chown d10/d12/d9a/faf 87246 1 2024-03-04T09:40:37.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/798: truncate d1/d44/d81/f91 492283 0 2024-03-04T09:40:37.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/872: unlink d7/f4e 0 2024-03-04T09:40:37.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/873: readlink d7/de/d12/ld1 0 2024-03-04T09:40:37.196 INFO:tasks.workunit.client.0.smithi046.stdout:0/875: dwrite ff [0,4194304] 0 2024-03-04T09:40:37.196 INFO:tasks.workunit.client.0.smithi046.stdout:0/876: creat d10/d12/d1f/d3f/d7e/f134 x:0 0 0 2024-03-04T09:40:37.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/901: truncate d5/da/dbd/ff0 239389 0 2024-03-04T09:40:37.781 INFO:tasks.workunit.client.0.smithi046.stdout:1/683: fsync d1/f8f 0 2024-03-04T09:40:37.935 INFO:tasks.workunit.client.0.smithi046.stdout:5/799: dread d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/f23 [8388608,4194304] 0 2024-03-04T09:40:37.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/800: dread d1/d44/d81/d96/d20/d76/d6c/fc0 [0,4194304] 0 2024-03-04T09:40:37.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/801: write d1/d44/d57/d70/fd5 [873160,115168] 0 2024-03-04T09:40:38.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/874: symlink d7/de/d28/d36/d7c/d89/l123 0 2024-03-04T09:40:38.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/875: chown d7/de/d3e/da1 168291 1 2024-03-04T09:40:38.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/876: chown d7/de/d28/dab/dc1/dfc/l11b 0 1 2024-03-04T09:40:38.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/902: truncate d5/d84/d88/d3f/f4b 3494072 0 2024-03-04T09:40:38.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/967: rename d1/d1d/d27/d40/d76/d8d/d95/d12b to d1/d1d/d27/d40/d70/d7d/d15f 0 2024-03-04T09:40:38.795 INFO:tasks.workunit.client.0.smithi046.stdout:3/968: read d1/d1d/d27/d40/d92/f9c [3147205,103372] 0 2024-03-04T09:40:38.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/684: fsync d1/d28/f7a 0 2024-03-04T09:40:39.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/877: symlink d7/de/d28/dab/d3c/da5/l124 0 2024-03-04T09:40:39.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/878: fsync d7/f1a 0 2024-03-04T09:40:39.927 INFO:tasks.workunit.client.0.smithi046.stdout:6/989: rename da/d14/d1e/d8f/ddf/d103/d123/f148 to da/dd/d39/d60/da0/d67/d64/d82/d83/f166 0 2024-03-04T09:40:40.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/969: mknod d1/d1d/d123/c160 0 2024-03-04T09:40:40.270 INFO:tasks.workunit.client.0.smithi046.stdout:1/685: symlink d1/d92/d96/lde 0 2024-03-04T09:40:40.647 INFO:tasks.workunit.client.0.smithi046.stdout:8/879: dwrite d7/de/d28/dab/d2c/dd9/f111 [0,4194304] 0 2024-03-04T09:40:40.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/903: rmdir d5/d40/da8 39 2024-03-04T09:40:41.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/833: rename d0/d4/db/d12/d28/df6 to d0/da/d46/d99/de2/db1/dfa/d11f 0 2024-03-04T09:40:41.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/990: creat da/d14/d1e/d27/d78/d66/d11f/f167 x:0 0 0 2024-03-04T09:40:41.307 INFO:tasks.workunit.client.0.smithi046.stdout:3/970: truncate d1/d74/fce 534012 0 2024-03-04T09:40:41.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/971: creat d1/d1d/d27/d40/d76/dfd/f161 x:0 0 0 2024-03-04T09:40:41.345 INFO:tasks.workunit.client.0.smithi046.stdout:6/991: dwrite da/d14/d1e/d27/f43 [4194304,4194304] 0 2024-03-04T09:40:41.362 INFO:tasks.workunit.client.0.smithi046.stdout:6/992: dread da/d14/d1e/d27/f55 [0,4194304] 0 2024-03-04T09:40:41.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/993: dwrite da/dd/d39/d60/fd6 [0,4194304] 0 2024-03-04T09:40:41.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/686: mknod d1/d92/d9a/cdf 0 2024-03-04T09:40:41.826 INFO:tasks.workunit.client.0.smithi046.stdout:8/880: mknod d7/de/d28/dab/d2c/d64/db8/d11f/c125 0 2024-03-04T09:40:41.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/904: mknod d5/da/c12e 0 2024-03-04T09:40:41.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/905: dread d5/d84/d88/fc1 [0,4194304] 0 2024-03-04T09:40:42.600 INFO:tasks.workunit.client.0.smithi046.stdout:0/877: write d10/d12/fb3 [159662,87480] 0 2024-03-04T09:40:42.600 INFO:tasks.workunit.client.0.smithi046.stdout:0/878: read d10/d12/d52/d78/f3c [789465,77169] 0 2024-03-04T09:40:42.965 INFO:tasks.workunit.client.0.smithi046.stdout:1/687: dread d1/f89 [0,4194304] 0 2024-03-04T09:40:43.171 INFO:tasks.workunit.client.0.smithi046.stdout:9/918: rename d1/d11/d6/d8/d1d/d34/d4d/fc4 to d1/d11/d6/d8/d1d/d34/d7f/ded/f122 0 2024-03-04T09:40:43.172 INFO:tasks.workunit.client.0.smithi046.stdout:9/919: chown d1/d11/d6/d8/d12/d1c/f6e 2180444 1 2024-03-04T09:40:43.195 INFO:tasks.workunit.client.0.smithi046.stdout:9/920: read d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/daf/fd2 [530039,54749] 0 2024-03-04T09:40:43.324 INFO:tasks.workunit.client.0.smithi046.stdout:7/834: getdents d0/d4/db/d38/dc0 0 2024-03-04T09:40:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:1/688: creat d1/fe0 x:0 0 0 2024-03-04T09:40:44.060 INFO:tasks.workunit.client.0.smithi046.stdout:8/881: rmdir d7/de/d28/dab/dc1/dfc 39 2024-03-04T09:40:44.452 INFO:tasks.workunit.client.0.smithi046.stdout:7/835: truncate d0/d4/db/d38/d7e/dc5/fdf 2749345 0 2024-03-04T09:40:44.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/882: stat d7/de/d28/dab/d2c/d62/ddb/cfb 0 2024-03-04T09:40:45.152 INFO:tasks.workunit.client.0.smithi046.stdout:9/921: unlink d1/d11/d6/d8/d12/d1c/dd1/d5e/dde/le0 0 2024-03-04T09:40:45.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/922: write d1/d11/d6/d8/d6f/d8c/d9a/ddc/f10a [424354,126784] 0 2024-03-04T09:40:45.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/836: mkdir d0/da/d46/d99/de2/db1/dc8/d120 0 2024-03-04T09:40:45.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/883: chown d7/de/d28/d36/c40 569699 1 2024-03-04T09:40:45.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/802: truncate d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/f37 3289116 0 2024-03-04T09:40:45.651 INFO:tasks.workunit.client.0.smithi046.stdout:4/936: rename d0/d3/d3b/d8d to d0/d1f/d13b/d15e 0 2024-03-04T09:40:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:9/923: rmdir d1/d11/d6/d8/d13/d92 39 2024-03-04T09:40:46.028 INFO:tasks.workunit.client.0.smithi046.stdout:9/924: write d1/fc5 [4143,113715] 0 2024-03-04T09:40:46.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/925: write d1/d11/d6/d8/f33 [2684912,115931] 0 2024-03-04T09:40:46.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/884: rmdir d7/de/d28 39 2024-03-04T09:40:46.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/803: link d1/d44/d57/d70/lec d1/d44/d81/lf9 0 2024-03-04T09:40:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/937: truncate d0/d1f/d25/f26 6875851 0 2024-03-04T09:40:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/938: readlink d0/d5f/da2/l145 0 2024-03-04T09:40:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/939: stat d0/d1f/d25/d50/d119/f1a 0 2024-03-04T09:40:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/940: write d0/d1f/d25/d50/d119/d1e/d73/f9a [5726346,61523] 0 2024-03-04T09:40:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/926: mkdir d1/d11/d6/d8/d12/d1c/d123 0 2024-03-04T09:40:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/927: chown d1/d11/d6/d8/d6f/ffd 461531010 1 2024-03-04T09:40:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:7/837: truncate d0/d4/db/d3b/f7c 202781 0 2024-03-04T09:40:47.045 INFO:tasks.workunit.client.0.smithi046.stdout:7/838: chown d0/d4/db/cd0 61 1 2024-03-04T09:40:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/839: dread d0/d4/db/d12/d28/f4b [4194304,4194304] 0 2024-03-04T09:40:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/840: write d0/d8f/f6c [536296,61901] 0 2024-03-04T09:40:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:7/841: dwrite d0/d4/d6e/fb6 [0,4194304] 0 2024-03-04T09:40:47.624 INFO:tasks.workunit.client.0.smithi046.stdout:4/941: symlink d0/d1f/d25/d50/d119/d76/d15b/d114/l15f 0 2024-03-04T09:40:48.069 INFO:tasks.workunit.client.0.smithi046.stdout:8/885: symlink d7/de/d4c/l126 0 2024-03-04T09:40:48.771 INFO:tasks.workunit.client.0.smithi046.stdout:0/879: write d10/d12/f41 [4580818,20780] 0 2024-03-04T09:40:48.821 INFO:tasks.workunit.client.0.smithi046.stdout:0/880: dwrite d10/d12/d1f/d3f/d7e/f134 [0,4194304] 0 2024-03-04T09:40:48.821 INFO:tasks.workunit.client.0.smithi046.stdout:0/881: fdatasync d10/d12/d6e/d99/f109 0 2024-03-04T09:40:49.085 INFO:tasks.workunit.client.0.smithi046.stdout:6/994: symlink da/l168 0 2024-03-04T09:40:49.085 INFO:tasks.workunit.client.0.smithi046.stdout:6/995: fdatasync da/d14/d1e/d27/f43 0 2024-03-04T09:40:49.085 INFO:tasks.workunit.client.0.smithi046.stdout:6/996: write da/d14/d1e/fb6 [256397,52995] 0 2024-03-04T09:40:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/972: rename d1/d1d/d27/d40/f151 to d1/d1d/d27/d40/d92/f162 0 2024-03-04T09:40:50.742 INFO:tasks.workunit.client.0.smithi046.stdout:5/804: dwrite d1/d44/d81/d96/d20/f42 [0,4194304] 0 2024-03-04T09:40:50.942 INFO:tasks.workunit.client.0.smithi046.stdout:9/928: write d1/d11/fac [1309806,61616] 0 2024-03-04T09:40:51.096 INFO:tasks.workunit.client.0.smithi046.stdout:3/973: creat d1/d1d/d123/f163 x:0 0 0 2024-03-04T09:40:51.480 INFO:tasks.workunit.client.0.smithi046.stdout:9/929: creat d1/d11/d6/d8/d13/f124 x:0 0 0 2024-03-04T09:40:51.480 INFO:tasks.workunit.client.0.smithi046.stdout:1/689: rename d1/d28/c5f to d1/d28/d6f/da6/ce1 0 2024-03-04T09:40:51.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/906: symlink d5/l12f 0 2024-03-04T09:40:51.480 INFO:tasks.workunit.client.0.smithi046.stdout:9/930: write d1/d11/d6/d8/d6f/d8c/d9a/ddc/f10a [1036868,117861] 0 2024-03-04T09:40:51.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/907: creat d5/d2c/d51/dca/f130 x:0 0 0 2024-03-04T09:40:51.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/974: symlink d1/d88/l164 0 2024-03-04T09:40:51.870 INFO:tasks.workunit.client.0.smithi046.stdout:4/942: dwrite d0/d1f/d35/f6b [0,4194304] 0 2024-03-04T09:40:52.279 INFO:tasks.workunit.client.0.smithi046.stdout:7/842: rename d0/d4/db/d12/d28/fef to d0/d4/db/d38/d94/d113/f121 0 2024-03-04T09:40:52.280 INFO:tasks.workunit.client.0.smithi046.stdout:7/843: write d0/da/f2a [4132620,104414] 0 2024-03-04T09:40:52.311 INFO:tasks.workunit.client.0.smithi046.stdout:7/844: dread d0/f16 [0,4194304] 0 2024-03-04T09:40:52.349 INFO:tasks.workunit.client.0.smithi046.stdout:7/845: dread d0/d4/db/d38/d94/d113/f121 [0,4194304] 0 2024-03-04T09:40:52.350 INFO:tasks.workunit.client.0.smithi046.stdout:7/846: readlink d0/d4/db/d38/l45 0 2024-03-04T09:40:52.358 INFO:tasks.workunit.client.0.smithi046.stdout:9/931: mkdir d1/d11/d6/d8/d13/d21/d125 0 2024-03-04T09:40:52.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/975: mknod d1/d1d/d27/d40/c165 0 2024-03-04T09:40:52.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/976: fsync d1/d21/d35/d43/dd2/d9a/f14e 0 2024-03-04T09:40:52.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/977: chown d1/d1d/d27/d40/d70/d105/de3/d15a 3552097 1 2024-03-04T09:40:52.771 INFO:tasks.workunit.client.0.smithi046.stdout:0/882: dwrite d10/d12/d52/d78/d8a/da2/fb1 [0,4194304] 0 2024-03-04T09:40:52.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/883: stat d10/d12/d52/d5d/d83 0 2024-03-04T09:40:52.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/943: creat d0/d1f/d25/d50/d119/f160 x:0 0 0 2024-03-04T09:40:53.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:40:53.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:40:53.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/932: dread d1/d11/d6/d8/d1d/d34/d7f/fbf [0,4194304] 0 2024-03-04T09:40:53.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/933: write d1/d11/d6/d8/d13/f24 [544474,44030] 0 2024-03-04T09:40:53.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/997: truncate da/d14/d1e/fb6 4000673 0 2024-03-04T09:40:53.734 INFO:tasks.workunit.client.0.smithi046.stdout:0/884: creat d10/d36/f135 x:0 0 0 2024-03-04T09:40:53.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/885: write fe [4297359,90830] 0 2024-03-04T09:40:53.758 INFO:tasks.workunit.client.0.smithi046.stdout:8/886: rename d7/de/d28/dab/d2c/d62/c81 to d7/d53/d72/d93/dd7/dc9/ddc/c127 0 2024-03-04T09:40:53.763 INFO:tasks.workunit.client.0.smithi046.stdout:8/887: write d7/de/d28/dab/f38 [4914063,110008] 0 2024-03-04T09:40:54.505 INFO:tasks.workunit.client.0.smithi046.stdout:0/886: rmdir d10/d12/d6e/d99/d124 0 2024-03-04T09:40:54.588 INFO:tasks.workunit.client.0.smithi046.stdout:0/887: dwrite d10/f22 [0,4194304] 0 2024-03-04T09:40:55.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/944: getdents d0/d1f/d25/da6 0 2024-03-04T09:40:55.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/945: chown d0/d3/d20/d96/d6e/lc3 3 1 2024-03-04T09:40:55.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/934: mknod d1/d11/d6/d8/c126 0 2024-03-04T09:40:55.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/935: write d1/d11/d6/f4e [4570686,32409] 0 2024-03-04T09:40:55.580 INFO:tasks.workunit.client.0.smithi046.stdout:8/888: symlink d7/de/d28/d3a/d6f/dd0/l128 0 2024-03-04T09:40:56.287 INFO:tasks.workunit.client.0.smithi046.stdout:4/946: rmdir d0/d8e 39 2024-03-04T09:40:56.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/690: rename d1/c3b to d1/d92/d96/ce2 0 2024-03-04T09:40:56.287 INFO:tasks.workunit.client.0.smithi046.stdout:0/888: creat d10/d12/d52/d78/df7/f136 x:0 0 0 2024-03-04T09:40:56.297 INFO:tasks.workunit.client.0.smithi046.stdout:4/947: dread d0/d3/d3b/fd9 [0,4194304] 0 2024-03-04T09:40:56.472 INFO:tasks.workunit.client.0.smithi046.stdout:8/889: creat d7/d53/d72/f129 x:0 0 0 2024-03-04T09:40:56.550 INFO:tasks.workunit.client.0.smithi046.stdout:8/890: dwrite d7/de/d3e/fc2 [0,4194304] 0 2024-03-04T09:40:56.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/891: dwrite d7/d53/d72/d93/dd7/dc9/fd6 [0,4194304] 0 2024-03-04T09:40:56.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/892: write d7/de/d3e/f91 [6568170,29305] 0 2024-03-04T09:40:56.641 INFO:tasks.workunit.client.0.smithi046.stdout:8/893: dwrite d7/de/d28/d36/fdd [0,4194304] 0 2024-03-04T09:40:56.641 INFO:tasks.workunit.client.0.smithi046.stdout:8/894: fdatasync d7/de/d28/dab/dc1/fdf 0 2024-03-04T09:40:56.659 INFO:tasks.workunit.client.0.smithi046.stdout:7/847: rename d0/da/l50 to d0/da/d46/d99/de2/db1/l122 0 2024-03-04T09:40:56.716 INFO:tasks.workunit.client.0.smithi046.stdout:7/848: dwrite d0/d4/db/d38/d7e/fe7 [0,4194304] 0 2024-03-04T09:40:56.856 INFO:tasks.workunit.client.0.smithi046.stdout:4/948: symlink d0/d1f/d25/d50/d119/d76/d15b/d114/l161 0 2024-03-04T09:40:57.050 INFO:tasks.workunit.client.0.smithi046.stdout:1/691: link d1/d28/c64 d1/d92/d96/dbb/ce3 0 2024-03-04T09:40:57.223 INFO:tasks.workunit.client.0.smithi046.stdout:5/805: mknod d1/cfa 0 2024-03-04T09:40:57.374 INFO:tasks.workunit.client.0.smithi046.stdout:2/908: dwrite d5/ff [0,4194304] 0 2024-03-04T09:40:57.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/895: unlink d7/de/d12/da9/l10d 0 2024-03-04T09:40:57.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/889: rename d10/d12/d52/d78/c9d to d10/d12/d9a/dd8/c137 0 2024-03-04T09:40:57.704 INFO:tasks.workunit.client.0.smithi046.stdout:3/978: write d1/d1d/d27/d40/d70/d105/de3/f111 [1204076,25958] 0 2024-03-04T09:40:57.704 INFO:tasks.workunit.client.0.smithi046.stdout:3/979: chown d1/d1d/d27/d10f/f142 2055303 1 2024-03-04T09:40:57.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/980: dwrite d1/d88/ff2 [0,4194304] 0 2024-03-04T09:40:57.823 INFO:tasks.workunit.client.0.smithi046.stdout:7/849: symlink d0/d4/db/d38/de1/l123 0 2024-03-04T09:40:57.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/850: fsync d0/d4/f36 0 2024-03-04T09:40:57.849 INFO:tasks.workunit.client.0.smithi046.stdout:7/851: read d0/d4/db/d38/d94/f112 [522642,25069] 0 2024-03-04T09:40:57.849 INFO:tasks.workunit.client.0.smithi046.stdout:7/852: chown d0/d4/db/d12/d28/cd7 3473 1 2024-03-04T09:40:57.952 INFO:tasks.workunit.client.0.smithi046.stdout:4/949: symlink d0/d3/d3b/d9d/l162 0 2024-03-04T09:40:58.312 INFO:tasks.workunit.client.0.smithi046.stdout:1/692: chown d1/d28/f6e 201672 1 2024-03-04T09:40:58.312 INFO:tasks.workunit.client.0.smithi046.stdout:1/693: write d1/d28/d6f/fa2 [2363514,59905] 0 2024-03-04T09:40:58.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/694: write d1/d28/d6f/db7/fac [116261,74059] 0 2024-03-04T09:40:58.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/695: creat d1/d28/d6f/dbe/fe4 x:0 0 0 2024-03-04T09:40:58.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/909: mkdir d5/d84/d7c/dd0/df4/d131 0 2024-03-04T09:40:58.683 INFO:tasks.workunit.client.0.smithi046.stdout:0/890: dwrite d10/d36/d7a/fa7 [8388608,4194304] 0 2024-03-04T09:40:58.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/891: fsync d10/d12/d6e/d99/f109 0 2024-03-04T09:40:59.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/853: read d0/d4/db/d3b/f53 [756057,115327] 0 2024-03-04T09:40:59.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/854: fsync d0/da/f29 0 2024-03-04T09:40:59.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/855: write d0/d4/db/d38/dc0/ff4 [518394,126947] 0 2024-03-04T09:40:59.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/856: dwrite d0/d8f/f9d [0,4194304] 0 2024-03-04T09:40:59.188 INFO:tasks.workunit.client.0.smithi046.stdout:7/857: write d0/d4/db/d38/f57 [1621150,30005] 0 2024-03-04T09:40:59.203 INFO:tasks.workunit.client.0.smithi046.stdout:4/950: mkdir d0/d1f/d25/d50/d119/d76/d15b/d163 0 2024-03-04T09:40:59.203 INFO:tasks.workunit.client.0.smithi046.stdout:4/951: getdents d0/d3/d3b/d158 0 2024-03-04T09:40:59.356 INFO:tasks.workunit.client.0.smithi046.stdout:5/806: mkdir d1/d44/d81/d96/d20/d76/dfb 0 2024-03-04T09:40:59.414 INFO:tasks.workunit.client.0.smithi046.stdout:5/807: dwrite d1/d44/d81/d96/d20/d76/d6c/dd1/fe8 [0,4194304] 0 2024-03-04T09:40:59.643 INFO:tasks.workunit.client.0.smithi046.stdout:1/696: rename d1/d92/d9a/c9f to d1/d92/d96/dbb/ce5 0 2024-03-04T09:40:59.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/697: dwrite d1/d92/d96/fc0 [0,4194304] 0 2024-03-04T09:40:59.801 INFO:tasks.workunit.client.0.smithi046.stdout:2/910: symlink d5/da/deb/l132 0 2024-03-04T09:40:59.830 INFO:tasks.workunit.client.0.smithi046.stdout:2/911: dread d5/d40/d5a/fe2 [4194304,4194304] 0 2024-03-04T09:40:59.859 INFO:tasks.workunit.client.0.smithi046.stdout:2/912: dread d5/da/f65 [0,4194304] 0 2024-03-04T09:41:00.259 INFO:tasks.workunit.client.0.smithi046.stdout:3/981: mknod d1/d1d/d27/d4a/d78/de0/c166 0 2024-03-04T09:41:00.439 INFO:tasks.workunit.client.0.smithi046.stdout:8/896: truncate d7/de/d28/dab/f38 634328 0 2024-03-04T09:41:00.513 INFO:tasks.workunit.client.0.smithi046.stdout:8/897: dwrite d7/de/d28/dab/d3c/fb1 [0,4194304] 0 2024-03-04T09:41:01.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/998: sync 2024-03-04T09:41:01.474 INFO:tasks.workunit.client.0.smithi046.stdout:5/808: creat d1/d44/d57/d70/d86/d92/ffc x:0 0 0 2024-03-04T09:41:01.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/698: dread d1/f54 [0,4194304] 0 2024-03-04T09:41:02.418 INFO:tasks.workunit.client.0.smithi046.stdout:2/913: mkdir d5/db9/dd2/df7/d133 0 2024-03-04T09:41:02.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/982: rename d1/d21/d35/d43/f62 to d1/d1d/d27/d40/d76/dfd/d137/f167 0 2024-03-04T09:41:02.992 INFO:tasks.workunit.client.0.smithi046.stdout:3/983: dwrite d1/d88/f117 [4194304,4194304] 0 2024-03-04T09:41:03.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/898: fsync d7/de/d4c/d50/fed 0 2024-03-04T09:41:03.747 INFO:tasks.workunit.client.0.smithi046.stdout:7/858: getdents d0/d4/db/d3b/d6b 0 2024-03-04T09:41:03.784 INFO:tasks.workunit.client.0.smithi046.stdout:4/952: truncate d0/d1f/d5b/f11b 875745 0 2024-03-04T09:41:03.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/953: write d0/d1f/d25/d50/d119/f1a [7802263,122737] 0 2024-03-04T09:41:03.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/954: write d0/d1f/f45 [1309894,62305] 0 2024-03-04T09:41:03.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/955: chown d0/d3/d20/d96/d6e/f8b 9 1 2024-03-04T09:41:03.860 INFO:tasks.workunit.client.0.smithi046.stdout:4/956: dread d0/d3/f6 [0,4194304] 0 2024-03-04T09:41:03.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/999: truncate da/dd/f36 2535269 0 2024-03-04T09:41:03.988 INFO:tasks.workunit.client.0.smithi046.stdout:5/809: truncate d1/d44/d81/faa 238097 0 2024-03-04T09:41:04.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/810: dread d1/f82 [0,4194304] 0 2024-03-04T09:41:04.241 INFO:tasks.workunit.client.0.smithi046.stdout:9/936: mknod d1/d11/d6/c127 0 2024-03-04T09:41:04.331 INFO:tasks.workunit.client.0.smithi046.stdout:9/937: dwrite d1/d11/d6/d8/d12/fe9 [0,4194304] 0 2024-03-04T09:41:04.331 INFO:tasks.workunit.client.0.smithi046.stdout:9/938: getdents d1/d11/d6/d8/d1d/d34/d4d/d11e 0 2024-03-04T09:41:04.341 INFO:tasks.workunit.client.0.smithi046.stdout:9/939: dread d1/d11/d6/d118/f11c [0,4194304] 0 2024-03-04T09:41:04.341 INFO:tasks.workunit.client.0.smithi046.stdout:9/940: stat d1/d11/d6/lda 0 2024-03-04T09:41:04.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/914: truncate d5/d38/f90 1962358 0 2024-03-04T09:41:04.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/915: fdatasync d5/db9/dd2/fe3 0 2024-03-04T09:41:04.973 INFO:tasks.workunit.client.0.smithi046.stdout:3/984: unlink d1/d21/d35/c17 0 2024-03-04T09:41:05.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/899: creat d7/de/d28/dab/d2c/d64/db8/d11f/f12a x:0 0 0 2024-03-04T09:41:05.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/957: rename d0/d3/d20/d96/d6e/lc3 to d0/d1f/d25/d50/d63/l164 0 2024-03-04T09:41:05.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/958: fdatasync d0/d5f/f13d 0 2024-03-04T09:41:05.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/959: dread - d0/d125/f14f zero size 2024-03-04T09:41:06.473 INFO:tasks.workunit.client.0.smithi046.stdout:5/811: truncate d1/f36 376411 0 2024-03-04T09:41:06.474 INFO:tasks.workunit.client.0.smithi046.stdout:5/812: dread - d1/d44/d57/d70/d86/d92/ffc zero size 2024-03-04T09:41:06.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/813: dwrite d1/d44/d81/d96/d20/d76/fb6 [0,4194304] 0 2024-03-04T09:41:06.815 INFO:tasks.workunit.client.0.smithi046.stdout:9/941: unlink d1/d11/d6/d8/d12/d1c/dd1/f80 0 2024-03-04T09:41:06.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/942: creat d1/d11/d6/d8/d12/d1c/dd1/f128 x:0 0 0 2024-03-04T09:41:06.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/943: chown d1/d11/d6/d8/d12/d1c/d26/dae 6 1 2024-03-04T09:41:06.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/944: write d1/d11/d6/d118/f11f [747777,5700] 0 2024-03-04T09:41:06.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/945: readlink d1/d11/d6/d8/d13/d85/l108 0 2024-03-04T09:41:06.984 INFO:tasks.workunit.client.0.smithi046.stdout:3/985: mknod d1/d1d/d27/d4a/d78/c168 0 2024-03-04T09:41:07.315 INFO:tasks.workunit.client.0.smithi046.stdout:2/916: rename d5/d84/d88/d3f/f41 to d5/db9/f134 0 2024-03-04T09:41:07.640 INFO:tasks.workunit.client.0.smithi046.stdout:5/814: chown d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/fc 64995 1 2024-03-04T09:41:08.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/892: truncate d10/d36/d7a/fa7 9578601 0 2024-03-04T09:41:08.288 INFO:tasks.workunit.client.0.smithi046.stdout:8/900: creat d7/de/f12b x:0 0 0 2024-03-04T09:41:08.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/893: stat d10/d12/d9f/da6/dc3 0 2024-03-04T09:41:08.289 INFO:tasks.workunit.client.0.smithi046.stdout:8/901: chown d7/de/d28/dab/d2c/d64/db8/d109 77665 1 2024-03-04T09:41:08.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/894: creat d10/d12/d9f/dca/f138 x:0 0 0 2024-03-04T09:41:08.318 INFO:tasks.workunit.client.0.smithi046.stdout:0/895: dread d10/f26 [0,4194304] 0 2024-03-04T09:41:08.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/960: rename d0/d1f/d25/da6/lb7 to d0/d3/d20/d96/d6e/d85/l165 0 2024-03-04T09:41:08.616 INFO:tasks.workunit.client.0.smithi046.stdout:2/917: symlink d5/d2c/d51/dca/l135 0 2024-03-04T09:41:08.616 INFO:tasks.workunit.client.0.smithi046.stdout:2/918: chown d5/d2c/d51/dca/f130 7961946 1 2024-03-04T09:41:08.767 INFO:tasks.workunit.client.0.smithi046.stdout:5/815: mknod d1/d44/d81/d96/d9a/da0/cfd 0 2024-03-04T09:41:09.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/986: mknod d1/d1d/d27/d4a/d78/de0/c169 0 2024-03-04T09:41:09.176 INFO:tasks.workunit.client.0.smithi046.stdout:0/896: mknod d10/d12/d52/c139 0 2024-03-04T09:41:09.176 INFO:tasks.workunit.client.0.smithi046.stdout:0/897: chown d10/d12/d52/d5d/ca4 356 1 2024-03-04T09:41:09.215 INFO:tasks.workunit.client.0.smithi046.stdout:3/987: dwrite d1/d21/d35/d24/ff0 [0,4194304] 0 2024-03-04T09:41:09.215 INFO:tasks.workunit.client.0.smithi046.stdout:3/988: stat d1/d1d/d27/d40/d76/d8d/d95/f87 0 2024-03-04T09:41:09.235 INFO:tasks.workunit.client.0.smithi046.stdout:3/989: dread d1/d21/ff9 [0,4194304] 0 2024-03-04T09:41:09.301 INFO:tasks.workunit.client.0.smithi046.stdout:3/990: dwrite d1/d21/d35/d43/dd2/d9a/fcb [0,4194304] 0 2024-03-04T09:41:09.513 INFO:tasks.workunit.client.0.smithi046.stdout:4/961: mknod d0/d1f/d25/d50/d119/d1e/da1/d10b/c166 0 2024-03-04T09:41:09.513 INFO:tasks.workunit.client.0.smithi046.stdout:4/962: chown d0/d3/d20/ld6 0 1 2024-03-04T09:41:09.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/919: mknod d5/d2c/d91/d119/c136 0 2024-03-04T09:41:09.514 INFO:tasks.workunit.client.0.smithi046.stdout:4/963: creat d0/d1f/d25/d50/d119/d1e/da1/dcc/d122/f167 x:0 0 0 2024-03-04T09:41:09.514 INFO:tasks.workunit.client.0.smithi046.stdout:4/964: readlink d0/d1f/d25/da6/lbc 0 2024-03-04T09:41:10.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/898: truncate d10/d12/fb3 1007300 0 2024-03-04T09:41:10.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/899: fsync d10/d12/d1f/fed 0 2024-03-04T09:41:10.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/699: write d1/d28/f40 [1561932,52969] 0 2024-03-04T09:41:10.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/991: mkdir d1/d88/d12c/d16a 0 2024-03-04T09:41:11.256 INFO:tasks.workunit.client.0.smithi046.stdout:8/902: rename d7/d53/d72/d93/dd7 to d7/de/d28/dab/d2c/d64/db8/d109/d12c 0 2024-03-04T09:41:11.353 INFO:tasks.workunit.client.0.smithi046.stdout:2/920: creat d5/d38/d54/dda/f137 x:0 0 0 2024-03-04T09:41:11.425 INFO:tasks.workunit.client.0.smithi046.stdout:2/921: dwrite d5/d38/f76 [0,4194304] 0 2024-03-04T09:41:11.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/965: creat d0/d1f/d25/d50/d119/ddc/f168 x:0 0 0 2024-03-04T09:41:11.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/966: dread - d0/d1f/d25/d50/d119/d1e/da1/dc1/f123 zero size 2024-03-04T09:41:12.003 INFO:tasks.workunit.client.0.smithi046.stdout:1/700: creat d1/d28/d6a/fe6 x:0 0 0 2024-03-04T09:41:12.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/992: mkdir d1/d88/d16b 0 2024-03-04T09:41:12.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/993: truncate d1/d1d/d27/d4a/f146 783269 0 2024-03-04T09:41:12.559 INFO:tasks.workunit.client.0.smithi046.stdout:2/922: rename d5/d40/d117/daa/lfe to d5/d40/d117/l138 0 2024-03-04T09:41:12.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/923: fsync d5/d84/fb7 0 2024-03-04T09:41:12.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/967: unlink d0/d1f/d25/d50/ddb/ced 0 2024-03-04T09:41:12.853 INFO:tasks.workunit.client.0.smithi046.stdout:3/994: creat d1/d1d/d27/d40/f16c x:0 0 0 2024-03-04T09:41:12.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/995: fdatasync d1/d1d/d27/f119 0 2024-03-04T09:41:13.045 INFO:tasks.workunit.client.0.smithi046.stdout:2/924: symlink d5/d2c/d51/l139 0 2024-03-04T09:41:13.045 INFO:tasks.workunit.client.0.smithi046.stdout:2/925: truncate d5/d2c/d51/d61/f10d 558097 0 2024-03-04T09:41:13.045 INFO:tasks.workunit.client.0.smithi046.stdout:2/926: fsync d5/d84/d88/d47/f67 0 2024-03-04T09:41:13.063 INFO:tasks.workunit.client.0.smithi046.stdout:2/927: dread d5/da/f2b [0,4194304] 0 2024-03-04T09:41:13.084 INFO:tasks.workunit.client.0.smithi046.stdout:2/928: dread d5/da/fab [0,4194304] 0 2024-03-04T09:41:13.145 INFO:tasks.workunit.client.0.smithi046.stdout:4/968: rmdir d0/d1f/d25/d50/d119/d76 39 2024-03-04T09:41:13.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/929: dwrite d5/d2c/d51/dca/f121 [0,4194304] 0 2024-03-04T09:41:13.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/930: dread d5/f1f [0,4194304] 0 2024-03-04T09:41:13.481 INFO:tasks.workunit.client.0.smithi046.stdout:4/969: mkdir d0/d1f/d25/d169 0 2024-03-04T09:41:13.906 INFO:tasks.workunit.client.0.smithi046.stdout:3/996: truncate d1/d21/d35/d43/dd2/d51/da3/fec 1979803 0 2024-03-04T09:41:14.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/970: creat d0/d3/d3b/f16a x:0 0 0 2024-03-04T09:41:14.093 INFO:tasks.workunit.client.0.smithi046.stdout:4/971: write d0/d3/d3b/fd9 [568509,49168] 0 2024-03-04T09:41:14.093 INFO:tasks.workunit.client.0.smithi046.stdout:4/972: truncate d0/d1f/d25/d50/d119/f160 222934 0 2024-03-04T09:41:14.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/973: dwrite d0/d3/d20/d96/d6e/f9e [0,4194304] 0 2024-03-04T09:41:14.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/974: fdatasync d0/d1f/d25/d50/d119/d1e/da1/dc1/f117 0 2024-03-04T09:41:14.383 INFO:tasks.workunit.client.0.smithi046.stdout:3/997: mkdir d1/d1d/d27/d40/d16d 0 2024-03-04T09:41:14.637 INFO:tasks.workunit.client.0.smithi046.stdout:9/946: dwrite d1/d11/d6/d8/d1d/d34/d4d/f55 [4194304,4194304] 0 2024-03-04T09:41:14.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/947: dread - d1/d11/d6/d8/d13/d92/ffb zero size 2024-03-04T09:41:14.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/948: stat d1/d11/d6/d8/d1d/d34/d4d/d11e 0 2024-03-04T09:41:14.685 INFO:tasks.workunit.client.0.smithi046.stdout:9/949: dwrite d1/d11/d6/d8/d13/f124 [0,4194304] 0 2024-03-04T09:41:14.685 INFO:tasks.workunit.client.0.smithi046.stdout:9/950: readlink d1/d11/d6/d8/d12/d1c/d26/le7 0 2024-03-04T09:41:14.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/975: symlink d0/d1f/d25/d50/d119/d1e/da1/d10b/l16b 0 2024-03-04T09:41:14.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/976: write d0/d1f/f44 [1533928,61487] 0 2024-03-04T09:41:14.922 INFO:tasks.workunit.client.0.smithi046.stdout:7/859: sync 2024-03-04T09:41:14.989 INFO:tasks.workunit.client.0.smithi046.stdout:3/998: unlink d1/db0/f138 0 2024-03-04T09:41:15.366 INFO:tasks.workunit.client.0.smithi046.stdout:8/903: rename d7/c82 to d7/de/d4c/d50/dff/c12d 0 2024-03-04T09:41:15.481 INFO:tasks.workunit.client.0.smithi046.stdout:8/904: dwrite d7/de/d12/f43 [0,4194304] 0 2024-03-04T09:41:15.502 INFO:tasks.workunit.client.0.smithi046.stdout:8/905: dread d7/de/d28/dab/d3c/f9c [0,4194304] 0 2024-03-04T09:41:15.562 INFO:tasks.workunit.client.0.smithi046.stdout:8/906: dwrite d7/de/d28/dab/d2c/d64/db8/d109/d12c/dc9/ddc/f10c [0,4194304] 0 2024-03-04T09:41:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/860: symlink d0/d4/db/d38/d94/l124 0 2024-03-04T09:41:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/861: creat d0/d4/db/d3b/f125 x:0 0 0 2024-03-04T09:41:16.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/862: dwrite d0/d4/db/d38/d7e/fcf [0,4194304] 0 2024-03-04T09:41:16.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/931: rename d5/d84/d9a to d5/d38/d13a 0 2024-03-04T09:41:17.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/951: link d1/d11/d6/d8/cb d1/d11/d3e/c129 0 2024-03-04T09:41:17.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/952: chown d1/d11/d6/d8/d13/f124 816504651 1 2024-03-04T09:41:17.443 INFO:tasks.workunit.client.0.smithi046.stdout:5/816: dwrite d1/d44/d81/d96/d20/d76/d6c/d7b/f61 [4194304,4194304] 0 2024-03-04T09:41:17.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/907: mknod d7/de/d28/d36/d7c/c12e 0 2024-03-04T09:41:17.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/908: fsync d7/de/d28/dab/d2c/d62/f8d 0 2024-03-04T09:41:18.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/863: creat d0/d4/db/d12/d28/f126 x:0 0 0 2024-03-04T09:41:18.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/864: read d0/d4/db/d3b/f53 [345561,1502] 0 2024-03-04T09:41:18.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/865: chown d0/d8f/c73 1 1 2024-03-04T09:41:18.139 INFO:tasks.workunit.client.0.smithi046.stdout:2/932: rename d5/d2c/d51/dca/f130 to d5/d2c/d51/f13b 0 2024-03-04T09:41:18.156 INFO:tasks.workunit.client.0.smithi046.stdout:7/866: write d0/d4/fd [5817382,22833] 0 2024-03-04T09:41:18.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/953: read d1/d11/d6/d8/d1d/d34/d7f/ded/f122 [212213,62516] 0 2024-03-04T09:41:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/954: dread d1/d11/d6/d8/fef [0,4194304] 0 2024-03-04T09:41:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/955: creat d1/d11/d6/d8/d13/f12a x:0 0 0 2024-03-04T09:41:18.236 INFO:tasks.workunit.client.0.smithi046.stdout:9/956: write d1/d11/d6/d8/d12/d1c/dd1/f5f [2552859,98194] 0 2024-03-04T09:41:18.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/817: getdents d1/d44/d81/d96/d20/d76/d6c/db2 0 2024-03-04T09:41:18.488 INFO:tasks.workunit.client.0.smithi046.stdout:5/818: dread d1/d44/d81/d96/d20/d76/d6c/f8c [0,4194304] 0 2024-03-04T09:41:18.661 INFO:tasks.workunit.client.0.smithi046.stdout:8/909: creat d7/de/d28/dab/d2c/d64/db8/d109/d12c/dc9/f12f x:0 0 0 2024-03-04T09:41:18.661 INFO:tasks.workunit.client.0.smithi046.stdout:8/910: creat d7/de/d28/d36/d7c/f130 x:0 0 0 2024-03-04T09:41:19.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/933: fdatasync d5/da/d1b/f30 0 2024-03-04T09:41:19.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/934: read d5/d40/dde/fdb [3572275,5796] 0 2024-03-04T09:41:19.437 INFO:tasks.workunit.client.0.smithi046.stdout:9/957: mknod d1/d11/d6/d8/d13/d21/c12b 0 2024-03-04T09:41:19.858 INFO:tasks.workunit.client.0.smithi046.stdout:8/911: creat d7/de/d28/dab/d2c/d62/f131 x:0 0 0 2024-03-04T09:41:19.859 INFO:tasks.workunit.client.0.smithi046.stdout:8/912: fdatasync d7/de/d4c/f98 0 2024-03-04T09:41:19.859 INFO:tasks.workunit.client.0.smithi046.stdout:8/913: dread - d7/de/f12b zero size 2024-03-04T09:41:20.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/935: truncate d5/d2c/f7e 1761375 0 2024-03-04T09:41:20.643 INFO:tasks.workunit.client.0.smithi046.stdout:8/914: symlink d7/de/d28/l132 0 2024-03-04T09:41:20.643 INFO:tasks.workunit.client.0.smithi046.stdout:8/915: fsync d7/de/d3e/da1/fa6 0 2024-03-04T09:41:20.660 INFO:tasks.workunit.client.0.smithi046.stdout:8/916: read d7/fc [4558488,97558] 0 2024-03-04T09:41:20.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/900: sync 2024-03-04T09:41:20.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/901: chown d10/d12/d1f/l126 0 1 2024-03-04T09:41:20.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/701: rmdir d1/d92/d96 39 2024-03-04T09:41:21.316 INFO:tasks.workunit.client.0.smithi046.stdout:2/936: truncate f3 2142589 0 2024-03-04T09:41:21.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/917: mkdir d7/d53/d72/d93/d133 0 2024-03-04T09:41:21.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/902: read d10/d12/fbc [2775958,58572] 0 2024-03-04T09:41:21.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/903: fdatasync d10/d12/f56 0 2024-03-04T09:41:21.571 INFO:tasks.workunit.client.0.smithi046.stdout:0/904: dread d10/d12/d9f/fd2 [0,4194304] 0 2024-03-04T09:41:21.822 INFO:tasks.workunit.client.0.smithi046.stdout:1/702: chown d1/d28/fce 0 1 2024-03-04T09:41:21.822 INFO:tasks.workunit.client.0.smithi046.stdout:2/937: symlink d5/d84/d7c/d10f/l13c 0 2024-03-04T09:41:21.822 INFO:tasks.workunit.client.0.smithi046.stdout:1/703: dread - d1/d92/d96/f9d zero size 2024-03-04T09:41:21.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/704: chown d1/d28/d6a/fe6 213 1 2024-03-04T09:41:21.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/938: dwrite d5/d40/d5a/fe2 [4194304,4194304] 0 2024-03-04T09:41:22.226 INFO:tasks.workunit.client.0.smithi046.stdout:0/905: unlink d10/d12/d52/d78/lf8 0 2024-03-04T09:41:22.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/705: creat d1/d28/d6f/fe7 x:0 0 0 2024-03-04T09:41:22.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/706: fdatasync d1/d28/d6f/db7/dba/fd6 0 2024-03-04T09:41:22.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/707: dread - d1/d92/d96/f9d zero size 2024-03-04T09:41:22.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/906: symlink d10/d12/d52/d78/d8a/da2/d123/l13a 0 2024-03-04T09:41:22.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/907: stat d10/d12/d1f/ffa 0 2024-03-04T09:41:22.831 INFO:tasks.workunit.client.0.smithi046.stdout:1/708: mknod d1/d92/d96/da7/ce8 0 2024-03-04T09:41:23.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/977: sync 2024-03-04T09:41:23.374 INFO:tasks.workunit.client.0.smithi046.stdout:8/918: truncate d7/de/d12/f43 1390317 0 2024-03-04T09:41:23.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:41:23.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:41:23.408 INFO:tasks.workunit.client.0.smithi046.stdout:3/999: dwrite d1/d1d/d27/d40/d70/d7d/f13f [0,4194304] 0 2024-03-04T09:41:24.112 INFO:tasks.workunit.client.0.smithi046.stdout:0/908: link fc d10/d12/d1f/d3f/d4b/f13b 0 2024-03-04T09:41:24.112 INFO:tasks.workunit.client.0.smithi046.stdout:1/709: getdents d1/d28/d6f/db7 0 2024-03-04T09:41:24.297 INFO:tasks.workunit.client.0.smithi046.stdout:8/919: creat d7/de/d28/dab/d2c/f134 x:0 0 0 2024-03-04T09:41:24.606 INFO:tasks.workunit.client.0.smithi046.stdout:7/867: sync 2024-03-04T09:41:24.633 INFO:tasks.workunit.client.0.smithi046.stdout:7/868: write d0/d4/db/d38/d94/d113/f121 [2930929,59155] 0 2024-03-04T09:41:24.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/710: getdents d1/d92/d96 0 2024-03-04T09:41:24.979 INFO:tasks.workunit.client.0.smithi046.stdout:0/909: link d10/d12/f82 d10/d12/d52/d78/d8a/da2/d104/f13c 0 2024-03-04T09:41:24.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/910: write d10/d36/d7a/ffd [765441,56390] 0 2024-03-04T09:41:25.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/911: dread d10/d12/f82 [0,4194304] 0 2024-03-04T09:41:25.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/912: creat d10/d12/d52/d78/d8a/f13d x:0 0 0 2024-03-04T09:41:25.247 INFO:tasks.workunit.client.0.smithi046.stdout:7/869: mknod d0/d4/db/d38/dc0/c127 0 2024-03-04T09:41:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:1/711: dread d1/f27 [0,4194304] 0 2024-03-04T09:41:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/712: fdatasync d1/d92/d96/f9d 0 2024-03-04T09:41:25.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/913: creat d10/d12/d52/d78/f13e x:0 0 0 2024-03-04T09:41:25.891 INFO:tasks.workunit.client.0.smithi046.stdout:7/870: unlink d0/d4/db/d38/f57 0 2024-03-04T09:41:26.226 INFO:tasks.workunit.client.0.smithi046.stdout:2/939: mknod d5/d40/c13d 0 2024-03-04T09:41:26.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/871: creat d0/da/d46/f128 x:0 0 0 2024-03-04T09:41:26.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/872: write d0/da/d46/fce [635862,127648] 0 2024-03-04T09:41:26.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/873: chown d0/d4/db/d38/cab 41256 1 2024-03-04T09:41:26.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/874: fdatasync d0/d4/db/d3b/d6b/f97 0 2024-03-04T09:41:27.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/940: mkdir d5/db9/d13e 0 2024-03-04T09:41:27.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/941: dread f3 [0,4194304] 0 2024-03-04T09:41:27.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/942: creat d5/d84/d88/d47/dcc/d11d/f13f x:0 0 0 2024-03-04T09:41:27.994 INFO:tasks.workunit.client.0.smithi046.stdout:5/819: unlink d1/f82 0 2024-03-04T09:41:28.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/943: mknod d5/d40/dde/c140 0 2024-03-04T09:41:28.465 INFO:tasks.workunit.client.0.smithi046.stdout:0/914: symlink d10/d12/l13f 0 2024-03-04T09:41:28.540 INFO:tasks.workunit.client.0.smithi046.stdout:0/915: dwrite d10/d12/d9a/faf [0,4194304] 0 2024-03-04T09:41:28.755 INFO:tasks.workunit.client.0.smithi046.stdout:4/978: write d0/d8e/f91 [294468,76775] 0 2024-03-04T09:41:28.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/820: chown d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/c9e 232094752 1 2024-03-04T09:41:28.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/821: dread - d1/d44/d81/d96/d20/d76/d6c/db2/dcb/ff4 zero size 2024-03-04T09:41:28.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/713: dwrite d1/f2d [0,4194304] 0 2024-03-04T09:41:29.435 INFO:tasks.workunit.client.0.smithi046.stdout:0/916: rename d10/c129 to d10/d36/c140 0 2024-03-04T09:41:29.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/944: link d5/d40/f72 d5/da/d1b/f141 0 2024-03-04T09:41:29.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/945: write d5/d84/d88/fc1 [1900630,506] 0 2024-03-04T09:41:29.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/714: readlink d1/l59 0 2024-03-04T09:41:29.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/715: getdents d1/d92/d96 0 2024-03-04T09:41:29.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/716: getdents d1/d28/d6f/dbe/dcc 0 2024-03-04T09:41:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/917: creat d10/d12/d11e/f141 x:0 0 0 2024-03-04T09:41:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/918: chown d10/d12/d9f/da6/l10b 6 1 2024-03-04T09:41:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/919: chown d10/d12/d52/d5d/fcb 51 1 2024-03-04T09:41:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/920: creat d10/d12/d52/d78/d8a/da2/dc8/f142 x:0 0 0 2024-03-04T09:41:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/921: readlink d10/d12/d52/d78/l5a 0 2024-03-04T09:41:30.602 INFO:tasks.workunit.client.0.smithi046.stdout:2/946: mknod d5/d84/d7c/c142 0 2024-03-04T09:41:30.602 INFO:tasks.workunit.client.0.smithi046.stdout:9/958: rmdir d1/d11/d6/d8/d36 39 2024-03-04T09:41:30.602 INFO:tasks.workunit.client.0.smithi046.stdout:2/947: write d5/d2c/d51/d7f/d92/f10b [7341002,45492] 0 2024-03-04T09:41:30.603 INFO:tasks.workunit.client.0.smithi046.stdout:2/948: write d5/d38/d54/fa4 [2621858,58667] 0 2024-03-04T09:41:30.603 INFO:tasks.workunit.client.0.smithi046.stdout:2/949: chown d5/d84/d88/d47/dcc/d11d/c123 2798148 1 2024-03-04T09:41:30.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/875: dwrite d0/d4/db/d12/f30 [4194304,4194304] 0 2024-03-04T09:41:30.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/959: dwrite d1/d11/d6/d8/d1d/d34/d4d/f55 [0,4194304] 0 2024-03-04T09:41:30.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/960: write d1/d11/d6/d8/d12/f29 [9189284,67935] 0 2024-03-04T09:41:30.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/961: dread d1/d11/d6/d8/d12/d1c/dd1/f5f [8388608,4194304] 0 2024-03-04T09:41:30.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/717: chown d1/fe 2235963 1 2024-03-04T09:41:30.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/962: dwrite d1/d11/d6/d8/d12/d1c/d26/ff8 [0,4194304] 0 2024-03-04T09:41:30.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/920: unlink d7/f1a 0 2024-03-04T09:41:31.243 INFO:tasks.workunit.client.0.smithi046.stdout:4/979: mknod d0/c16c 0 2024-03-04T09:41:31.243 INFO:tasks.workunit.client.0.smithi046.stdout:2/950: rename d5/d2c/ld6 to d5/d40/d117/daa/l143 0 2024-03-04T09:41:31.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/718: rename d1 to d1/d92/d96/dbb/de9 22 2024-03-04T09:41:31.243 INFO:tasks.workunit.client.0.smithi046.stdout:4/980: dread - d0/d1f/d25/d50/d119/ddc/f168 zero size 2024-03-04T09:41:31.279 INFO:tasks.workunit.client.0.smithi046.stdout:4/981: dread d0/d5f/d6f/f107 [0,4194304] 0 2024-03-04T09:41:31.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/876: creat d0/d4/db/f129 x:0 0 0 2024-03-04T09:41:32.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/963: truncate d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/fdb 3531736 0 2024-03-04T09:41:32.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/964: chown d1/d11/d6/d8/d13/d92/lb8 212558697 1 2024-03-04T09:41:32.410 INFO:tasks.workunit.client.0.smithi046.stdout:1/719: dread d1/d28/f39 [0,4194304] 0 2024-03-04T09:41:32.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/951: mknod d5/d38/c144 0 2024-03-04T09:41:32.887 INFO:tasks.workunit.client.0.smithi046.stdout:7/877: creat d0/da/d46/d99/de2/db1/f12a x:0 0 0 2024-03-04T09:41:32.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/878: dread d0/da/d46/d99/de2/fba [0,4194304] 0 2024-03-04T09:41:33.007 INFO:tasks.workunit.client.0.smithi046.stdout:4/982: dwrite d0/d8e/f93 [0,4194304] 0 2024-03-04T09:41:33.245 INFO:tasks.workunit.client.0.smithi046.stdout:5/822: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/f23 [4194304,4194304] 0 2024-03-04T09:41:33.245 INFO:tasks.workunit.client.0.smithi046.stdout:5/823: readlink d1/d44/d81/d96/d20/d76/d6c/lc8 0 2024-03-04T09:41:33.469 INFO:tasks.workunit.client.0.smithi046.stdout:1/720: fdatasync d1/d28/d6a/fa5 0 2024-03-04T09:41:33.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/952: dread d5/d84/d88/d3f/f4b [0,4194304] 0 2024-03-04T09:41:33.792 INFO:tasks.workunit.client.0.smithi046.stdout:7/879: creat d0/d2d/d85/f12b x:0 0 0 2024-03-04T09:41:33.793 INFO:tasks.workunit.client.0.smithi046.stdout:7/880: creat d0/da/d46/d99/de2/db1/f12c x:0 0 0 2024-03-04T09:41:33.793 INFO:tasks.workunit.client.0.smithi046.stdout:7/881: stat d0/d2d/l65 0 2024-03-04T09:41:33.793 INFO:tasks.workunit.client.0.smithi046.stdout:7/882: fsync d0/da/f42 0 2024-03-04T09:41:34.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/983: dread d0/d1f/de8/f12a [0,4194304] 0 2024-03-04T09:41:34.057 INFO:tasks.workunit.client.0.smithi046.stdout:4/984: write d0/d3/d20/d96/d6e/f9e [803563,106391] 0 2024-03-04T09:41:34.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/824: symlink d1/d44/d81/d96/d9a/lfe 0 2024-03-04T09:41:34.178 INFO:tasks.workunit.client.0.smithi046.stdout:5/825: dread d1/d44/d81/d96/d20/d76/d6c/d7b/f61 [4194304,4194304] 0 2024-03-04T09:41:34.179 INFO:tasks.workunit.client.0.smithi046.stdout:5/826: dread - d1/d44/d69/fbf zero size 2024-03-04T09:41:34.465 INFO:tasks.workunit.client.0.smithi046.stdout:2/953: mknod d5/d84/d7c/c145 0 2024-03-04T09:41:34.669 INFO:tasks.workunit.client.0.smithi046.stdout:7/883: symlink d0/da/d46/d99/de2/db1/dc8/d120/l12d 0 2024-03-04T09:41:34.675 INFO:tasks.workunit.client.0.smithi046.stdout:0/922: dwrite d10/d12/d52/d78/d8a/da2/f10c [0,4194304] 0 2024-03-04T09:41:34.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/923: dwrite d10/d12/d52/d78/d8a/f102 [0,4194304] 0 2024-03-04T09:41:35.020 INFO:tasks.workunit.client.0.smithi046.stdout:5/827: truncate d1/d44/d81/fb5 1201851 0 2024-03-04T09:41:35.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/985: truncate d0/d3/d20/f38 896789 0 2024-03-04T09:41:35.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/986: creat d0/d1f/d25/d50/d119/ddc/f16d x:0 0 0 2024-03-04T09:41:35.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/721: getdents d1/d28/d8d 0 2024-03-04T09:41:35.431 INFO:tasks.workunit.client.0.smithi046.stdout:2/954: fdatasync d5/d2c/d51/d61/f10d 0 2024-03-04T09:41:35.516 INFO:tasks.workunit.client.0.smithi046.stdout:7/884: symlink d0/da/d46/d99/de2/l12e 0 2024-03-04T09:41:35.516 INFO:tasks.workunit.client.0.smithi046.stdout:7/885: chown d0/da/d46/d99/de2/l12e 312 1 2024-03-04T09:41:35.562 INFO:tasks.workunit.client.0.smithi046.stdout:7/886: dread d0/d4/db/d38/d7e/fcf [0,4194304] 0 2024-03-04T09:41:36.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/828: creat d1/d44/d81/d96/d20/d76/dfb/fff x:0 0 0 2024-03-04T09:41:36.082 INFO:tasks.workunit.client.0.smithi046.stdout:5/829: dread d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/fe2 [0,4194304] 0 2024-03-04T09:41:36.287 INFO:tasks.workunit.client.0.smithi046.stdout:4/987: symlink d0/d1f/d25/d50/d119/d1e/da1/dcc/l16e 0 2024-03-04T09:41:36.316 INFO:tasks.workunit.client.0.smithi046.stdout:8/921: write d7/de/d28/dab/d2c/dd9/f111 [183289,43239] 0 2024-03-04T09:41:36.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/722: mknod d1/d92/d96/cea 0 2024-03-04T09:41:36.772 INFO:tasks.workunit.client.0.smithi046.stdout:2/955: creat d5/d2c/d51/f146 x:0 0 0 2024-03-04T09:41:36.807 INFO:tasks.workunit.client.0.smithi046.stdout:2/956: dread d5/da/fab [0,4194304] 0 2024-03-04T09:41:36.807 INFO:tasks.workunit.client.0.smithi046.stdout:2/957: chown d5/db9 5 1 2024-03-04T09:41:38.679 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:52:49.485 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.684 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:52:49.554 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.686 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:52:49.556 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.687 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:52:49.557 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.690 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:52:49.560 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.695 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:52:49.501 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.757 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:52:49.626 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.759 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:52:49.629 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.795 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:52:49.602 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:41:38.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/924: getdents d10/d12/d52/d78/df7 0 2024-03-04T09:41:38.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/925: creat d10/dd5/f143 x:0 0 0 2024-03-04T09:41:39.069 INFO:tasks.workunit.client.0.smithi046.stdout:5/830: getdents d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f 0 2024-03-04T09:41:39.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/831: truncate d1/d44/d81/d96/d20/fb9 848640 0 2024-03-04T09:41:39.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/832: fsync d1/d44/d81/d8e/dbe/fe0 0 2024-03-04T09:41:39.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/723: symlink d1/d92/leb 0 2024-03-04T09:41:39.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/724: fsync d1/d28/d6f/d74/f88 0 2024-03-04T09:41:39.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/725: stat d1/f2d 0 2024-03-04T09:41:39.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/726: write d1/d28/d8d/fad [1532896,58687] 0 2024-03-04T09:41:39.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/727: write d1/f8f [3766465,5628] 0 2024-03-04T09:41:40.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/965: truncate d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/fdb 575149 0 2024-03-04T09:41:40.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/966: creat d1/d11/d6/d8/d13/d85/f12c x:0 0 0 2024-03-04T09:41:40.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/728: chown d1/d28/f38 318 1 2024-03-04T09:41:40.940 INFO:tasks.workunit.client.0.smithi046.stdout:0/926: getdents d10/d12/d52/d78/d8a/da2/dc8 0 2024-03-04T09:41:41.080 INFO:tasks.workunit.client.0.smithi046.stdout:5/833: symlink d1/d44/d57/d70/l100 0 2024-03-04T09:41:41.436 INFO:tasks.workunit.client.0.smithi046.stdout:5/834: mknod d1/d44/d69/dcd/df1/c101 0 2024-03-04T09:41:41.482 INFO:tasks.workunit.client.0.smithi046.stdout:5/835: dwrite d1/d44/d81/d96/d20/d76/d6c/dd1/fe8 [0,4194304] 0 2024-03-04T09:41:41.482 INFO:tasks.workunit.client.0.smithi046.stdout:5/836: fdatasync d1/d44/d81/d96/d20/d76/d6c/db2/fc9 0 2024-03-04T09:41:41.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/729: truncate d1/f79 3392058 0 2024-03-04T09:41:42.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/837: mknod d1/d44/d57/c102 0 2024-03-04T09:41:42.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/838: chown d1/d44/d57/d70/l8b 16383982 1 2024-03-04T09:41:42.992 INFO:tasks.workunit.client.0.smithi046.stdout:5/839: symlink d1/d44/d69/dcd/df1/l103 0 2024-03-04T09:41:43.156 INFO:tasks.workunit.client.0.smithi046.stdout:0/927: mkdir d10/d12/d52/d78/d144 0 2024-03-04T09:41:43.167 INFO:tasks.workunit.client.0.smithi046.stdout:7/887: sync 2024-03-04T09:41:43.168 INFO:tasks.workunit.client.0.smithi046.stdout:7/888: chown d0/c18 1 1 2024-03-04T09:41:43.234 INFO:tasks.workunit.client.0.smithi046.stdout:7/889: dwrite d0/d4/db/d3b/f10e [0,4194304] 0 2024-03-04T09:41:43.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/890: write d0/d4/db/d38/d94/fa8 [2556324,21732] 0 2024-03-04T09:41:43.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/891: chown d0/d4/db/d38/d94/d113 52 1 2024-03-04T09:41:43.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/892: fdatasync d0/d4/d40/f105 0 2024-03-04T09:41:43.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/893: read d0/da/f29 [2434320,80429] 0 2024-03-04T09:41:43.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/894: creat d0/d8f/f12f x:0 0 0 2024-03-04T09:41:43.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/928: mknod d10/d36/d7a/dfc/c145 0 2024-03-04T09:41:43.605 INFO:tasks.workunit.client.0.smithi046.stdout:0/929: dwrite d10/d12/d6e/d99/fa8 [0,4194304] 0 2024-03-04T09:41:44.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/895: mknod d0/da/d46/d99/de2/db1/dfa/d11f/d119/c130 0 2024-03-04T09:41:44.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/930: symlink d10/d12/d52/d5d/l146 0 2024-03-04T09:41:44.882 INFO:tasks.workunit.client.0.smithi046.stdout:1/730: dwrite d1/d28/f4e [0,4194304] 0 2024-03-04T09:41:45.177 INFO:tasks.workunit.client.0.smithi046.stdout:7/896: chown d0/d4/db/d12/dc1/faa 207432116 1 2024-03-04T09:41:45.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/931: creat d10/d12/d52/d5d/f147 x:0 0 0 2024-03-04T09:41:45.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/932: chown d10/d12/d52/d78/c7c 3797 1 2024-03-04T09:41:45.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/922: rename d7/de/d28/dab/d2c/d64/lf3 to d7/l135 0 2024-03-04T09:41:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:5/840: rmdir d1/d44 39 2024-03-04T09:41:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:5/841: chown d1/d44/d57/d70/d86/d92 288146480 1 2024-03-04T09:41:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/897: getdents d0/d4/db/d12/dc1 0 2024-03-04T09:41:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/898: creat d0/d4/d40/f131 x:0 0 0 2024-03-04T09:41:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/899: fdatasync d0/da/d46/d99/de2/fdd 0 2024-03-04T09:41:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/900: fdatasync d0/da/d4e/fd1 0 2024-03-04T09:41:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/842: write d1/d44/d81/d96/d20/d5e/f7e [809439,111202] 0 2024-03-04T09:41:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/901: dread - d0/da/d46/f11b zero size 2024-03-04T09:41:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/902: dread - d0/d58/ffd zero size 2024-03-04T09:41:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:5/843: dread d1/d44/d81/d96/d20/f5d [0,4194304] 0 2024-03-04T09:41:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:5/844: truncate d1/d44/d81/d96/d20/d76/d6c/f8c 5058507 0 2024-03-04T09:41:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:5/845: chown d1/d44/d69/dcd/ce1 0 1 2024-03-04T09:41:46.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/988: rmdir d0/d3 39 2024-03-04T09:41:46.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/989: stat d0/d1f/d5b 0 2024-03-04T09:41:46.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/990: creat d0/d3/d3b/d9d/f16f x:0 0 0 2024-03-04T09:41:46.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/991: dread - d0/d1f/d25/d50/df5/ff9 zero size 2024-03-04T09:41:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/903: link d0/d2d/d85/f12b d0/da/d4e/dd2/dfc/f132 0 2024-03-04T09:41:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/904: chown d0/da/d46/d99/de2/db1/cb4 2 1 2024-03-04T09:41:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/905: write d0/d4/db/d38/fc7 [453367,39982] 0 2024-03-04T09:41:46.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/846: creat d1/d44/d81/d96/d20/d5e/f104 x:0 0 0 2024-03-04T09:41:47.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/731: dwrite d1/f56 [0,4194304] 0 2024-03-04T09:41:47.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/732: fsync d1/d28/d8d/fad 0 2024-03-04T09:41:47.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/958: sync 2024-03-04T09:41:47.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/959: readlink d5/d38/lee 0 2024-03-04T09:41:47.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/960: chown d5/d84/d7c/d10f/l13c 156730 1 2024-03-04T09:41:47.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/961: write d5/d40/f8f [992171,95701] 0 2024-03-04T09:41:47.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/962: creat d5/db9/dd2/f147 x:0 0 0 2024-03-04T09:41:47.840 INFO:tasks.workunit.client.0.smithi046.stdout:8/923: write d7/fc3 [640490,158] 0 2024-03-04T09:41:47.987 INFO:tasks.workunit.client.0.smithi046.stdout:9/967: rename d1/d11/d6/d8/d12/d1c/dd1/d5e/dde/ca2 to d1/d11/d6/c12d 0 2024-03-04T09:41:47.996 INFO:tasks.workunit.client.0.smithi046.stdout:9/968: dread d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/fd5 [0,4194304] 0 2024-03-04T09:41:48.104 INFO:tasks.workunit.client.0.smithi046.stdout:7/906: mknod d0/d11e/c133 0 2024-03-04T09:41:48.104 INFO:tasks.workunit.client.0.smithi046.stdout:7/907: chown d0/d4/db/d38/d94/fe8 561 1 2024-03-04T09:41:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:7/908: dwrite d0/da/d4e/dd2/dfc/f132 [0,4194304] 0 2024-03-04T09:41:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:7/909: dread - d0/d2d/f10a zero size 2024-03-04T09:41:48.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/847: link d1/d44/d81/d96/d20/cdd d1/d44/d81/d96/d20/d76/d6c/db2/dbc/c105 0 2024-03-04T09:41:48.836 INFO:tasks.workunit.client.0.smithi046.stdout:1/733: dread d1/d28/f7f [0,4194304] 0 2024-03-04T09:41:48.836 INFO:tasks.workunit.client.0.smithi046.stdout:1/734: fsync d1/fe0 0 2024-03-04T09:41:49.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/963: fsync d5/d2c/d91/fec 0 2024-03-04T09:41:49.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/992: mknod d0/d8e/c170 0 2024-03-04T09:41:49.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/933: rename d10/d12/d9a/faf to d10/d12/d1f/d3b/d6b/d12d/f148 0 2024-03-04T09:41:49.586 INFO:tasks.workunit.client.0.smithi046.stdout:0/934: write d10/d12/d6e/d99/fa8 [2580474,113655] 0 2024-03-04T09:41:49.659 INFO:tasks.workunit.client.0.smithi046.stdout:0/935: dwrite d10/d12/f1c [0,4194304] 0 2024-03-04T09:41:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:9/969: truncate d1/d11/fac 884304 0 2024-03-04T09:41:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:9/970: chown d1/d11/d6/d8/c126 3322 1 2024-03-04T09:41:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:9/971: readlink d1/d11/d6/d8/d13/l8b 0 2024-03-04T09:41:50.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/910: mkdir d0/d3c/d134 0 2024-03-04T09:41:50.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/848: mkdir d1/d44/d81/d96/d106 0 2024-03-04T09:41:50.385 INFO:tasks.workunit.client.0.smithi046.stdout:1/735: unlink d1/d28/d8d/fd3 0 2024-03-04T09:41:50.420 INFO:tasks.workunit.client.0.smithi046.stdout:1/736: read d1/d92/d96/da7/fdb [172519,98513] 0 2024-03-04T09:41:50.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/993: creat d0/d1f/f171 x:0 0 0 2024-03-04T09:41:50.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/994: write d0/f56 [243800,64201] 0 2024-03-04T09:41:50.814 INFO:tasks.workunit.client.0.smithi046.stdout:8/924: symlink d7/de/d28/dab/d3c/l136 0 2024-03-04T09:41:50.815 INFO:tasks.workunit.client.0.smithi046.stdout:8/925: chown d7/de/f7b 104341 1 2024-03-04T09:41:50.901 INFO:tasks.workunit.client.0.smithi046.stdout:8/926: dwrite d7/de/d28/dab/dc1/fdf [0,4194304] 0 2024-03-04T09:41:50.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/927: write d7/de/d28/dab/d2c/fae [4096982,81842] 0 2024-03-04T09:41:50.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/928: fdatasync d7/d53/d72/fb6 0 2024-03-04T09:41:51.223 INFO:tasks.workunit.client.0.smithi046.stdout:9/972: mkdir d1/d11/d6/d8/d13/d21/d12e 0 2024-03-04T09:41:51.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/911: creat d0/d4/db/d12/d101/f135 x:0 0 0 2024-03-04T09:41:51.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/849: mknod d1/d44/d81/d96/d9a/da0/c107 0 2024-03-04T09:41:51.953 INFO:tasks.workunit.client.0.smithi046.stdout:5/850: write d1/d44/d81/d96/d20/f5d [4426770,99133] 0 2024-03-04T09:41:52.227 INFO:tasks.workunit.client.0.smithi046.stdout:4/995: link d0/d1f/d25/d50/d119/d1e/cf4 d0/d1f/d25/d50/d119/d76/d15b/d127/c172 0 2024-03-04T09:41:52.352 INFO:tasks.workunit.client.0.smithi046.stdout:2/964: rename d5/d40/dde/c140 to d5/d84/d88/c148 0 2024-03-04T09:41:52.597 INFO:tasks.workunit.client.0.smithi046.stdout:0/936: creat d10/f149 x:0 0 0 2024-03-04T09:41:52.597 INFO:tasks.workunit.client.0.smithi046.stdout:0/937: dread - d10/d12/d52/d78/d8a/f118 zero size 2024-03-04T09:41:52.597 INFO:tasks.workunit.client.0.smithi046.stdout:0/938: dread - d10/d12/d1f/fed zero size 2024-03-04T09:41:53.352 INFO:tasks.workunit.client.0.smithi046.stdout:9/973: mkdir d1/d11/d6/d8/d1d/d34/d35/d12f 0 2024-03-04T09:41:53.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:41:53.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:41:53.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/737: rmdir d1/d28/d6f/dbe 39 2024-03-04T09:41:53.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/851: rmdir d1/d44/d57/dc7 39 2024-03-04T09:41:53.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/852: stat d1/d44/c83 0 2024-03-04T09:41:53.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/853: chown d1/d44/d81/ca4 984656 1 2024-03-04T09:41:54.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/996: dread d0/d8e/f91 [0,4194304] 0 2024-03-04T09:41:54.377 INFO:tasks.workunit.client.0.smithi046.stdout:2/965: mkdir d5/db9/dd2/df7/d133/d149 0 2024-03-04T09:41:54.377 INFO:tasks.workunit.client.0.smithi046.stdout:2/966: fdatasync d5/da/d1b/f141 0 2024-03-04T09:41:54.377 INFO:tasks.workunit.client.0.smithi046.stdout:2/967: write d5/d84/ffc [32907,105505] 0 2024-03-04T09:41:54.377 INFO:tasks.workunit.client.0.smithi046.stdout:2/968: chown d5/da/d1b 12367 1 2024-03-04T09:41:54.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/939: rmdir d10/d12/d9f/da6/d10a 0 2024-03-04T09:41:54.638 INFO:tasks.workunit.client.0.smithi046.stdout:0/940: dwrite d10/d12/f82 [4194304,4194304] 0 2024-03-04T09:41:54.967 INFO:tasks.workunit.client.0.smithi046.stdout:9/974: rename d1/d11/d6/d8/d12/d1c/dd1/d5e/fcb to d1/d11/d6/d8/d1d/d34/d4d/d11e/f130 0 2024-03-04T09:41:54.967 INFO:tasks.workunit.client.0.smithi046.stdout:9/975: dread - d1/d11/d6/d8/d12/d1c/d26/f11d zero size 2024-03-04T09:41:55.188 INFO:tasks.workunit.client.0.smithi046.stdout:1/738: symlink d1/d28/d6f/dbe/dcc/lec 0 2024-03-04T09:41:55.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/854: unlink d1/d44/d81/d96/d20/d76/d6c/l97 0 2024-03-04T09:41:55.735 INFO:tasks.workunit.client.0.smithi046.stdout:2/969: mknod d5/d84/c14a 0 2024-03-04T09:41:56.185 INFO:tasks.workunit.client.0.smithi046.stdout:0/941: symlink d10/d36/d87/l14a 0 2024-03-04T09:41:56.185 INFO:tasks.workunit.client.0.smithi046.stdout:0/942: chown d10/d12/d1f/c31 1030856 1 2024-03-04T09:41:56.185 INFO:tasks.workunit.client.0.smithi046.stdout:0/943: dread - d10/d12/d9f/f12f zero size 2024-03-04T09:41:56.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/739: creat d1/d28/d8d/fed x:0 0 0 2024-03-04T09:41:56.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/997: mknod d0/d3/d3b/c173 0 2024-03-04T09:41:56.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/998: fsync d0/d3/f6 0 2024-03-04T09:41:56.591 INFO:tasks.workunit.client.0.smithi046.stdout:2/970: mkdir d5/d2c/d51/d7f/d92/d14b 0 2024-03-04T09:41:56.674 INFO:tasks.workunit.client.0.smithi046.stdout:0/944: truncate d10/d12/f3d 3417537 0 2024-03-04T09:41:56.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/945: dread d10/dd5/fe3 [0,4194304] 0 2024-03-04T09:41:57.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/971: dwrite d5/d2c/f93 [0,4194304] 0 2024-03-04T09:41:57.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/972: write d5/d40/dde/fdb [3674941,68857] 0 2024-03-04T09:41:57.054 INFO:tasks.workunit.client.0.smithi046.stdout:4/999: rename d0/d1f/d25/da9/l75 to d0/d5f/d6f/l174 0 2024-03-04T09:41:57.121 INFO:tasks.workunit.client.0.smithi046.stdout:8/929: sync 2024-03-04T09:41:57.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/946: unlink d10/d12/d1f/d3f/fc1 0 2024-03-04T09:41:57.709 INFO:tasks.workunit.client.0.smithi046.stdout:1/740: truncate d1/fb8 1510496 0 2024-03-04T09:41:57.709 INFO:tasks.workunit.client.0.smithi046.stdout:1/741: truncate d1/fd2 1048057 0 2024-03-04T09:41:57.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/973: rename d5/da/f23 to d5/db9/d13e/f14c 0 2024-03-04T09:41:57.745 INFO:tasks.workunit.client.0.smithi046.stdout:8/930: creat d7/de/d28/d3a/f137 x:0 0 0 2024-03-04T09:41:57.791 INFO:tasks.workunit.client.0.smithi046.stdout:1/742: dwrite d1/d28/f6e [0,4194304] 0 2024-03-04T09:41:58.715 INFO:tasks.workunit.client.0.smithi046.stdout:2/974: creat d5/f14d x:0 0 0 2024-03-04T09:41:58.715 INFO:tasks.workunit.client.0.smithi046.stdout:2/975: creat d5/db9/dd2/df7/f14e x:0 0 0 2024-03-04T09:41:58.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/931: rename d7/de/d12/fad to d7/de/d28/d3a/f138 0 2024-03-04T09:41:58.962 INFO:tasks.workunit.client.0.smithi046.stdout:7/912: mkdir d0/d4/db/d136 0 2024-03-04T09:41:58.962 INFO:tasks.workunit.client.0.smithi046.stdout:7/913: fsync d0/d4/d40/f49 0 2024-03-04T09:41:59.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/932: dwrite d7/de/d28/dab/d2c/d62/f8d [4194304,4194304] 0 2024-03-04T09:41:59.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/933: fsync d7/de/d4c/f11d 0 2024-03-04T09:41:59.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/934: chown d7/de/d28/dab/d2c/d64/db8/d109/d12c/l70 25208103 1 2024-03-04T09:41:59.365 INFO:tasks.workunit.client.0.smithi046.stdout:2/976: mknod d5/da/dbd/c14f 0 2024-03-04T09:41:59.639 INFO:tasks.workunit.client.0.smithi046.stdout:7/914: rename d0/d4/db/d38/dc0 to d0/d58/d103/d137 0 2024-03-04T09:41:59.827 INFO:tasks.workunit.client.0.smithi046.stdout:9/976: dwrite d1/d11/d6/d8/f1a [0,4194304] 0 2024-03-04T09:42:00.440 INFO:tasks.workunit.client.0.smithi046.stdout:2/977: creat d5/da/d1b/d116/f150 x:0 0 0 2024-03-04T09:42:00.554 INFO:tasks.workunit.client.0.smithi046.stdout:7/915: symlink d0/da/d46/d99/l138 0 2024-03-04T09:42:00.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/977: link d1/d11/d6/d8/d13/c116 d1/d11/d6/d8/d13/d21/d125/c131 0 2024-03-04T09:42:00.886 INFO:tasks.workunit.client.0.smithi046.stdout:2/978: creat d5/d84/d88/d47/f151 x:0 0 0 2024-03-04T09:42:01.044 INFO:tasks.workunit.client.0.smithi046.stdout:7/916: unlink d0/d4/db/d12/d28/l35 0 2024-03-04T09:42:01.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/978: symlink d1/d11/d6/d8/d1d/d34/d4d/d11e/l132 0 2024-03-04T09:42:01.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/979: stat d1/d11/d6/d8/d13/f24 0 2024-03-04T09:42:01.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/980: creat d1/d11/d6/d118/f133 x:0 0 0 2024-03-04T09:42:01.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/981: creat d1/d11/d6/d8/d1d/d34/d4d/d7e/f134 x:0 0 0 2024-03-04T09:42:01.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/743: write d1/fb8 [121094,73497] 0 2024-03-04T09:42:01.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/979: dread d5/d2c/f2e [0,4194304] 0 2024-03-04T09:42:01.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/980: chown d5/d84/d88/d47/c68 504 1 2024-03-04T09:42:01.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/981: write d5/d2c/d51/d7f/fe8 [1016161,18015] 0 2024-03-04T09:42:01.350 INFO:tasks.workunit.client.0.smithi046.stdout:2/982: dwrite d5/d2c/d51/d7f/d92/f10b [0,4194304] 0 2024-03-04T09:42:01.427 INFO:tasks.workunit.client.0.smithi046.stdout:2/983: dwrite d5/d2c/d91/fe1 [0,4194304] 0 2024-03-04T09:42:01.495 INFO:tasks.workunit.client.0.smithi046.stdout:0/947: write d10/d12/d9f/fb0 [1348999,40056] 0 2024-03-04T09:42:01.606 INFO:tasks.workunit.client.0.smithi046.stdout:5/855: link d1/d44/l62 d1/l108 0 2024-03-04T09:42:01.635 INFO:tasks.workunit.client.0.smithi046.stdout:5/856: dread d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/fc [0,4194304] 0 2024-03-04T09:42:02.224 INFO:tasks.workunit.client.0.smithi046.stdout:9/982: creat d1/d11/d6/d8/d12/f135 x:0 0 0 2024-03-04T09:42:02.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/744: creat d1/d28/fee x:0 0 0 2024-03-04T09:42:02.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/917: creat d0/f139 x:0 0 0 2024-03-04T09:42:02.600 INFO:tasks.workunit.client.0.smithi046.stdout:2/984: dread d5/da/dbd/ff0 [0,4194304] 0 2024-03-04T09:42:02.600 INFO:tasks.workunit.client.0.smithi046.stdout:2/985: dread - d5/db9/dd2/f147 zero size 2024-03-04T09:42:02.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/986: dread d5/d2c/d51/d7f/fe8 [0,4194304] 0 2024-03-04T09:42:02.656 INFO:tasks.workunit.client.0.smithi046.stdout:0/948: mknod d10/d12/d52/c14b 0 2024-03-04T09:42:02.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/857: creat d1/d44/d81/d96/d54/f109 x:0 0 0 2024-03-04T09:42:02.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/858: dwrite d1/d44/d81/d8e/f2e [0,4194304] 0 2024-03-04T09:42:02.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/983: stat d1/d11/d6/d8/d12/d1c/dd1/cc1 0 2024-03-04T09:42:03.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/918: rename d0/d4/db/d12/f30 to d0/d58/f13a 0 2024-03-04T09:42:03.304 INFO:tasks.workunit.client.0.smithi046.stdout:7/919: dread d0/d2d/d85/fa9 [0,4194304] 0 2024-03-04T09:42:03.402 INFO:tasks.workunit.client.0.smithi046.stdout:7/920: dwrite d0/da/d46/d99/de2/db1/fb5 [0,4194304] 0 2024-03-04T09:42:03.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/921: creat d0/d4/db/d38/d94/f13b x:0 0 0 2024-03-04T09:42:03.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/922: creat d0/d4/d6e/f13c x:0 0 0 2024-03-04T09:42:03.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/987: getdents d5/d84/d7c 0 2024-03-04T09:42:03.522 INFO:tasks.workunit.client.0.smithi046.stdout:0/949: truncate d10/d12/d9a/dd8/fe0 948500 0 2024-03-04T09:42:03.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/950: read d10/d12/d9f/fd4 [695795,3460] 0 2024-03-04T09:42:04.101 INFO:tasks.workunit.client.0.smithi046.stdout:9/984: mkdir d1/d11/d6/d8/d12/d1c/d26/dae/df2/d136 0 2024-03-04T09:42:04.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/923: truncate d0/f31 1040476 0 2024-03-04T09:42:04.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/924: creat d0/da/d46/f13d x:0 0 0 2024-03-04T09:42:04.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/988: creat d5/d84/d7c/dd0/f152 x:0 0 0 2024-03-04T09:42:04.641 INFO:tasks.workunit.client.0.smithi046.stdout:0/951: link d10/d12/d1f/d3f/d4b/f13b d10/d12/d52/d78/d8a/da2/d123/f14c 0 2024-03-04T09:42:04.641 INFO:tasks.workunit.client.0.smithi046.stdout:0/952: dread - d10/d12/d6e/d99/f109 zero size 2024-03-04T09:42:04.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/985: mknod d1/d11/d6/d8/d12/d117/c137 0 2024-03-04T09:42:04.743 INFO:tasks.workunit.client.0.smithi046.stdout:9/986: dread d1/d11/d6/d8/d13/d21/f69 [0,4194304] 0 2024-03-04T09:42:04.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/987: dwrite d1/d11/d6/d8/d13/d85/f12c [0,4194304] 0 2024-03-04T09:42:04.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/988: chown d1/d11/d6/d8/d1d/d34/d4d/d11e 2080 1 2024-03-04T09:42:04.892 INFO:tasks.workunit.client.0.smithi046.stdout:9/989: dwrite d1/d11/d6/d8/d12/d1c/f48 [0,4194304] 0 2024-03-04T09:42:05.630 INFO:tasks.workunit.client.0.smithi046.stdout:2/989: creat d5/db9/dd2/df7/d133/f153 x:0 0 0 2024-03-04T09:42:05.630 INFO:tasks.workunit.client.0.smithi046.stdout:2/990: fsync d5/f1f 0 2024-03-04T09:42:05.633 INFO:tasks.workunit.client.0.smithi046.stdout:8/935: sync 2024-03-04T09:42:05.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/953: symlink d10/d12/d1f/d3b/d6b/l14d 0 2024-03-04T09:42:05.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/936: read d7/de/d12/fb7 [6603731,84553] 0 2024-03-04T09:42:05.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/937: creat d7/de/d28/d36/d7c/f139 x:0 0 0 2024-03-04T09:42:05.672 INFO:tasks.workunit.client.0.smithi046.stdout:8/938: write d7/de/d28/d36/d7c/f130 [563759,33268] 0 2024-03-04T09:42:05.672 INFO:tasks.workunit.client.0.smithi046.stdout:8/939: stat d7/de/d28/d71/faa 0 2024-03-04T09:42:05.769 INFO:tasks.workunit.client.0.smithi046.stdout:8/940: dwrite d7/de/d28/d3a/d7d/f120 [0,4194304] 0 2024-03-04T09:42:06.323 INFO:tasks.workunit.client.0.smithi046.stdout:2/991: write d5/d2c/f33 [7441646,55360] 0 2024-03-04T09:42:06.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/954: rmdir d10/d36/d7a 39 2024-03-04T09:42:06.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/955: truncate d10/f96 111256 0 2024-03-04T09:42:07.408 INFO:tasks.workunit.client.0.smithi046.stdout:0/956: mkdir d10/d12/d11e/d14e 0 2024-03-04T09:42:07.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/859: write d1/d44/d81/d96/d20/d76/d6c/db2/fd2 [68123,111259] 0 2024-03-04T09:42:07.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/745: dwrite d1/d28/f3c [0,4194304] 0 2024-03-04T09:42:07.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/746: fsync d1/f2d 0 2024-03-04T09:42:08.156 INFO:tasks.workunit.client.0.smithi046.stdout:2/992: rename d5/d84/d7c/ld1 to d5/d84/d88/l154 0 2024-03-04T09:42:08.474 INFO:tasks.workunit.client.0.smithi046.stdout:5/860: mknod d1/d44/d81/d96/d20/d76/d6c/dd1/c10a 0 2024-03-04T09:42:08.637 INFO:tasks.workunit.client.0.smithi046.stdout:1/747: mknod d1/d92/d96/da7/cef 0 2024-03-04T09:42:09.159 INFO:tasks.workunit.client.0.smithi046.stdout:7/925: sync 2024-03-04T09:42:09.159 INFO:tasks.workunit.client.0.smithi046.stdout:7/926: fdatasync d0/d2d/d85/f12b 0 2024-03-04T09:42:09.610 INFO:tasks.workunit.client.0.smithi046.stdout:1/748: symlink d1/d92/d9a/lf0 0 2024-03-04T09:42:09.850 INFO:tasks.workunit.client.0.smithi046.stdout:7/927: mkdir d0/da/d46/d99/de2/db1/dc8/dcb/d13e 0 2024-03-04T09:42:09.990 INFO:tasks.workunit.client.0.smithi046.stdout:9/990: write d1/d11/d6/d8/d1d/d34/d7f/fbf [1294154,118746] 0 2024-03-04T09:42:10.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/749: fdatasync d1/d28/d6a/fca 0 2024-03-04T09:42:10.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/750: chown d1/f19 86648 1 2024-03-04T09:42:10.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/751: fsync d1/d28/d6f/da6/fb4 0 2024-03-04T09:42:10.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/752: fdatasync d1/d28/d6f/f80 0 2024-03-04T09:42:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/957: rename d10/d12/d9a/dd8 to d10/dd5/d14f 0 2024-03-04T09:42:10.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/991: mknod d1/d11/d6/d8/d12/d1c/dd1/d5e/dde/c138 0 2024-03-04T09:42:10.953 INFO:tasks.workunit.client.0.smithi046.stdout:8/941: write d7/de/d28/dab/d2c/d64/db8/d109/d12c/dc9/ddc/ff0 [3369822,104013] 0 2024-03-04T09:42:10.953 INFO:tasks.workunit.client.0.smithi046.stdout:8/942: chown d7/de/d28/dab/c56 5219715 1 2024-03-04T09:42:11.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/958: dread d10/d12/d6e/f93 [0,4194304] 0 2024-03-04T09:42:11.248 INFO:tasks.workunit.client.0.smithi046.stdout:2/993: rename d5/d40/d117/daa/fdd to d5/d84/d88/d3f/f155 0 2024-03-04T09:42:11.256 INFO:tasks.workunit.client.0.smithi046.stdout:2/994: read d5/da/dbd/fcd [399743,24541] 0 2024-03-04T09:42:11.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/959: mkdir d10/d12/d52/d150 0 2024-03-04T09:42:11.913 INFO:tasks.workunit.client.0.smithi046.stdout:7/928: mknod d0/d4/db/c13f 0 2024-03-04T09:42:12.206 INFO:tasks.workunit.client.0.smithi046.stdout:2/995: mknod d5/db9/d105/c156 0 2024-03-04T09:42:12.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/943: truncate d7/de/d12/f43 914711 0 2024-03-04T09:42:12.206 INFO:tasks.workunit.client.0.smithi046.stdout:2/996: stat d5/da/d1b/f141 0 2024-03-04T09:42:12.206 INFO:tasks.workunit.client.0.smithi046.stdout:2/997: stat d5/d40/da8/d12c 0 2024-03-04T09:42:12.206 INFO:tasks.workunit.client.0.smithi046.stdout:2/998: dread - d5/da/dbd/f10e zero size 2024-03-04T09:42:12.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/944: dread - d7/de/d28/d3a/f137 zero size 2024-03-04T09:42:12.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/945: fdatasync d7/de/fec 0 2024-03-04T09:42:12.241 INFO:tasks.workunit.client.0.smithi046.stdout:0/960: mkdir d10/d12/d9a/d151 0 2024-03-04T09:42:12.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/961: dread d10/d12/d1f/ffa [0,4194304] 0 2024-03-04T09:42:12.303 INFO:tasks.workunit.client.0.smithi046.stdout:5/861: truncate d1/d44/d81/d8e/f2e 1269176 0 2024-03-04T09:42:12.558 INFO:tasks.workunit.client.0.smithi046.stdout:7/929: creat d0/d4/db/d12/d28/f140 x:0 0 0 2024-03-04T09:42:12.602 INFO:tasks.workunit.client.0.smithi046.stdout:7/930: dwrite d0/d58/d103/f118 [0,4194304] 0 2024-03-04T09:42:12.621 INFO:tasks.workunit.client.0.smithi046.stdout:7/931: dread d0/da/d4e/dd2/fd9 [0,4194304] 0 2024-03-04T09:42:12.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/932: write d0/f11 [7270405,15610] 0 2024-03-04T09:42:13.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/962: symlink d10/d12/d52/d78/d8a/da2/d123/l152 0 2024-03-04T09:42:13.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/963: dread - d10/d12/d6e/d99/fe2 zero size 2024-03-04T09:42:13.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/964: write d10/d12/d1f/d3f/d4b/ff4 [199707,83377] 0 2024-03-04T09:42:13.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/862: mkdir d1/d44/d81/d8e/dbe/d10b 0 2024-03-04T09:42:13.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/863: fsync d1/f36 0 2024-03-04T09:42:13.414 INFO:tasks.workunit.client.0.smithi046.stdout:1/753: dwrite d1/f24 [0,4194304] 0 2024-03-04T09:42:13.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/864: dwrite d1/d44/d81/d8e/dbe/fe0 [0,4194304] 0 2024-03-04T09:42:13.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/933: unlink d0/d4/db/d12/lbe 0 2024-03-04T09:42:13.663 INFO:tasks.workunit.client.0.smithi046.stdout:2/999: mkdir d5/d84/d88/d3f/d157 0 2024-03-04T09:42:14.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/865: creat d1/d44/d81/d96/f10c x:0 0 0 2024-03-04T09:42:14.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/866: chown d1/d44/d81/d96/d20/d76/d6c/db2/dcb/ff6 156485 1 2024-03-04T09:42:14.271 INFO:tasks.workunit.client.0.smithi046.stdout:7/934: mknod d0/d3c/c141 0 2024-03-04T09:42:14.422 INFO:tasks.workunit.client.0.smithi046.stdout:5/867: creat d1/d44/d81/d96/d54/f10d x:0 0 0 2024-03-04T09:42:14.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/935: mkdir d0/d2d/d85/d142 0 2024-03-04T09:42:14.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/936: dread - d0/d4/db/d38/d94/f114 zero size 2024-03-04T09:42:14.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/937: dwrite d0/d4/d6e/f84 [0,4194304] 0 2024-03-04T09:42:14.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/938: chown d0/d4/f1f 648 1 2024-03-04T09:42:15.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/992: rename d1/d11/d6/d8/d1d/d34/d4d to d1/d11/d6/d8/d139 0 2024-03-04T09:42:15.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/993: write d1/d11/d6/d8/d139/d7e/f134 [226254,72664] 0 2024-03-04T09:42:15.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/994: truncate d1/d11/d6/d8/d12/d1c/d26/f11d 908839 0 2024-03-04T09:42:15.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/995: dwrite d1/d11/d6/d8/d1d/d34/d7f/dfc/dfe/da3/feb [0,4194304] 0 2024-03-04T09:42:15.307 INFO:tasks.workunit.client.0.smithi046.stdout:7/939: creat d0/da/d46/d99/de2/db1/f143 x:0 0 0 2024-03-04T09:42:15.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/940: write d0/d4/db/d3b/d6b/f97 [350699,90023] 0 2024-03-04T09:42:15.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/868: rmdir d1/d44/d81/d96/d20/d76/d6c/d7b/db7 0 2024-03-04T09:42:15.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/754: rename d1/d92/la4 to d1/d92/d96/da7/lf1 0 2024-03-04T09:42:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:9/996: mknod d1/d11/d6/d8/d1d/d34/c13a 0 2024-03-04T09:42:16.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/941: symlink d0/da/d46/d99/de2/db1/dc8/d120/l144 0 2024-03-04T09:42:16.148 INFO:tasks.workunit.client.0.smithi046.stdout:7/942: dwrite d0/d4/db/d3b/d6b/f97 [0,4194304] 0 2024-03-04T09:42:16.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/869: link d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/c58 d1/d44/d81/d96/d20/d5e/c10e 0 2024-03-04T09:42:16.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/755: mkdir d1/d28/d6f/da6/df2 0 2024-03-04T09:42:16.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/756: chown d1/d28/d6f/db7/ld1 15471779 1 2024-03-04T09:42:16.331 INFO:tasks.workunit.client.0.smithi046.stdout:9/997: creat d1/d11/d6/d8/d1d/d34/d35/f13b x:0 0 0 2024-03-04T09:42:16.353 INFO:tasks.workunit.client.0.smithi046.stdout:9/998: read d1/d11/d6/d8/f1a [2401012,67219] 0 2024-03-04T09:42:16.788 INFO:tasks.workunit.client.0.smithi046.stdout:1/757: truncate d1/f56 1350998 0 2024-03-04T09:42:16.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/999: getdents d1/d11/d6/d8/d13/d92 0 2024-03-04T09:42:16.874 INFO:tasks.workunit.client.0.smithi046.stdout:1/758: dwrite d1/d28/fee [0,4194304] 0 2024-03-04T09:42:19.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/943: rename d0/d4/db/d12/d28 to d0/da/d46/d99/de2/de3/d145 0 2024-03-04T09:42:19.740 INFO:tasks.workunit.client.0.smithi046.stdout:7/944: creat d0/da/d46/d99/de2/db1/dc8/dcb/d13e/f146 x:0 0 0 2024-03-04T09:42:19.777 INFO:tasks.workunit.client.0.smithi046.stdout:7/945: dread d0/da/fac [0,4194304] 0 2024-03-04T09:42:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:5/870: dwrite d1/d44/d81/f91 [0,4194304] 0 2024-03-04T09:42:20.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/871: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f46 [0,4194304] 0 2024-03-04T09:42:20.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/946: mknod d7/de/c13a 0 2024-03-04T09:42:20.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/947: chown d7/de/d28/dab/d3c/f9c 92207480 1 2024-03-04T09:42:20.245 INFO:tasks.workunit.client.0.smithi046.stdout:0/965: creat d10/d12/f153 x:0 0 0 2024-03-04T09:42:20.772 INFO:tasks.workunit.client.0.smithi046.stdout:7/946: creat d0/d4/db/dc4/f147 x:0 0 0 2024-03-04T09:42:21.186 INFO:tasks.workunit.client.0.smithi046.stdout:5/872: mknod d1/d44/d81/d96/d9a/c10f 0 2024-03-04T09:42:21.739 INFO:tasks.workunit.client.0.smithi046.stdout:8/948: truncate d7/de/f7e 2172671 0 2024-03-04T09:42:21.739 INFO:tasks.workunit.client.0.smithi046.stdout:8/949: write d7/de/d28/dab/d3c/da5/df8/f105 [5229998,97003] 0 2024-03-04T09:42:21.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/966: rename d10/d36/f3a to d10/d12/d6e/d99/f154 0 2024-03-04T09:42:21.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/950: dread d7/d53/d72/fb6 [0,4194304] 0 2024-03-04T09:42:21.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/951: chown d7/de/d28/dab/d2c/dd9/f10a 9 1 2024-03-04T09:42:21.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/952: chown d7/d53/la0 1235039703 1 2024-03-04T09:42:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:5/873: dread d1/d44/d81/faa [0,4194304] 0 2024-03-04T09:42:21.799 INFO:tasks.workunit.client.0.smithi046.stdout:0/967: dread d10/d12/f1c [0,4194304] 0 2024-03-04T09:42:21.802 INFO:tasks.workunit.client.0.smithi046.stdout:1/759: sync 2024-03-04T09:42:21.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/760: dwrite d1/d92/f9b [4194304,4194304] 0 2024-03-04T09:42:22.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/947: rename d0/d2d/d85/cf7 to d0/da/d46/d99/de2/db1/dc8/dcb/d13e/c148 0 2024-03-04T09:42:22.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/968: rmdir d10/d131 0 2024-03-04T09:42:22.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/761: mkdir d1/d92/df3 0 2024-03-04T09:42:22.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/874: rename d1/d44/d57/d70/l94 to d1/d44/d81/d96/d20/d76/dfb/l110 0 2024-03-04T09:42:22.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/875: fdatasync d1/d44/d69/fbf 0 2024-03-04T09:42:22.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/876: write d1/d44/d81/d96/d54/f10d [143927,65535] 0 2024-03-04T09:42:22.842 INFO:tasks.workunit.client.0.smithi046.stdout:7/948: symlink d0/d4/db/d38/d7e/dc5/l149 0 2024-03-04T09:42:22.842 INFO:tasks.workunit.client.0.smithi046.stdout:7/949: fdatasync d0/da/f2a 0 2024-03-04T09:42:23.202 INFO:tasks.workunit.client.0.smithi046.stdout:8/953: link d7/de/d28/dab/d3c/f95 d7/de/d4c/d50/dff/f13b 0 2024-03-04T09:42:23.202 INFO:tasks.workunit.client.0.smithi046.stdout:8/954: chown d7/d53/d72/f129 73385690 1 2024-03-04T09:42:23.202 INFO:tasks.workunit.client.0.smithi046.stdout:8/955: stat d7/de/d28/dab/d3c/l66 0 2024-03-04T09:42:23.444 INFO:tasks.workunit.client.0.smithi046.stdout:0/969: mknod d10/d12/d1f/d3b/d6b/d12d/c155 0 2024-03-04T09:42:23.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/762: truncate d1/d28/f38 3066126 0 2024-03-04T09:42:23.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:42:23.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:42:23.741 INFO:tasks.workunit.client.0.smithi046.stdout:5/877: rename d1/d44/d57/f35 to d1/d44/d81/d96/d20/d76/d6c/db2/dcb/f111 0 2024-03-04T09:42:23.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/950: mkdir d0/d4/db/d38/d7e/dc5/d14a 0 2024-03-04T09:42:24.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/956: rmdir d7/de/d28/dab/d2c/d64/db8/d109/d12c/dc9 39 2024-03-04T09:42:24.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/957: stat d7/de/d28/dab/dc1 0 2024-03-04T09:42:24.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/958: chown d7/de/d28/dab/d3c/da5 712 1 2024-03-04T09:42:24.169 INFO:tasks.workunit.client.0.smithi046.stdout:8/959: dwrite d7/de/d4c/d50/fed [0,4194304] 0 2024-03-04T09:42:24.169 INFO:tasks.workunit.client.0.smithi046.stdout:8/960: chown d7/de/d28/cbe 32018429 1 2024-03-04T09:42:25.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/878: creat d1/d44/d57/d70/d86/d92/dbb/f112 x:0 0 0 2024-03-04T09:42:25.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/879: creat d1/d44/d81/d96/d9a/da0/f113 x:0 0 0 2024-03-04T09:42:25.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/880: write d1/d44/d81/d96/d9a/da0/f113 [365881,32470] 0 2024-03-04T09:42:25.658 INFO:tasks.workunit.client.0.smithi046.stdout:7/951: creat d0/d4/db/d12/f14b x:0 0 0 2024-03-04T09:42:26.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/763: rename d1/f98 to d1/d28/d6f/db1/ff4 0 2024-03-04T09:42:26.593 INFO:tasks.workunit.client.0.smithi046.stdout:5/881: symlink d1/d44/d81/d96/d20/d76/d6c/dda/l114 0 2024-03-04T09:42:26.683 INFO:tasks.workunit.client.0.smithi046.stdout:7/952: mknod d0/d4/db/d3b/c14c 0 2024-03-04T09:42:26.683 INFO:tasks.workunit.client.0.smithi046.stdout:7/953: chown d0/d58/l4f 488777832 1 2024-03-04T09:42:26.683 INFO:tasks.workunit.client.0.smithi046.stdout:7/954: creat d0/d4/db/d38/d94/f14d x:0 0 0 2024-03-04T09:42:26.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/970: rename d10/d12/d1f/d3b/cd1 to d10/d12/d1f/d3b/c156 0 2024-03-04T09:42:27.442 INFO:tasks.workunit.client.0.smithi046.stdout:7/955: read d0/d4/db/d12/f34 [109428,48644] 0 2024-03-04T09:42:27.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/764: truncate d1/f23 2918805 0 2024-03-04T09:42:27.853 INFO:tasks.workunit.client.0.smithi046.stdout:7/956: stat d0/da/d46/d99/de2/db1/cb4 0 2024-03-04T09:42:27.854 INFO:tasks.workunit.client.0.smithi046.stdout:7/957: truncate d0/d58/ffe 258492 0 2024-03-04T09:42:27.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/971: mkdir d10/d36/d7a/d157 0 2024-03-04T09:42:28.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/765: mknod d1/d92/d96/dbb/cf5 0 2024-03-04T09:42:28.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/766: truncate d1/d92/d96/da7/fdb 5170757 0 2024-03-04T09:42:28.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/958: symlink d0/d4/db/d136/l14e 0 2024-03-04T09:42:29.280 INFO:tasks.workunit.client.0.smithi046.stdout:8/961: dwrite d7/de/d4c/d50/f6e [0,4194304] 0 2024-03-04T09:42:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:5/882: dwrite d1/f87 [0,4194304] 0 2024-03-04T09:42:29.363 INFO:tasks.workunit.client.0.smithi046.stdout:5/883: dread d1/d44/d81/d96/f4c [0,4194304] 0 2024-03-04T09:42:29.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/767: chown d1/d28/c9e 0 1 2024-03-04T09:42:29.637 INFO:tasks.workunit.client.0.smithi046.stdout:7/959: mkdir d0/d8f/d14f 0 2024-03-04T09:42:29.637 INFO:tasks.workunit.client.0.smithi046.stdout:1/768: read d1/d92/d96/da7/fdb [3776201,58465] 0 2024-03-04T09:42:29.637 INFO:tasks.workunit.client.0.smithi046.stdout:1/769: chown d1/d28/d6f/db7/fac 59334104 1 2024-03-04T09:42:29.637 INFO:tasks.workunit.client.0.smithi046.stdout:1/770: readlink d1/d28/d6f/dbe/dcc/lec 0 2024-03-04T09:42:29.655 INFO:tasks.workunit.client.0.smithi046.stdout:7/960: dread d0/d4/db/d38/d94/f112 [0,4194304] 0 2024-03-04T09:42:29.981 INFO:tasks.workunit.client.0.smithi046.stdout:8/962: creat d7/de/d28/dab/dc1/dfc/f13c x:0 0 0 2024-03-04T09:42:30.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/771: dread d1/d28/f30 [0,4194304] 0 2024-03-04T09:42:30.277 INFO:tasks.workunit.client.0.smithi046.stdout:7/961: truncate d0/d4/db/f77 666687 0 2024-03-04T09:42:30.277 INFO:tasks.workunit.client.0.smithi046.stdout:7/962: fsync d0/d4/db/d12/dc1/f93 0 2024-03-04T09:42:30.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/963: mkdir d7/d13d 0 2024-03-04T09:42:30.549 INFO:tasks.workunit.client.0.smithi046.stdout:5/884: getdents d1/d44/d81/d8e/d72 0 2024-03-04T09:42:30.549 INFO:tasks.workunit.client.0.smithi046.stdout:5/885: truncate d1/d44/d81/d96/d20/d76/dfb/fff 607287 0 2024-03-04T09:42:30.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/772: symlink d1/d92/d96/lf6 0 2024-03-04T09:42:30.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/773: fdatasync d1/d28/f47 0 2024-03-04T09:42:30.921 INFO:tasks.workunit.client.0.smithi046.stdout:7/963: creat d0/d11e/f150 x:0 0 0 2024-03-04T09:42:31.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/964: creat d7/d53/d72/f13e x:0 0 0 2024-03-04T09:42:31.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/965: fsync d7/de/d3e/da1/fa6 0 2024-03-04T09:42:31.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/966: dread - d7/d53/d72/d93/fd5 zero size 2024-03-04T09:42:31.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/967: write d7/de/d28/dab/f121 [901814,65839] 0 2024-03-04T09:42:31.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/968: write d7/de/d12/f108 [726910,47838] 0 2024-03-04T09:42:31.238 INFO:tasks.workunit.client.0.smithi046.stdout:5/886: symlink d1/d44/d81/d96/d20/d76/d6c/db2/d8a/l115 0 2024-03-04T09:42:31.238 INFO:tasks.workunit.client.0.smithi046.stdout:5/887: readlink d1/d44/d81/d96/d20/d76/d6c/dda/l114 0 2024-03-04T09:42:31.443 INFO:tasks.workunit.client.0.smithi046.stdout:1/774: rename d1/d28/d6f/dbe/cd9 to d1/d28/d6f/da6/df2/cf7 0 2024-03-04T09:42:31.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/972: write d10/d12/d52/d78/d8a/da2/d123/f14c [1013961,122334] 0 2024-03-04T09:42:31.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/973: dread - d10/d12/d1f/d3f/d7e/f125 zero size 2024-03-04T09:42:31.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/974: chown d10/d12/d52/f8c 1359 1 2024-03-04T09:42:31.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/975: chown d10/d12/l13 456769 1 2024-03-04T09:42:31.656 INFO:tasks.workunit.client.0.smithi046.stdout:0/976: dread d10/d12/f4f [8388608,4194304] 0 2024-03-04T09:42:31.709 INFO:tasks.workunit.client.0.smithi046.stdout:7/964: truncate d0/d4/db/d38/d94/fa8 3916549 0 2024-03-04T09:42:31.709 INFO:tasks.workunit.client.0.smithi046.stdout:7/965: creat d0/d8f/f151 x:0 0 0 2024-03-04T09:42:31.721 INFO:tasks.workunit.client.0.smithi046.stdout:7/966: dread d0/d8f/f6c [0,4194304] 0 2024-03-04T09:42:31.778 INFO:tasks.workunit.client.0.smithi046.stdout:8/969: truncate d7/de/d28/dab/d2c/d62/f8d 6563889 0 2024-03-04T09:42:31.832 INFO:tasks.workunit.client.0.smithi046.stdout:5/888: truncate d1/d44/d81/d96/d20/f42 3280375 0 2024-03-04T09:42:31.949 INFO:tasks.workunit.client.0.smithi046.stdout:1/775: symlink d1/d28/d6f/dbe/dcc/lf8 0 2024-03-04T09:42:32.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/977: creat d10/d12/d52/d5d/d83/f158 x:0 0 0 2024-03-04T09:42:32.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/978: write d10/d12/d1f/d3f/d4b/ff4 [718457,76563] 0 2024-03-04T09:42:32.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/979: chown d10/d12/d52/d5d/d83/c94 28 1 2024-03-04T09:42:32.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/980: truncate d10/d12/d52/d5d/d83/f158 875612 0 2024-03-04T09:42:32.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/967: creat d0/da/d46/d99/de2/de3/f152 x:0 0 0 2024-03-04T09:42:32.512 INFO:tasks.workunit.client.0.smithi046.stdout:8/970: getdents d7/de/d28/dab/d2c/d64/db8 0 2024-03-04T09:42:32.512 INFO:tasks.workunit.client.0.smithi046.stdout:8/971: fsync d7/de/f52 0 2024-03-04T09:42:32.512 INFO:tasks.workunit.client.0.smithi046.stdout:8/972: fsync d7/de/d28/dab/d2c/d64/db8/d109/d12c/dc9/f107 0 2024-03-04T09:42:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/889: creat d1/d44/d81/d96/d20/d76/d6c/d7b/f116 x:0 0 0 2024-03-04T09:42:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:1/776: mkdir d1/d28/d6f/db1/df9 0 2024-03-04T09:42:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:1/777: chown d1/d92/d9a/lf0 2461691 1 2024-03-04T09:42:32.877 INFO:tasks.workunit.client.0.smithi046.stdout:1/778: dwrite d1/d28/fee [0,4194304] 0 2024-03-04T09:42:32.956 INFO:tasks.workunit.client.0.smithi046.stdout:7/968: creat d0/da/d46/d99/de2/db1/f153 x:0 0 0 2024-03-04T09:42:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/973: creat d7/d53/d72/f13f x:0 0 0 2024-03-04T09:42:33.254 INFO:tasks.workunit.client.0.smithi046.stdout:5/890: symlink d1/d44/d81/d96/d9a/l117 0 2024-03-04T09:42:33.782 INFO:tasks.workunit.client.0.smithi046.stdout:1/779: fdatasync d1/f7 0 2024-03-04T09:42:33.782 INFO:tasks.workunit.client.0.smithi046.stdout:1/780: fsync d1/fd2 0 2024-03-04T09:42:33.875 INFO:tasks.workunit.client.0.smithi046.stdout:7/969: symlink d0/da/d4e/dd2/l154 0 2024-03-04T09:42:34.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/891: mknod d1/d44/d69/c118 0 2024-03-04T09:42:34.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/781: write d1/f27 [2919129,122503] 0 2024-03-04T09:42:34.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/974: mkdir d7/de/d4c/de4/d140 0 2024-03-04T09:42:34.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/892: read d1/d44/d81/d96/d20/d76/f48 [7151736,80905] 0 2024-03-04T09:42:34.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/893: dread d1/d44/d81/d96/d20/d76/d6c/db2/fc9 [0,4194304] 0 2024-03-04T09:42:34.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/894: write d1/d44/d81/d96/d20/d76/d6c/d7b/f116 [94669,33764] 0 2024-03-04T09:42:35.290 INFO:tasks.workunit.client.0.smithi046.stdout:7/970: rename d0/d2d/d85/lc9 to d0/d4/d40/l155 0 2024-03-04T09:42:35.435 INFO:tasks.workunit.client.0.smithi046.stdout:0/981: dwrite d10/d12/d52/d78/f32 [0,4194304] 0 2024-03-04T09:42:35.435 INFO:tasks.workunit.client.0.smithi046.stdout:0/982: fdatasync d10/f20 0 2024-03-04T09:42:37.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/782: rename d1/d92/d96/ce2 to d1/d28/d6f/cfa 0 2024-03-04T09:42:37.643 INFO:tasks.workunit.client.0.smithi046.stdout:0/983: creat d10/d12/d6e/f159 x:0 0 0 2024-03-04T09:42:37.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/984: dwrite d10/d12/d9f/ff1 [0,4194304] 0 2024-03-04T09:42:37.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/985: readlink d10/d12/d1f/d3b/d6b/l14d 0 2024-03-04T09:42:37.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/783: symlink d1/d28/d6f/da6/df2/lfb 0 2024-03-04T09:42:38.272 INFO:tasks.workunit.client.0.smithi046.stdout:0/986: mknod d10/dd5/d14f/c15a 0 2024-03-04T09:42:38.272 INFO:tasks.workunit.client.0.smithi046.stdout:0/987: chown d10/d12/d6e/f159 21224319 1 2024-03-04T09:42:38.467 INFO:tasks.workunit.client.0.smithi046.stdout:1/784: mkdir d1/d28/d6f/dbe/dfc 0 2024-03-04T09:42:38.923 INFO:tasks.workunit.client.0.smithi046.stdout:5/895: write d1/d44/d81/d96/d20/d76/d6c/db2/fd2 [921775,42056] 0 2024-03-04T09:42:38.945 INFO:tasks.workunit.client.0.smithi046.stdout:5/896: dread d1/d44/d81/d96/d20/d5e/f74 [0,4194304] 0 2024-03-04T09:42:39.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/988: symlink d10/d12/d1f/d3b/def/l15b 0 2024-03-04T09:42:39.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/785: rename d1/d28/fa3 to d1/d28/d6f/db1/df9/ffd 0 2024-03-04T09:42:39.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/786: creat d1/d28/d6f/db7/dba/ffe x:0 0 0 2024-03-04T09:42:39.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/897: mkdir d1/d44/d57/d119 0 2024-03-04T09:42:39.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/787: dwrite d1/d28/d6f/f80 [0,4194304] 0 2024-03-04T09:42:39.822 INFO:tasks.workunit.client.0.smithi046.stdout:0/989: dread d10/d12/d6e/d99/f154 [0,4194304] 0 2024-03-04T09:42:39.839 INFO:tasks.workunit.client.0.smithi046.stdout:1/788: write d1/d28/d6f/f80 [688362,6391] 0 2024-03-04T09:42:39.862 INFO:tasks.workunit.client.0.smithi046.stdout:1/789: dread d1/fe [0,4194304] 0 2024-03-04T09:42:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:0/990: dwrite d10/d12/f1c [0,4194304] 0 2024-03-04T09:42:40.097 INFO:tasks.workunit.client.0.smithi046.stdout:5/898: chown d1/d44/d57/d70/cc6 4650 1 2024-03-04T09:42:40.097 INFO:tasks.workunit.client.0.smithi046.stdout:5/899: creat d1/d44/d69/f11a x:0 0 0 2024-03-04T09:42:40.334 INFO:tasks.workunit.client.0.smithi046.stdout:8/975: sync 2024-03-04T09:42:40.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/991: symlink d10/d12/d52/d5d/l15c 0 2024-03-04T09:42:40.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/992: write d10/d12/d52/d78/df7/f136 [637277,73325] 0 2024-03-04T09:42:40.394 INFO:tasks.workunit.client.0.smithi046.stdout:0/993: write d10/d36/d87/ff0 [322367,124134] 0 2024-03-04T09:42:40.394 INFO:tasks.workunit.client.0.smithi046.stdout:0/994: stat d10/d12/d1f/d3f/d7e/c113 0 2024-03-04T09:42:40.779 INFO:tasks.workunit.client.0.smithi046.stdout:7/971: dwrite d0/d4/db/f2b [0,4194304] 0 2024-03-04T09:42:40.779 INFO:tasks.workunit.client.0.smithi046.stdout:7/972: truncate d0/d4/db/d38/d94/f13b 985626 0 2024-03-04T09:42:40.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/790: link d1/d28/la8 d1/d92/lff 0 2024-03-04T09:42:40.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/976: dread - d7/de/d28/dab/d2c/feb zero size 2024-03-04T09:42:40.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/977: write d7/de/d28/dab/dc1/dfc/f119 [866709,74736] 0 2024-03-04T09:42:41.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/973: symlink d0/da/d41/l156 0 2024-03-04T09:42:41.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/974: chown d0/da/d46/f11b 52 1 2024-03-04T09:42:41.813 INFO:tasks.workunit.client.0.smithi046.stdout:1/791: creat d1/d28/d6f/db1/df9/f100 x:0 0 0 2024-03-04T09:42:42.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/900: rename d1/d44/d81/d96/d20/d76/d6c/db2/cab to d1/d44/d57/dc7/c11b 0 2024-03-04T09:42:42.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/901: readlink d1/d44/d81/d96/d20/d76/d6c/db2/lce 0 2024-03-04T09:42:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:1/792: stat d1/f91 0 2024-03-04T09:42:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/975: rename d0/da/d4e/l6f to d0/d3c/l157 0 2024-03-04T09:42:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/976: getdents d0/d3c/d134 0 2024-03-04T09:42:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/977: fsync d0/d4/db/d38/fc7 0 2024-03-04T09:42:42.553 INFO:tasks.workunit.client.0.smithi046.stdout:5/902: symlink d1/d44/d81/d96/d9a/l11c 0 2024-03-04T09:42:42.566 INFO:tasks.workunit.client.0.smithi046.stdout:7/978: dwrite d0/d4/db/d12/dc1/f93 [0,4194304] 0 2024-03-04T09:42:42.880 INFO:tasks.workunit.client.0.smithi046.stdout:8/978: creat d7/de/d4c/f141 x:0 0 0 2024-03-04T09:42:43.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/793: creat d1/d92/f101 x:0 0 0 2024-03-04T09:42:43.243 INFO:tasks.workunit.client.0.smithi046.stdout:7/979: getdents d0/da 0 2024-03-04T09:42:43.243 INFO:tasks.workunit.client.0.smithi046.stdout:7/980: truncate d0/d4/db/fc2 181659 0 2024-03-04T09:42:43.268 INFO:tasks.workunit.client.0.smithi046.stdout:7/981: dread d0/f16 [0,4194304] 0 2024-03-04T09:42:43.268 INFO:tasks.workunit.client.0.smithi046.stdout:7/982: dread - d0/d58/ffd zero size 2024-03-04T09:42:43.268 INFO:tasks.workunit.client.0.smithi046.stdout:7/983: fdatasync d0/d2d/f116 0 2024-03-04T09:42:43.327 INFO:tasks.workunit.client.0.smithi046.stdout:7/984: dwrite d0/d4/db/d38/d7e/dc5/ff5 [0,4194304] 0 2024-03-04T09:42:43.358 INFO:tasks.workunit.client.0.smithi046.stdout:8/979: mkdir d7/de/d28/d71/d142 0 2024-03-04T09:42:43.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/985: dwrite d0/d4/d40/f105 [0,4194304] 0 2024-03-04T09:42:43.495 INFO:tasks.workunit.client.0.smithi046.stdout:1/794: creat d1/d92/d96/da7/f102 x:0 0 0 2024-03-04T09:42:43.495 INFO:tasks.workunit.client.0.smithi046.stdout:1/795: write d1/d28/d6f/db7/fc1 [1001653,74066] 0 2024-03-04T09:42:43.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/980: mknod d7/de/d28/dab/d2c/d11a/c143 0 2024-03-04T09:42:43.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/981: truncate d7/d53/d72/f129 127053 0 2024-03-04T09:42:44.005 INFO:tasks.workunit.client.0.smithi046.stdout:0/995: dwrite d10/d12/d1f/d3f/d4b/f7f [4194304,4194304] 0 2024-03-04T09:42:44.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/986: symlink d0/d4/db/d38/d7e/dc5/d14a/l158 0 2024-03-04T09:42:44.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/796: creat d1/d28/d6f/db7/f103 x:0 0 0 2024-03-04T09:42:44.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/982: mknod d7/de/d4c/d50/d110/c144 0 2024-03-04T09:42:44.928 INFO:tasks.workunit.client.0.smithi046.stdout:0/996: creat d10/d12/d52/d78/d8a/da2/d123/f15d x:0 0 0 2024-03-04T09:42:45.920 INFO:tasks.workunit.client.0.smithi046.stdout:0/997: mkdir d10/d12/d52/d78/d8a/da2/dc8/d15e 0 2024-03-04T09:42:45.937 INFO:tasks.workunit.client.0.smithi046.stdout:0/998: dread d10/d12/d52/d78/df7/f136 [0,4194304] 0 2024-03-04T09:42:46.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/903: rename d1/d44/d69/dcd/df1 to d1/d44/d81/d96/d20/d11d 0 2024-03-04T09:42:46.730 INFO:tasks.workunit.client.0.smithi046.stdout:8/983: dwrite d7/de/d28/dab/d2c/f31 [4194304,4194304] 0 2024-03-04T09:42:46.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/904: dread d1/d44/d81/d96/d20/d76/d6c/d7b/f3d [0,4194304] 0 2024-03-04T09:42:47.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/797: symlink d1/d92/l104 0 2024-03-04T09:42:47.294 INFO:tasks.workunit.client.0.smithi046.stdout:8/984: creat d7/de/d28/dab/d2c/d64/f145 x:0 0 0 2024-03-04T09:42:47.294 INFO:tasks.workunit.client.0.smithi046.stdout:8/985: stat d7/de/f4a 0 2024-03-04T09:42:47.490 INFO:tasks.workunit.client.0.smithi046.stdout:0/999: rename d10/d12/d52/d78/d8a/da2 to d10/d12/d11e/d14e/d15f 0 2024-03-04T09:42:47.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/905: mknod d1/d44/d57/d70/d86/c11e 0 2024-03-04T09:42:47.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/906: readlink d1/d44/d69/l73 0 2024-03-04T09:42:47.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/907: write d1/d44/d81/d96/f10c [954791,96655] 0 2024-03-04T09:42:47.835 INFO:tasks.workunit.client.0.smithi046.stdout:1/798: getdents d1 0 2024-03-04T09:42:47.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/908: write d1/d44/d81/d96/d20/f3b [3861782,110322] 0 2024-03-04T09:42:47.899 INFO:tasks.workunit.client.0.smithi046.stdout:5/909: write d1/d44/d81/d96/d20/d76/fa3 [2347909,91788] 0 2024-03-04T09:42:48.200 INFO:tasks.workunit.client.0.smithi046.stdout:1/799: creat d1/d28/f105 x:0 0 0 2024-03-04T09:42:48.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/987: sync 2024-03-04T09:42:48.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/986: sync 2024-03-04T09:42:48.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/910: rename d1/d44/d57/dc7/c11b to d1/d44/d81/d8e/d72/c11f 0 2024-03-04T09:42:48.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/987: stat d7/de/d28/d3a/d6f/dd0 0 2024-03-04T09:42:48.273 INFO:tasks.workunit.client.0.smithi046.stdout:1/800: dwrite d1/d28/d6a/fca [0,4194304] 0 2024-03-04T09:42:48.291 INFO:tasks.workunit.client.0.smithi046.stdout:1/801: dread d1/d28/f30 [0,4194304] 0 2024-03-04T09:42:48.416 INFO:tasks.workunit.client.0.smithi046.stdout:7/988: symlink d0/d4/db/d38/d94/l159 0 2024-03-04T09:42:48.416 INFO:tasks.workunit.client.0.smithi046.stdout:7/989: read d0/da/d46/f10b [25150,124179] 0 2024-03-04T09:42:48.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/988: getdents d7/d53/d72 0 2024-03-04T09:42:48.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/911: rename d1/d44/d81/d96/f4c to d1/d44/d57/d70/d86/def/f120 0 2024-03-04T09:42:48.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/912: write d1/d44/d57/d70/d86/d92/fa7 [2687910,78275] 0 2024-03-04T09:42:48.860 INFO:tasks.workunit.client.0.smithi046.stdout:1/802: creat d1/d28/f106 x:0 0 0 2024-03-04T09:42:48.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/990: creat d0/da/d46/d99/de2/db1/dc8/f15a x:0 0 0 2024-03-04T09:42:48.861 INFO:tasks.workunit.client.0.smithi046.stdout:7/991: dread - d0/d4/db/dc4/f147 zero size 2024-03-04T09:42:48.872 INFO:tasks.workunit.client.0.smithi046.stdout:8/989: creat d7/de/d4c/d50/f146 x:0 0 0 2024-03-04T09:42:48.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/990: write d7/de/d28/dab/dc1/fdf [2926710,42827] 0 2024-03-04T09:42:49.179 INFO:tasks.workunit.client.0.smithi046.stdout:1/803: mkdir d1/d92/d96/d107 0 2024-03-04T09:42:49.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/804: dread d1/fe [0,4194304] 0 2024-03-04T09:42:49.474 INFO:tasks.workunit.client.0.smithi046.stdout:7/992: creat d0/d4/db/d38/d94/d113/f15b x:0 0 0 2024-03-04T09:42:49.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/991: symlink d7/de/d28/d3a/d6f/d84/l147 0 2024-03-04T09:42:50.086 INFO:tasks.workunit.client.0.smithi046.stdout:8/992: dwrite d7/de/d28/dab/f88 [0,4194304] 0 2024-03-04T09:42:50.086 INFO:tasks.workunit.client.0.smithi046.stdout:8/993: write d7/d53/d72/f13e [1021390,19540] 0 2024-03-04T09:42:50.659 INFO:tasks.workunit.client.0.smithi046.stdout:8/994: creat d7/de/d4c/d50/d110/f148 x:0 0 0 2024-03-04T09:42:50.853 INFO:tasks.workunit.client.0.smithi046.stdout:8/995: rmdir d7/de/d4c/d50/dff 39 2024-03-04T09:42:51.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/993: dwrite d0/da/d46/ff2 [0,4194304] 0 2024-03-04T09:42:51.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/994: chown d0/da/d46/d99/de2/db1/dc8/d120 1976411 1 2024-03-04T09:42:51.152 INFO:tasks.workunit.client.0.smithi046.stdout:1/805: dwrite d1/d28/f7f [0,4194304] 0 2024-03-04T09:42:51.255 INFO:tasks.workunit.client.0.smithi046.stdout:5/913: rename d1/d44/d81/d96/d54 to d1/d44/d81/d96/d20/d76/d6c/db2/d8a/d121 0 2024-03-04T09:42:51.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/996: creat d7/de/d28/dab/d2c/d62/ddb/f149 x:0 0 0 2024-03-04T09:42:51.256 INFO:tasks.workunit.client.0.smithi046.stdout:5/914: chown d1/d44/d57/d70/d86/def/f120 46258148 1 2024-03-04T09:42:51.507 INFO:tasks.workunit.client.0.smithi046.stdout:8/997: truncate d7/de/d28/dab/d3c/fb1 2031692 0 2024-03-04T09:42:51.507 INFO:tasks.workunit.client.0.smithi046.stdout:1/806: creat d1/d28/d6f/da6/df2/f108 x:0 0 0 2024-03-04T09:42:51.508 INFO:tasks.workunit.client.0.smithi046.stdout:8/998: write d7/de/d28/dab/d2c/d64/db8/d11f/f12a [854862,123193] 0 2024-03-04T09:42:51.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/915: creat d1/d44/d81/d8e/dd3/f122 x:0 0 0 2024-03-04T09:42:51.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/916: truncate d1/d44/d57/d70/d86/d92/dbb/f112 779776 0 2024-03-04T09:42:51.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/917: truncate d1/d44/d81/d96/d4f/d8f/f90 1410193 0 2024-03-04T09:42:51.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/807: creat d1/d92/d96/f109 x:0 0 0 2024-03-04T09:42:51.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/995: rmdir d0/d3c 39 2024-03-04T09:42:51.920 INFO:tasks.workunit.client.0.smithi046.stdout:7/996: write d0/fd8 [462943,42017] 0 2024-03-04T09:42:52.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/997: dwrite d0/da/d46/d99/de2/fdd [0,4194304] 0 2024-03-04T09:42:52.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/998: fsync d0/d4/d6e/fb6 0 2024-03-04T09:42:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:1/808: mkdir d1/d92/d96/dbb/d10a 0 2024-03-04T09:42:52.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/999: truncate d7/de/d28/d3a/d6f/dd0/fe2 493045 0 2024-03-04T09:42:52.826 INFO:tasks.workunit.client.0.smithi046.stdout:7/999: mknod d0/d4/db/d38/d7e/dc5/c15c 0 2024-03-04T09:42:52.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/809: getdents d1/d28/d6f/db7/dba 0 2024-03-04T09:42:53.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/918: sync 2024-03-04T09:42:53.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/810: creat d1/f10b x:0 0 0 2024-03-04T09:42:53.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/919: symlink d1/d44/d57/d70/d86/d92/dbb/l123 0 2024-03-04T09:42:53.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:42:53.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/811: creat d1/d92/d96/d107/f10c x:0 0 0 2024-03-04T09:42:53.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/812: fsync d1/fe 0 2024-03-04T09:42:53.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:42:53.896 INFO:tasks.workunit.client.0.smithi046.stdout:5/920: truncate d1/d44/d81/d96/f49 1078702 0 2024-03-04T09:42:53.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/813: rename d1/d28/f6e to d1/d92/d96/f10d 0 2024-03-04T09:42:54.402 INFO:tasks.workunit.client.0.smithi046.stdout:5/921: symlink d1/d44/d81/l124 0 2024-03-04T09:42:54.402 INFO:tasks.workunit.client.0.smithi046.stdout:5/922: readlink d1/d44/d81/d96/d20/d76/dfb/l110 0 2024-03-04T09:42:54.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/814: mknod d1/d92/d9a/c10e 0 2024-03-04T09:42:54.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/815: chown d1/d28/d6f/da6/fb4 0 1 2024-03-04T09:42:54.445 INFO:tasks.workunit.client.0.smithi046.stdout:5/923: dwrite d1/d44/d81/d96/d20/d76/d6c/dd1/fe8 [0,4194304] 0 2024-03-04T09:42:54.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/924: read d1/d44/d57/d70/fd5 [840230,106019] 0 2024-03-04T09:42:55.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/925: read d1/d44/d81/d96/d20/f42 [748893,119410] 0 2024-03-04T09:42:55.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/926: creat d1/d44/d81/d96/d20/d76/d6c/ddf/f125 x:0 0 0 2024-03-04T09:42:55.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/927: creat d1/d44/d81/d96/d9a/f126 x:0 0 0 2024-03-04T09:42:56.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/816: unlink d1/l59 0 2024-03-04T09:42:56.255 INFO:tasks.workunit.client.0.smithi046.stdout:5/928: write d1/d44/d81/d8e/dd3/fcc [1204936,33307] 0 2024-03-04T09:42:56.333 INFO:tasks.workunit.client.0.smithi046.stdout:1/817: symlink d1/d28/d8d/l10f 0 2024-03-04T09:42:56.538 INFO:tasks.workunit.client.0.smithi046.stdout:5/929: mkdir d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d127 0 2024-03-04T09:42:56.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/930: rename d1/d44/d57/dc7/de7/fd9 to d1/d44/d69/f128 0 2024-03-04T09:42:56.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/931: write d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/ff3 [153788,125544] 0 2024-03-04T09:42:56.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/932: chown d1/d44/d81/d96/d20/d76/d6c/ff8 905018 1 2024-03-04T09:42:56.953 INFO:tasks.workunit.client.0.smithi046.stdout:1/818: sync 2024-03-04T09:42:57.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/933: creat d1/d44/d81/d8e/f129 x:0 0 0 2024-03-04T09:42:57.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/819: symlink d1/d28/d6f/db1/df9/l110 0 2024-03-04T09:42:57.214 INFO:tasks.workunit.client.0.smithi046.stdout:5/934: unlink c0 0 2024-03-04T09:42:57.215 INFO:tasks.workunit.client.0.smithi046.stdout:5/935: chown d1/d44/d81/d96/d20/d76/d6c/dd1/ce6 7445669 1 2024-03-04T09:42:57.321 INFO:tasks.workunit.client.0.smithi046.stdout:1/820: readlink d1/d28/l5d 0 2024-03-04T09:42:57.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/936: link d1/d44/d81/d96/d20/d76/d6c/d7b/f3d d1/d44/d81/d96/d20/d76/d6c/dda/f12a 0 2024-03-04T09:42:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:1/821: symlink d1/d28/d6f/d74/l111 0 2024-03-04T09:42:57.440 INFO:tasks.workunit.client.0.smithi046.stdout:1/822: dwrite d1/d28/f106 [0,4194304] 0 2024-03-04T09:42:57.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/823: write d1/d28/d6f/dbe/fc6 [526645,70543] 0 2024-03-04T09:42:57.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/937: mkdir d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d12b 0 2024-03-04T09:42:57.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/824: getdents d1/d92 0 2024-03-04T09:42:57.755 INFO:tasks.workunit.client.0.smithi046.stdout:1/825: rename d1/l26 to d1/d92/d96/dbb/l112 0 2024-03-04T09:42:57.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/826: chown d1/d92/d96/dbb/d10a 107 1 2024-03-04T09:42:57.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/827: dread - d1/d92/d96/da7/f102 zero size 2024-03-04T09:42:57.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/828: chown d1/d92/d96 13 1 2024-03-04T09:42:58.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/829: mknod d1/d28/d8d/c113 0 2024-03-04T09:42:58.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/938: dwrite d1/d44/d81/d96/d9a/da0/f113 [0,4194304] 0 2024-03-04T09:42:58.460 INFO:tasks.workunit.client.0.smithi046.stdout:1/830: mkdir d1/d92/d96/da7/d114 0 2024-03-04T09:42:58.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/939: creat d1/d44/d81/d96/d20/d76/d6c/f12c x:0 0 0 2024-03-04T09:42:58.460 INFO:tasks.workunit.client.0.smithi046.stdout:1/831: write d1/d28/d6f/db1/fbc [895176,117144] 0 2024-03-04T09:42:58.810 INFO:tasks.workunit.client.0.smithi046.stdout:5/940: mknod d1/d44/d81/d96/d20/d76/d6c/ddf/c12d 0 2024-03-04T09:42:58.811 INFO:tasks.workunit.client.0.smithi046.stdout:1/832: link d1/d28/d8d/c113 d1/d92/df3/c115 0 2024-03-04T09:42:58.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/941: dwrite d1/d44/d57/d70/d86/d92/ffc [0,4194304] 0 2024-03-04T09:42:58.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/833: dread d1/d28/d6a/f90 [0,4194304] 0 2024-03-04T09:42:58.956 INFO:tasks.workunit.client.0.smithi046.stdout:5/942: dwrite d1/d44/d69/fbf [0,4194304] 0 2024-03-04T09:42:58.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/943: write d1/d44/d81/d96/d9a/da0/f113 [3391257,120704] 0 2024-03-04T09:42:59.024 INFO:tasks.workunit.client.0.smithi046.stdout:1/834: dwrite d1/d28/f47 [0,4194304] 0 2024-03-04T09:42:59.024 INFO:tasks.workunit.client.0.smithi046.stdout:1/835: creat d1/d28/d6f/d74/f116 x:0 0 0 2024-03-04T09:42:59.051 INFO:tasks.workunit.client.0.smithi046.stdout:1/836: write d1/f24 [1120792,45728] 0 2024-03-04T09:42:59.341 INFO:tasks.workunit.client.0.smithi046.stdout:5/944: mknod d1/d44/d81/d96/d20/d76/d6c/ddf/c12e 0 2024-03-04T09:43:00.204 INFO:tasks.workunit.client.0.smithi046.stdout:5/945: rmdir d1/d44/d81/d96/d20/d76/d6c/db2/dcb 39 2024-03-04T09:43:00.631 INFO:tasks.workunit.client.0.smithi046.stdout:5/946: creat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f12f x:0 0 0 2024-03-04T09:43:01.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/947: creat d1/d44/d81/d96/d20/d76/d6c/db2/f130 x:0 0 0 2024-03-04T09:43:01.017 INFO:tasks.workunit.client.0.smithi046.stdout:1/837: write d1/d28/d6f/db1/ff4 [73913,52932] 0 2024-03-04T09:43:01.017 INFO:tasks.workunit.client.0.smithi046.stdout:1/838: chown d1/d28/d6f/c72 1526 1 2024-03-04T09:43:01.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/839: mknod d1/d28/d6f/db7/c117 0 2024-03-04T09:43:01.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/948: rmdir d1/d44/d81/d96/d20/d76/d6c 39 2024-03-04T09:43:01.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/840: mkdir d1/d92/df3/d118 0 2024-03-04T09:43:01.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/841: chown d1/d28/d6f/dbe/dcc/lec 108 1 2024-03-04T09:43:01.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/842: chown d1/d28/f7a 0 1 2024-03-04T09:43:01.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/843: truncate d1/d92/d96/f109 798657 0 2024-03-04T09:43:01.701 INFO:tasks.workunit.client.0.smithi046.stdout:5/949: creat d1/d44/d57/d70/d86/f131 x:0 0 0 2024-03-04T09:43:01.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/844: mkdir d1/d28/d119 0 2024-03-04T09:43:01.972 INFO:tasks.workunit.client.0.smithi046.stdout:1/845: symlink d1/d28/d8d/l11a 0 2024-03-04T09:43:02.023 INFO:tasks.workunit.client.0.smithi046.stdout:1/846: creat d1/d28/d6a/f11b x:0 0 0 2024-03-04T09:43:02.023 INFO:tasks.workunit.client.0.smithi046.stdout:1/847: fsync d1/f2b 0 2024-03-04T09:43:02.059 INFO:tasks.workunit.client.0.smithi046.stdout:1/848: read d1/d92/f9b [8388561,94023] 0 2024-03-04T09:43:02.287 INFO:tasks.workunit.client.0.smithi046.stdout:5/950: write d1/d44/d81/d96/d20/d76/d6c/db2/f64 [4093346,57700] 0 2024-03-04T09:43:02.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/849: creat d1/d92/df3/d118/f11c x:0 0 0 2024-03-04T09:43:02.299 INFO:tasks.workunit.client.0.smithi046.stdout:1/850: write d1/d28/d6f/fa2 [2308139,29906] 0 2024-03-04T09:43:02.299 INFO:tasks.workunit.client.0.smithi046.stdout:1/851: truncate d1/fd2 1501971 0 2024-03-04T09:43:02.651 INFO:tasks.workunit.client.0.smithi046.stdout:1/852: creat d1/d92/f11d x:0 0 0 2024-03-04T09:43:02.651 INFO:tasks.workunit.client.0.smithi046.stdout:5/951: creat d1/d44/d57/dc7/de7/f132 x:0 0 0 2024-03-04T09:43:02.904 INFO:tasks.workunit.client.0.smithi046.stdout:1/853: rmdir d1/d28/d6f 39 2024-03-04T09:43:03.109 INFO:tasks.workunit.client.0.smithi046.stdout:1/854: truncate d1/f54 513383 0 2024-03-04T09:43:03.109 INFO:tasks.workunit.client.0.smithi046.stdout:5/952: rename d1/d44/d81/d96/d20/d76/d6c/db2/d8a to d1/d44/d57/d70/d133 0 2024-03-04T09:43:03.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/855: creat d1/d28/f11e x:0 0 0 2024-03-04T09:43:03.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/856: dread d1/f61 [0,4194304] 0 2024-03-04T09:43:03.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/857: chown d1/d92/d96/lc5 5811 1 2024-03-04T09:43:03.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/858: fsync d1/fe0 0 2024-03-04T09:43:03.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/953: symlink d1/d44/d81/d96/d20/l134 0 2024-03-04T09:43:03.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/954: write d1/d44/d57/d70/d86/d92/fa7 [3541963,36873] 0 2024-03-04T09:43:03.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/859: creat d1/f11f x:0 0 0 2024-03-04T09:43:03.314 INFO:tasks.workunit.client.0.smithi046.stdout:1/860: chown d1/f1d 960 1 2024-03-04T09:43:03.323 INFO:tasks.workunit.client.0.smithi046.stdout:5/955: dread d1/d44/d81/fb5 [0,4194304] 0 2024-03-04T09:43:03.422 INFO:tasks.workunit.client.0.smithi046.stdout:5/956: dread d1/f5 [0,4194304] 0 2024-03-04T09:43:03.717 INFO:tasks.workunit.client.0.smithi046.stdout:1/861: dwrite d1/d28/d6f/db1/df9/ffd [0,4194304] 0 2024-03-04T09:43:03.764 INFO:tasks.workunit.client.0.smithi046.stdout:5/957: mkdir d1/d44/d57/d70/d133/d121/d135 0 2024-03-04T09:43:04.095 INFO:tasks.workunit.client.0.smithi046.stdout:1/862: rename d1/d92/d9a to d1/d92/df3/d118/d120 0 2024-03-04T09:43:04.636 INFO:tasks.workunit.client.0.smithi046.stdout:5/958: rename d1/d44/d81/d96/d20/d76/dfb/fff to d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d12b/f136 0 2024-03-04T09:43:04.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/863: dread d1/d92/d96/da7/fdb [0,4194304] 0 2024-03-04T09:43:04.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/864: dwrite d1/d28/d6f/db1/fbc [0,4194304] 0 2024-03-04T09:43:05.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/865: truncate d1/d92/df3/d118/d120/fc7 1225150 0 2024-03-04T09:43:05.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/866: dread - d1/d28/d6a/fe6 zero size 2024-03-04T09:43:05.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/867: fsync d1/fd 0 2024-03-04T09:43:05.768 INFO:tasks.workunit.client.0.smithi046.stdout:1/868: truncate d1/f61 2132679 0 2024-03-04T09:43:05.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/869: chown d1/d28/d6a/fe6 8867 1 2024-03-04T09:43:05.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/870: fsync d1/d92/d96/da7/f102 0 2024-03-04T09:43:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/959: dwrite d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/ff3 [0,4194304] 0 2024-03-04T09:43:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:5/960: fsync d1/d44/d81/d96/d20/d76/d6c/fc0 0 2024-03-04T09:43:06.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/961: rename d1/d44/d57/dc7/de7/f132 to d1/d44/d81/d96/d20/d5e/f137 0 2024-03-04T09:43:06.681 INFO:tasks.workunit.client.0.smithi046.stdout:1/871: mknod d1/c121 0 2024-03-04T09:43:06.718 INFO:tasks.workunit.client.0.smithi046.stdout:1/872: dread d1/d28/d6a/fca [0,4194304] 0 2024-03-04T09:43:06.776 INFO:tasks.workunit.client.0.smithi046.stdout:5/962: symlink d1/d44/d57/l138 0 2024-03-04T09:43:06.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/873: creat d1/d28/d6f/dbe/dcc/f122 x:0 0 0 2024-03-04T09:43:06.936 INFO:tasks.workunit.client.0.smithi046.stdout:5/963: link d1/d44/d81/d96/d20/d76/d6c/dda/l114 d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/l139 0 2024-03-04T09:43:07.249 INFO:tasks.workunit.client.0.smithi046.stdout:1/874: mkdir d1/d28/d6f/db1/d123 0 2024-03-04T09:43:07.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/875: link d1/d28/d6a/l85 d1/d92/d96/dbb/d10a/l124 0 2024-03-04T09:43:07.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/876: write d1/d28/d6f/db7/dba/fd6 [539622,54831] 0 2024-03-04T09:43:07.543 INFO:tasks.workunit.client.0.smithi046.stdout:1/877: dread - d1/d28/d6f/d74/f88 zero size 2024-03-04T09:43:07.778 INFO:tasks.workunit.client.0.smithi046.stdout:5/964: dwrite d1/d44/d81/d96/f49 [0,4194304] 0 2024-03-04T09:43:07.833 INFO:tasks.workunit.client.0.smithi046.stdout:1/878: symlink d1/l125 0 2024-03-04T09:43:07.833 INFO:tasks.workunit.client.0.smithi046.stdout:1/879: fdatasync d1/f23 0 2024-03-04T09:43:07.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/965: dread - d1/d44/d57/d70/d133/d121/f109 zero size 2024-03-04T09:43:08.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/966: dwrite d1/d44/d81/d96/d20/d76/d6c/f12c [0,4194304] 0 2024-03-04T09:43:08.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/967: dwrite d1/d44/d69/f89 [0,4194304] 0 2024-03-04T09:43:08.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/880: unlink d1/d28/d6f/db1/fbc 0 2024-03-04T09:43:08.280 INFO:tasks.workunit.client.0.smithi046.stdout:5/968: unlink d1/d44/d81/d96/d4f/d8f/fe9 0 2024-03-04T09:43:08.280 INFO:tasks.workunit.client.0.smithi046.stdout:5/969: chown d1/d44/d81/d96/d4f 1372875 1 2024-03-04T09:43:08.423 INFO:tasks.workunit.client.0.smithi046.stdout:1/881: rmdir d1 39 2024-03-04T09:43:08.488 INFO:tasks.workunit.client.0.smithi046.stdout:1/882: dwrite d1/fe0 [0,4194304] 0 2024-03-04T09:43:08.488 INFO:tasks.workunit.client.0.smithi046.stdout:1/883: chown d1/d92/d96/da7/lb0 206531 1 2024-03-04T09:43:08.796 INFO:tasks.workunit.client.0.smithi046.stdout:5/970: link d1/d44/d81/d8e/l93 d1/d44/d57/d70/d86/d92/dbb/l13a 0 2024-03-04T09:43:09.065 INFO:tasks.workunit.client.0.smithi046.stdout:1/884: getdents d1/d28/d6f/db7 0 2024-03-04T09:43:09.066 INFO:tasks.workunit.client.0.smithi046.stdout:1/885: chown d1/d28/f4e 1723096 1 2024-03-04T09:43:09.346 INFO:tasks.workunit.client.0.smithi046.stdout:5/971: dwrite d1/d44/d81/d96/d20/fb9 [0,4194304] 0 2024-03-04T09:43:09.347 INFO:tasks.workunit.client.0.smithi046.stdout:5/972: stat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d12b 0 2024-03-04T09:43:09.629 INFO:tasks.workunit.client.0.smithi046.stdout:5/973: mknod d1/d44/d57/d70/d86/d92/c13b 0 2024-03-04T09:43:09.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/974: link d1/d44/d81/d96/d20/c9c d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d127/c13c 0 2024-03-04T09:43:10.101 INFO:tasks.workunit.client.0.smithi046.stdout:5/975: mkdir d1/d44/d81/d96/d9a/d13d 0 2024-03-04T09:43:10.273 INFO:tasks.workunit.client.0.smithi046.stdout:5/976: truncate d1/d44/d81/d96/d20/d76/d6c/db2/f64 1935132 0 2024-03-04T09:43:10.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/977: rename d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d12b to d1/d44/d57/d119/d13e 0 2024-03-04T09:43:10.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/886: mknod d1/d92/c126 0 2024-03-04T09:43:10.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/887: dread - d1/d28/d6f/db7/dba/fda zero size 2024-03-04T09:43:11.029 INFO:tasks.workunit.client.0.smithi046.stdout:1/888: dwrite d1/d28/f40 [0,4194304] 0 2024-03-04T09:43:11.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/978: mknod d1/d44/d57/d70/c13f 0 2024-03-04T09:43:11.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/889: creat d1/d28/d6f/da6/f127 x:0 0 0 2024-03-04T09:43:11.279 INFO:tasks.workunit.client.0.smithi046.stdout:5/979: dread d1/d44/d81/f91 [0,4194304] 0 2024-03-04T09:43:11.279 INFO:tasks.workunit.client.0.smithi046.stdout:5/980: read d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/fc [4675228,34974] 0 2024-03-04T09:43:11.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/890: creat d1/d28/d6f/db7/dba/f128 x:0 0 0 2024-03-04T09:43:11.357 INFO:tasks.workunit.client.0.smithi046.stdout:5/981: mknod d1/d44/d81/d96/d20/d76/d6c/dd1/c140 0 2024-03-04T09:43:11.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/891: dread - d1/d28/d6a/fe6 zero size 2024-03-04T09:43:11.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/892: chown d1/d92/d96/fc0 3495418 1 2024-03-04T09:43:11.373 INFO:tasks.workunit.client.0.smithi046.stdout:5/982: dread d1/d44/d81/d96/f10c [0,4194304] 0 2024-03-04T09:43:11.484 INFO:tasks.workunit.client.0.smithi046.stdout:5/983: creat d1/d44/d81/d96/d20/d76/d6c/dda/f141 x:0 0 0 2024-03-04T09:43:11.484 INFO:tasks.workunit.client.0.smithi046.stdout:5/984: truncate d1/d44/d81/d96/f49 4544743 0 2024-03-04T09:43:11.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/893: mkdir d1/d28/d129 0 2024-03-04T09:43:11.605 INFO:tasks.workunit.client.0.smithi046.stdout:5/985: rename d1/d44/d81/d8e/dd3/cd7 to d1/d44/d81/d96/d20/d76/d6c/db2/c142 0 2024-03-04T09:43:11.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/894: symlink d1/d92/df3/d118/l12a 0 2024-03-04T09:43:11.674 INFO:tasks.workunit.client.0.smithi046.stdout:5/986: dwrite d1/d44/d81/d96/d9a/da0/f113 [0,4194304] 0 2024-03-04T09:43:11.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/987: dread d1/d44/d81/f91 [0,4194304] 0 2024-03-04T09:43:11.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/988: truncate d1/d44/d57/d70/d133/d121/f109 700177 0 2024-03-04T09:43:11.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/895: rename d1/d28/d6f/db1/df9/l110 to d1/d28/d6f/d74/l12b 0 2024-03-04T09:43:11.778 INFO:tasks.workunit.client.0.smithi046.stdout:1/896: dwrite d1/d28/d6f/db7/fcd [0,4194304] 0 2024-03-04T09:43:11.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/989: chown d1/d44/d81/d96/d20/d76/d6c/d7b/c99 1 1 2024-03-04T09:43:11.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/990: getdents d1/d44/d81/d96/d20/d5e/dc4 0 2024-03-04T09:43:11.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/897: dwrite d1/d28/f11e [0,4194304] 0 2024-03-04T09:43:11.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/898: dread - d1/d28/d6f/db7/dba/f128 zero size 2024-03-04T09:43:11.902 INFO:tasks.workunit.client.0.smithi046.stdout:5/991: symlink d1/d44/d57/d70/d86/d92/l143 0 2024-03-04T09:43:11.902 INFO:tasks.workunit.client.0.smithi046.stdout:5/992: chown d1/d44/d57/d70/d133 167054169 1 2024-03-04T09:43:11.902 INFO:tasks.workunit.client.0.smithi046.stdout:1/899: dwrite d1/d28/f38 [0,4194304] 0 2024-03-04T09:43:11.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/900: write d1/d28/d6a/fa5 [1213930,13809] 0 2024-03-04T09:43:11.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/901: chown d1/d28/f105 567 1 2024-03-04T09:43:11.938 INFO:tasks.workunit.client.0.smithi046.stdout:1/902: dwrite d1/f7 [0,4194304] 0 2024-03-04T09:43:12.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/993: creat d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f144 x:0 0 0 2024-03-04T09:43:12.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/903: mkdir d1/d92/d96/d107/d12c 0 2024-03-04T09:43:13.636 INFO:tasks.workunit.client.0.smithi046.stdout:5/994: write d1/d44/d81/d96/d20/f42 [3457336,105492] 0 2024-03-04T09:43:13.655 INFO:tasks.workunit.client.0.smithi046.stdout:1/904: sync 2024-03-04T09:43:13.934 INFO:tasks.workunit.client.0.smithi046.stdout:5/995: rename d1/d44/d57/d70/d86/d92/dbb/lc3 to d1/d44/d69/l145 0 2024-03-04T09:43:13.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/905: creat d1/d92/df3/d118/d120/f12d x:0 0 0 2024-03-04T09:43:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:5/996: read d1/d44/d81/d8e/fac [937639,89029] 0 2024-03-04T09:43:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/997: dread d1/d44/d69/fbf [0,4194304] 0 2024-03-04T09:43:14.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/906: mkdir d1/d92/d12e 0 2024-03-04T09:43:14.072 INFO:tasks.workunit.client.0.smithi046.stdout:5/998: rename d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d3e/f66 to d1/d44/d57/d70/d86/d92/f146 0 2024-03-04T09:43:14.191 INFO:tasks.workunit.client.0.smithi046.stdout:1/907: getdents d1/d28/d6f/db1 0 2024-03-04T09:43:14.191 INFO:tasks.workunit.client.0.smithi046.stdout:1/908: truncate d1/d28/d6a/fe6 448399 0 2024-03-04T09:43:14.192 INFO:tasks.workunit.client.0.smithi046.stdout:5/999: mknod d1/d44/d81/d96/d20/d76/d6c/db2/d9b/d9d/d1f/c147 0 2024-03-04T09:43:14.227 INFO:tasks.workunit.client.0.smithi046.stdout:1/909: mkdir d1/d92/d12e/d12f 0 2024-03-04T09:43:14.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/910: creat d1/d28/d6f/db1/d123/f130 x:0 0 0 2024-03-04T09:43:14.446 INFO:tasks.workunit.client.0.smithi046.stdout:1/911: write d1/d28/d6f/db1/df9/ffd [216189,40391] 0 2024-03-04T09:43:14.447 INFO:tasks.workunit.client.0.smithi046.stdout:1/912: write d1/d92/df3/d118/f11c [796329,116727] 0 2024-03-04T09:43:14.483 INFO:tasks.workunit.client.0.smithi046.stdout:1/913: dread d1/f4d [0,4194304] 0 2024-03-04T09:43:14.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/914: chown d1/d28/d6f/caa 493078 1 2024-03-04T09:43:15.593 INFO:tasks.workunit.client.0.smithi046.stdout:1/915: symlink d1/d28/l131 0 2024-03-04T09:43:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:1/916: rename d1/d28/d6f to d1/d92/d96/da7/d114/d132 0 2024-03-04T09:43:16.147 INFO:tasks.workunit.client.0.smithi046.stdout:1/917: mknod d1/d92/d96/da7/d114/d132/dbe/dcc/c133 0 2024-03-04T09:43:16.148 INFO:tasks.workunit.client.0.smithi046.stdout:1/918: truncate d1/d92/d96/da7/f102 241084 0 2024-03-04T09:43:16.248 INFO:tasks.workunit.client.0.smithi046.stdout:1/919: getdents d1/d92/d96/da7 0 2024-03-04T09:43:16.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/920: mknod d1/d28/d8d/c134 0 2024-03-04T09:43:16.515 INFO:tasks.workunit.client.0.smithi046.stdout:1/921: unlink d1/d92/d96/f10d 0 2024-03-04T09:43:16.540 INFO:tasks.workunit.client.0.smithi046.stdout:1/922: dread d1/f79 [0,4194304] 0 2024-03-04T09:43:16.541 INFO:tasks.workunit.client.0.smithi046.stdout:1/923: truncate d1/d92/d96/da7/d114/d132/db7/dba/fd6 703553 0 2024-03-04T09:43:16.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/924: mkdir d1/d28/d119/d135 0 2024-03-04T09:43:16.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/925: dread - d1/d92/d96/da7/d114/d132/d74/f8c zero size 2024-03-04T09:43:16.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/926: rmdir d1/d92/d96/da7/d114/d132/dbe/dcc 39 2024-03-04T09:43:16.753 INFO:tasks.workunit.client.0.smithi046.stdout:1/927: truncate d1/fd 675187 0 2024-03-04T09:43:16.845 INFO:tasks.workunit.client.0.smithi046.stdout:1/928: dwrite d1/d92/d96/da7/d114/d132/f80 [0,4194304] 0 2024-03-04T09:43:16.846 INFO:tasks.workunit.client.0.smithi046.stdout:1/929: getdents d1/d28/d129 0 2024-03-04T09:43:16.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/930: mkdir d1/d92/d12e/d12f/d136 0 2024-03-04T09:43:16.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/931: mkdir d1/d92/d96/da7/d114/d132/db1/d137 0 2024-03-04T09:43:17.018 INFO:tasks.workunit.client.0.smithi046.stdout:1/932: dread d1/d92/d96/da7/fdb [0,4194304] 0 2024-03-04T09:43:17.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/933: dwrite d1/d92/d96/da7/d114/d132/dbe/dcc/f122 [0,4194304] 0 2024-03-04T09:43:17.102 INFO:tasks.workunit.client.0.smithi046.stdout:1/934: write d1/f24 [4245480,75246] 0 2024-03-04T09:43:17.275 INFO:tasks.workunit.client.0.smithi046.stdout:1/935: mknod d1/d92/d96/d107/c138 0 2024-03-04T09:43:17.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/936: getdents d1 0 2024-03-04T09:43:17.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/937: stat d1/d92/d96/da7/d114/d132/da6/f127 0 2024-03-04T09:43:17.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/938: dwrite d1/d92/d96/da7/d114/d132/fe7 [0,4194304] 0 2024-03-04T09:43:18.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/939: symlink d1/d92/d96/da7/d114/d132/d74/l139 0 2024-03-04T09:43:18.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/940: write d1/f24 [5052269,31088] 0 2024-03-04T09:43:18.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/941: mknod d1/d28/d129/c13a 0 2024-03-04T09:43:18.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/942: stat d1/d92/d96/da7/d114/d132/caa 0 2024-03-04T09:43:18.440 INFO:tasks.workunit.client.0.smithi046.stdout:1/943: mkdir d1/d92/df3/d13b 0 2024-03-04T09:43:18.440 INFO:tasks.workunit.client.0.smithi046.stdout:1/944: write d1/d92/d96/da7/d114/d132/dbe/fe4 [910476,104330] 0 2024-03-04T09:43:18.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/945: chown d1/d92/df3/d118/d120/c10e 0 1 2024-03-04T09:43:18.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/946: chown d1/d92/d96/da7/d114/d132/db7/fcd 24 1 2024-03-04T09:43:18.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/947: fdatasync d1/d92/df3/d118/f11c 0 2024-03-04T09:43:18.526 INFO:tasks.workunit.client.0.smithi046.stdout:1/948: creat d1/d92/d96/da7/d114/f13c x:0 0 0 2024-03-04T09:43:19.086 INFO:tasks.workunit.client.0.smithi046.stdout:1/949: sync 2024-03-04T09:43:19.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/950: dread d1/d92/d96/da7/fdb [0,4194304] 0 2024-03-04T09:43:19.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/951: write d1/d28/f47 [57062,58593] 0 2024-03-04T09:43:19.558 INFO:tasks.workunit.client.0.smithi046.stdout:1/952: mkdir d1/d92/d12e/d12f/d13d 0 2024-03-04T09:43:19.559 INFO:tasks.workunit.client.0.smithi046.stdout:1/953: chown d1/c3a 431519 1 2024-03-04T09:43:20.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/954: rename d1/d92/f101 to d1/d92/d96/da7/d114/d132/db7/f13e 0 2024-03-04T09:43:20.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/955: write d1/fb8 [1596417,59857] 0 2024-03-04T09:43:20.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/956: mkdir d1/d92/d96/da7/d114/d132/db7/d13f 0 2024-03-04T09:43:20.298 INFO:tasks.workunit.client.0.smithi046.stdout:1/957: unlink d1/d92/d96/da7/d114/d132/dbe/fc6 0 2024-03-04T09:43:20.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/958: rename d1/d92/d96/da7/d114/d132/c72 to d1/d28/d8d/c140 0 2024-03-04T09:43:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:1/959: read d1/d28/f30 [873867,8138] 0 2024-03-04T09:43:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:1/960: symlink d1/d92/d96/da7/d114/d132/db1/df9/l141 0 2024-03-04T09:43:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:1/961: fsync d1/f8f 0 2024-03-04T09:43:20.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/962: stat d1/d92/d96/dbb/ce3 0 2024-03-04T09:43:20.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/963: chown d1/d92/d96/da7/f102 1635060 1 2024-03-04T09:43:21.030 INFO:tasks.workunit.client.0.smithi046.stdout:1/964: sync 2024-03-04T09:43:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:1/965: mkdir d1/d92/d12e/d12f/d142 0 2024-03-04T09:43:21.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/966: write d1/d92/df3/d118/d120/fd7 [773589,5861] 0 2024-03-04T09:43:21.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/967: rename d1/d92/d96/da7/d114/d132/db7/dba/fd6 to d1/d92/d96/da7/d114/d132/da6/df2/f143 0 2024-03-04T09:43:21.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/968: dwrite d1/d28/fce [0,4194304] 0 2024-03-04T09:43:21.655 INFO:tasks.workunit.client.0.smithi046.stdout:1/969: chown d1/d28/c83 488762 1 2024-03-04T09:43:21.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/970: dread d1/d28/f7a [0,4194304] 0 2024-03-04T09:43:21.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/971: getdents d1/d92/d96/da7/d114/d132/db1/d137 0 2024-03-04T09:43:21.692 INFO:tasks.workunit.client.0.smithi046.stdout:1/972: write d1/d92/d96/da7/d114/d132/db7/f103 [926372,102893] 0 2024-03-04T09:43:21.753 INFO:tasks.workunit.client.0.smithi046.stdout:1/973: dwrite d1/d28/f7f [0,4194304] 0 2024-03-04T09:43:22.031 INFO:tasks.workunit.client.0.smithi046.stdout:1/974: sync 2024-03-04T09:43:22.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/975: mkdir d1/d92/df3/d13b/d144 0 2024-03-04T09:43:22.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/976: dwrite d1/d28/d6a/fca [0,4194304] 0 2024-03-04T09:43:22.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/977: fdatasync d1/d28/f11e 0 2024-03-04T09:43:22.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/978: getdents d1/d92/d12e/d12f/d142 0 2024-03-04T09:43:22.300 INFO:tasks.workunit.client.0.smithi046.stdout:1/979: sync 2024-03-04T09:43:22.300 INFO:tasks.workunit.client.0.smithi046.stdout:1/980: chown d1/d92/d96/da7/d114/d132/d74/fbf 0 1 2024-03-04T09:43:22.300 INFO:tasks.workunit.client.0.smithi046.stdout:1/981: read - d1/d92/d96/da7/d114/d132/db1/d123/f130 zero size 2024-03-04T09:43:22.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/982: rmdir d1 39 2024-03-04T09:43:22.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/983: write d1/d92/d96/da7/d114/d132/db1/df9/ffd [4979806,46441] 0 2024-03-04T09:43:22.475 INFO:tasks.workunit.client.0.smithi046.stdout:1/984: sync 2024-03-04T09:43:22.544 INFO:tasks.workunit.client.0.smithi046.stdout:1/985: symlink d1/d92/d96/da7/d114/l145 0 2024-03-04T09:43:22.568 INFO:tasks.workunit.client.0.smithi046.stdout:1/986: dread d1/d92/d96/da7/d114/d132/f80 [0,4194304] 0 2024-03-04T09:43:22.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/987: getdents d1/d92/df3/d118 0 2024-03-04T09:43:22.878 INFO:tasks.workunit.client.0.smithi046.stdout:1/988: rename d1/d92/c99 to d1/d28/d6a/c146 0 2024-03-04T09:43:22.878 INFO:tasks.workunit.client.0.smithi046.stdout:1/989: read - d1/d92/d96/da7/d114/d132/db7/f13e zero size 2024-03-04T09:43:22.946 INFO:tasks.workunit.client.0.smithi046.stdout:1/990: symlink d1/d92/df3/d118/l147 0 2024-03-04T09:43:23.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/991: getdents d1/d92/d96/da7/d114/d132/dbe 0 2024-03-04T09:43:23.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/992: chown d1/d28/d6a/c146 152 1 2024-03-04T09:43:23.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/993: truncate d1/d28/d6a/f11b 542689 0 2024-03-04T09:43:23.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/994: unlink d1/f2b 0 2024-03-04T09:43:23.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/995: mknod d1/d92/df3/d118/d120/c148 0 2024-03-04T09:43:23.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/996: read d1/d28/f11e [3136409,42309] 0 2024-03-04T09:43:23.422 INFO:tasks.workunit.client.0.smithi046.stdout:1/997: fdatasync d1/d28/d6a/f94 0 2024-03-04T09:43:23.423 INFO:tasks.workunit.client.0.smithi046.stdout:1/998: write d1/d92/d96/da7/d114/f13c [922867,119353] 0 2024-03-04T09:43:23.423 INFO:tasks.workunit.client.0.smithi046.stdout:1/999: chown d1/f27 294 1 2024-03-04T09:43:23.475 INFO:tasks.workunit.client.0.smithi046.stderr:+ rm -rf -- ./tmp.Is72PUMa20 2024-03-04T09:43:23.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:43:23.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:43:54.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:43:54.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:44:24.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:44:24.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:44:54.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:44:54.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:45:24.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:45:24.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:45:46.470 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:56:57.338 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.470 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:56:57.275 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.471 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:56:57.340 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.483 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:56:57.289 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.485 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:56:57.354 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.488 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:56:57.357 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.610 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:56:57.478 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.615 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:56:57.483 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:46.639 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:56:57.444 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:45:54.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:45:54.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:46:24.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:46:24.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:46:35.066 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:57:45.871 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.139 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:57:46.007 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.144 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:57:46.013 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.168 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:57:45.973 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.192 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:57:46.061 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.247 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:57:46.116 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.253 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:57:46.122 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.276 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:57:46.081 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:35.300 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:57:46.168 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:46:54.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:46:54.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:47:24.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:47:24.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:47:55.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:47:55.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:48:10.660 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:59:21.465 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.721 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:59:21.590 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.724 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:59:21.592 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.776 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:59:21.581 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.777 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:59:21.646 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.868 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:59:21.736 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.874 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:59:21.742 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.898 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:59:21.703 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:10.926 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:59:21.794 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:48:25.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:48:25.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:48:55.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:48:55.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:49:25.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:49:25.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:49:51.253 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:01:02.057 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.254 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:01:02.122 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.257 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:01:02.125 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.266 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:01:02.134 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.268 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:01:02.136 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.269 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:01:02.073 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.323 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:01:02.191 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.327 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:01:02.195 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:51.532 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:01:02.337 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:49:55.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:49:55.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:50:25.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:50:25.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:50:56.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:50:56.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:51:26.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:51:26.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:51:56.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:51:56.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:52:26.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:52:26.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:52:56.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:52:56.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:53:26.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:53:26.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:53:53.052 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:05:03.856 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.063 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:05:03.867 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.065 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:05:03.932 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.065 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:05:03.933 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.067 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:05:03.934 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.068 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:05:03.935 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.154 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:05:04.022 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.199 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:05:04.067 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:53.214 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:05:04.017 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:53:56.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:53:56.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:54:26.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:54:26.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:54:39.354 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:05:50.157 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.368 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:05:50.171 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.410 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:05:50.277 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.412 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:05:50.279 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.421 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:05:50.225 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.438 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:05:50.305 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.442 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:05:50.309 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.446 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:05:50.313 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:39.488 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:05:50.355 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:54:56.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:54:56.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:55:27.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:55:27.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:55:57.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:55:57.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:56:27.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:56:27.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:56:30.509 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:07:41.312 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.524 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:07:41.327 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.573 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:07:41.440 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.575 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:07:41.442 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.608 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:07:41.476 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.610 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:07:41.477 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.614 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:07:41.481 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.618 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:07:41.421 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:30.645 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:07:41.512 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:56:57.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:56:57.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:57:27.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:57:27.616 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:57:57.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:57:57.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:57:59.010 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:09:09.813 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.025 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:09:09.892 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.028 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:09:09.895 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.030 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:09:09.833 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.034 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:09:09.900 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.035 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:09:09.903 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.069 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:09:09.936 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.093 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:09:09.959 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T09:57:59.114 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:09:09.917 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T09:58:27.885 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:58:27.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:58:58.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:58:58.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:59:28.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:59:28.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:59:58.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T09:59:58.263 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:00:28.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:00:28.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:00:58.512 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:00:58.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:01:28.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:01:28.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:01:38.568 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T10:01:38.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T10:01:58.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:01:58.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:02:06.822 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:13:17.624 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.835 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:13:17.638 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.845 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:13:17.712 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.848 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:13:17.715 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.850 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:13:17.717 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.850 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:13:17.717 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.936 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:13:17.802 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:06.962 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:13:17.765 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:07.000 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:13:17.866 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:28.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:02:28.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:02:58.314 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:14:09.117 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.323 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:14:09.126 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.363 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:14:09.166 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.396 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:14:09.262 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.411 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:14:09.277 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.418 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:14:09.285 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.428 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:14:09.292 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.462 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:14:09.329 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:58.465 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:14:09.332 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:02:59.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:02:59.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:03:29.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:03:29.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:03:59.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:03:59.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:04:29.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:04:29.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:04:49.124 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:15:59.926 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.134 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:15:59.937 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.205 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:16:00.071 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.216 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:16:00.079 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.216 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:16:00.080 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.216 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:16:00.082 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.242 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:16:00.045 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.269 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:16:00.135 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:49.269 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:16:00.136 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:04:59.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:04:59.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:05:29.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:05:29.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:05:59.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:05:59.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:06:12.834 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:17:23.637 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.847 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:17:23.713 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.849 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:17:23.716 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.850 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:17:23.653 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.857 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:17:23.723 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.859 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:17:23.726 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.892 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:17:23.758 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.902 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:17:23.768 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:12.966 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:17:23.769 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:06:29.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:06:29.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:07:00.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:07:00.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:07:30.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:07:30.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:08:00.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:08:00.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:08:30.565 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:08:30.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:09:00.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:09:00.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:09:30.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:09:30.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:10:00.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:10:01.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:10:21.207 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:21:32.008 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.212 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:21:32.078 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.213 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:21:32.016 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.214 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:21:32.080 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.216 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:21:32.082 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.218 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:21:32.084 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.304 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:21:32.170 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.348 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:21:32.214 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:21.358 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:21:32.161 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:10:31.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:10:31.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:11:01.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:11:01.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:11:16.635 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:22:27.437 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.656 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:22:27.459 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.706 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:22:27.572 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.714 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:22:27.516 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.715 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:22:27.581 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.725 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:22:27.591 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.729 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:22:27.595 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.749 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:22:27.614 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:16.777 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:22:27.643 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:11:31.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:11:31.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:12:01.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:12:01.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:12:31.684 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:12:31.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:13:01.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:13:01.839 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:13:12.288 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:24:23.090 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.293 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:24:23.095 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.351 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:23.217 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.356 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:23.222 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.372 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:24:23.174 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.385 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:24:23.251 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.387 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:24:23.252 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.397 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:23.263 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:12.426 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:24:23.292 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:13:32.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:13:32.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:14:02.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:14:02.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:14:28.017 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:25:38.818 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.024 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:25:38.890 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.026 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:25:38.892 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.027 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:25:38.893 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.029 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:25:38.831 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.030 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:25:38.895 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.067 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:25:38.933 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.085 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:25:38.950 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:28.126 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:25:38.928 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:14:32.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:14:32.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:15:02.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:15:02.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:15:32.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:15:32.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:16:02.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:16:02.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:16:32.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:16:32.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:17:02.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:17:02.975 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:17:33.148 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:17:33.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:18:03.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:18:03.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:18:33.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:18:33.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:18:36.215 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:29:47.017 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.223 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:29:47.088 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.223 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:29:47.025 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.226 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:29:47.091 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.227 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:29:47.093 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.230 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:29:47.096 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.318 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:29:47.183 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.347 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:29:47.212 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:18:36.378 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:29:47.179 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:03.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:19:03.568 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:19:33.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:19:33.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:19:39.678 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:30:50.479 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.681 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:30:50.483 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.720 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:30:50.522 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.764 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:30:50.630 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.765 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:30:50.631 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.767 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:30:50.632 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.769 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:30:50.634 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.799 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:30:50.664 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:19:39.800 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:30:50.665 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:20:03.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:20:03.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:20:33.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:20:33.903 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:21:04.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:21:04.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:21:34.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:21:34.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:21:35.495 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:32:46.296 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.502 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:32:46.303 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.549 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:32:46.414 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.554 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:32:46.420 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.580 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:32:46.445 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.587 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:32:46.452 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.606 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:32:46.408 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.611 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:32:46.476 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:21:35.643 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:32:46.509 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:04.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:22:04.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:22:34.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:22:34.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:22:43.287 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:33:54.088 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.295 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:33:54.160 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.297 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:33:54.162 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.298 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:33:54.099 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.299 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:33:54.164 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.299 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:33:54.165 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.336 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:33:54.201 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.358 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:33:54.223 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:22:43.398 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:33:54.199 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:23:04.549 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:23:04.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:23:34.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:23:34.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:24:04.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:24:04.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:24:34.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:24:34.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:25:05.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:25:05.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:25:35.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:25:35.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:26:05.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:26:05.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:26:35.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:26:35.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:26:52.245 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:38:03.046 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.261 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:38:03.062 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.263 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:38:03.128 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.266 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:38:03.131 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.267 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:38:03.132 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.270 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:38:03.135 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.376 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:38:03.241 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.378 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:38:03.243 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:26:52.414 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:38:03.215 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:05.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:27:05.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:27:35.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:27:35.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:27:58.510 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:39:09.311 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.600 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:39:09.401 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.653 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:39:09.454 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.665 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:39:09.530 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.667 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:39:09.532 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.687 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:39:09.552 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.695 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:39:09.560 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.718 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:39:09.583 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:27:58.731 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:39:09.596 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:28:05.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:28:05.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:28:36.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:28:36.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:29:06.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:29:06.135 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:29:36.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:29:36.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:29:59.533 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:41:10.334 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.541 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:41:10.342 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.613 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:41:10.478 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.614 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:41:10.479 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.626 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:41:10.428 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.630 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:41:10.495 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.632 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:41:10.497 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.653 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:41:10.518 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:29:59.690 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:41:10.555 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:06.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:30:06.427 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:30:36.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:30:36.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:30:57.514 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:42:08.315 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.528 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:42:08.393 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.529 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:42:08.330 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.531 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:42:08.396 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.536 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:42:08.401 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.538 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:42:08.403 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.573 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:42:08.438 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.576 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:42:08.441 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:30:57.586 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:42:08.388 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:31:06.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:31:06.677 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:31:36.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:31:36.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:32:06.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:32:06.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:32:37.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:32:37.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:33:07.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:33:07.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:33:37.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:33:37.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:34:07.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:34:07.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:34:37.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:34:37.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:35:07.273 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:46:18.074 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.289 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:46:18.091 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.297 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:46:18.161 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.297 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:46:18.161 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.300 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:46:18.164 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.300 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:46:18.165 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.407 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:46:18.272 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.436 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:46:18.300 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.463 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:46:18.264 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:35:07.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:35:07.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:35:37.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:35:37.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:36:08.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:36:08.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:36:17.165 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:47:27.966 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.176 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:47:27.977 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.220 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:47:28.085 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.225 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:47:28.090 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.227 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:47:28.029 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.231 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:47:28.096 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.235 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:47:28.099 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.264 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:47:28.129 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:17.316 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:47:28.181 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:36:38.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:36:38.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:37:08.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:37:08.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:37:38.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:37:38.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:38:08.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:38:08.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:38:23.157 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:49:33.958 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.164 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:49:33.965 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.242 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:49:34.106 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.244 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:49:34.109 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.247 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:49:34.111 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.250 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:49:34.115 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.260 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:49:34.061 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.305 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:49:34.169 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:23.310 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:49:34.174 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:38:38.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:38:38.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:39:08.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:39:08.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:39:13.771 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:50:24.572 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.787 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:50:24.588 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.794 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:50:24.658 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.796 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:50:24.661 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.797 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:50:24.662 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.800 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:50:24.664 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.833 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:50:24.697 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.837 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:50:24.702 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:13.877 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:50:24.678 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:39:39.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:39:39.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:40:09.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:40:09.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:40:39.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:40:39.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:41:09.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:41:09.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:41:39.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:41:39.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:42:09.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:42:09.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:42:39.921 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:42:39.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:43:10.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:43:10.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:43:22.371 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:54:33.171 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.378 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:54:33.243 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.380 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:54:33.181 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.380 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:54:33.245 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.388 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:54:33.252 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.391 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:54:33.256 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.511 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:54:33.375 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.523 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:54:33.387 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:22.543 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:54:33.344 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:43:40.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:43:40.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:44:10.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:44:10.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:44:40.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:44:40.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:44:40.831 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:55:51.632 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:40.933 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:55:51.734 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:40.975 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:55:51.839 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:40.982 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:55:51.846 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:41.016 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:55:51.881 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:41.019 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:55:51.883 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:41.020 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:55:51.885 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:41.076 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:55:51.940 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:44:41.101 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:55:51.901 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:45:10.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:45:10.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:45:40.800 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:45:40.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:46:05.947 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-04T10:46:05.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T10:46:06.987 DEBUG:teuthology.parallel:result is None 2024-03-04T10:46:06.987 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T10:46:07.541 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T10:46:07.541 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-04T10:46:07.554 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-04T10:46:07.554 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T10:46:07.554 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T10:46:07.602 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-04T10:46:07.602 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T10:46:07.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T10:46:07.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.931+0000 7eff45200640 1 Processor -- start 2024-03-04T10:46:07.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.931+0000 7eff45200640 1 -- start start 2024-03-04T10:46:07.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.932+0000 7eff45200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff4006d8c0 0x7eff4006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:07.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.932+0000 7eff45200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4015b960 con 0x7eff4006d4e0 2024-03-04T10:46:07.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.932+0000 7eff45200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4015bc40 con 0x7eff400716f0 2024-03-04T10:46:07.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.932+0000 7eff45200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4015bf20 con 0x7eff4006d8c0 2024-03-04T10:46:07.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.933+0000 7eff3e800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7eff400716f0 0x7eff40151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46796/0 (socket says 172.21.15.46:46796) 2024-03-04T10:46:07.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.933+0000 7eff3e800640 1 -- 172.21.15.46:0/2267140391 learned_addr learned my addr 172.21.15.46:0/2267140391 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:07.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.934+0000 7eff3d400640 1 --2- 172.21.15.46:0/2267140391 >> v2:172.21.15.46:3300/0 conn(0x7eff4006d8c0 0x7eff4006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:07.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.936+0000 7eff3ca00640 1 -- 172.21.15.46:0/2267140391 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127826651 0 0) 0x7eff4015bc40 con 0x7eff400716f0 2024-03-04T10:46:07.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.937+0000 7eff3ca00640 1 -- 172.21.15.46:0/2267140391 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff24003520 con 0x7eff400716f0 2024-03-04T10:46:07.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.938+0000 7eff3d400640 1 -- 172.21.15.46:0/2267140391 >> v1:172.21.15.73:6789/0 conn(0x7eff400716f0 legacy=0x7eff40151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:07.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.938+0000 7eff3d400640 1 -- 172.21.15.46:0/2267140391 >> v1:172.21.15.46:6789/0 conn(0x7eff4006d4e0 legacy=0x7eff40158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:07.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.938+0000 7eff3d400640 1 -- 172.21.15.46:0/2267140391 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4015c200 con 0x7eff4006d8c0 2024-03-04T10:46:07.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.946+0000 7eff3d400640 1 --2- 172.21.15.46:0/2267140391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d8c0 0x7eff4006e410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0097a0 tx=0x7eff2c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b5f10e02f43a14 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:07.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff3ca00640 1 -- 172.21.15.46:0/2267140391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c034070 con 0x7eff4006d8c0 2024-03-04T10:46:07.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff3ca00640 1 -- 172.21.15.46:0/2267140391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c030610 con 0x7eff4006d8c0 2024-03-04T10:46:07.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff3ca00640 1 -- 172.21.15.46:0/2267140391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0309e0 con 0x7eff4006d8c0 2024-03-04T10:46:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff45200640 1 -- 172.21.15.46:0/2267140391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d8c0 msgr2=0x7eff4006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff45200640 1 --2- 172.21.15.46:0/2267140391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d8c0 0x7eff4006e410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0097a0 tx=0x7eff2c02b960 comp rx=0 tx=0).stop 2024-03-04T10:46:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff45200640 1 -- 172.21.15.46:0/2267140391 shutdown_connections 2024-03-04T10:46:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff45200640 1 --2- 172.21.15.46:0/2267140391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d8c0 0x7eff4006e410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.951+0000 7eff45200640 1 -- 172.21.15.46:0/2267140391 >> 172.21.15.46:0/2267140391 conn(0x7eff400c88d0 msgr2=0x7eff400c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.952+0000 7eff45200640 1 -- 172.21.15.46:0/2267140391 shutdown_connections 2024-03-04T10:46:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.952+0000 7eff45200640 1 -- 172.21.15.46:0/2267140391 wait complete. 2024-03-04T10:46:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.954+0000 7eff45200640 1 Processor -- start 2024-03-04T10:46:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.954+0000 7eff45200640 1 -- start start 2024-03-04T10:46:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.955+0000 7eff45200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d4e0 0x7eff401576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.955+0000 7eff45200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4006d8c0 0x7eff40149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.955+0000 7eff45200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 0x7eff40156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.955+0000 7eff45200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff40158fe0 con 0x7eff4006d4e0 2024-03-04T10:46:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.955+0000 7eff45200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff40158e60 con 0x7eff4006d8c0 2024-03-04T10:46:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.955+0000 7eff45200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4015b3e0 con 0x7eff400716f0 2024-03-04T10:46:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.956+0000 7eff3d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4006d8c0 0x7eff40149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.956+0000 7eff3de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d4e0 0x7eff401576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.956+0000 7eff3e800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 0x7eff40156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.956+0000 7eff3e800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 0x7eff40156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48146/0 (socket says 172.21.15.46:48146) 2024-03-04T10:46:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.956+0000 7eff3e800640 1 -- 172.21.15.46:0/2821130705 learned_addr learned my addr 172.21.15.46:0/2821130705 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.960+0000 7eff3de00640 1 -- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 msgr2=0x7eff40156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.960+0000 7eff3de00640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 0x7eff40156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.960+0000 7eff3de00640 1 -- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4006d8c0 msgr2=0x7eff40149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.960+0000 7eff3de00640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4006d8c0 0x7eff40149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.960+0000 7eff3de00640 1 -- 172.21.15.46:0/2821130705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40157c00 con 0x7eff4006d4e0 2024-03-04T10:46:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.960+0000 7eff3e800640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 0x7eff40156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.962+0000 7eff3de00640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d4e0 0x7eff401576c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7eff3000c370 tx=0x7eff3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.967+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff300052d0 con 0x7eff4006d4e0 2024-03-04T10:46:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.967+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30005490 con 0x7eff4006d4e0 2024-03-04T10:46:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.967+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30007260 con 0x7eff4006d4e0 2024-03-04T10:46:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.967+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400c13c0 con 0x7eff4006d4e0 2024-03-04T10:46:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.967+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff400c26e0 con 0x7eff4006d4e0 2024-03-04T10:46:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.969+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff400c21f0 con 0x7eff4006d4e0 2024-03-04T10:46:07.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.990+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff30007400 con 0x7eff4006d4e0 2024-03-04T10:46:07.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.991+0000 7eff36000640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7eff2006b520 0x7eff2006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:07.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.992+0000 7eff3d400640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7eff2006b520 0x7eff2006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:07.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.993+0000 7eff3d400640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7eff2006b520 0x7eff2006d9e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff2c036000 tx=0x7eff2c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:07.995+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7eff30056380 con 0x7eff4006d4e0 2024-03-04T10:46:08.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.278+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7eff300582e0 con 0x7eff4006d4e0 2024-03-04T10:46:08.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.583+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff400680b0 con 0x7eff4006d4e0 2024-03-04T10:46:08.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.651+0000 7eff36000640 1 -- 172.21.15.46:0/2821130705 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16598 (secure 0 0 0) 0x7eff3005c380 con 0x7eff4006d4e0 2024-03-04T10:46:08.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:08.656 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:50:11.544052+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7eff2006b520 msgr2=0x7eff2006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7eff2006b520 0x7eff2006d9e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff2c036000 tx=0x7eff2c03b040 comp rx=0 tx=0).stop 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d4e0 msgr2=0x7eff401576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d4e0 0x7eff401576c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7eff3000c370 tx=0x7eff3000c830 comp rx=0 tx=0).stop 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 shutdown_connections 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7eff2006b520 0x7eff2006d9e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4006d8c0 0x7eff40149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff400716f0 0x7eff40156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 --2- 172.21.15.46:0/2821130705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4006d4e0 0x7eff401576c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 >> 172.21.15.46:0/2821130705 conn(0x7eff400c88d0 msgr2=0x7eff400c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 shutdown_connections 2024-03-04T10:46:08.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.654+0000 7eff45200640 1 -- 172.21.15.46:0/2821130705 wait complete. 2024-03-04T10:46:08.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:49:22.737500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:49:37.195578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:49:38.689323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T10:46:08.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T10:46:08.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.882+0000 7f9f47200640 1 Processor -- start 2024-03-04T10:46:08.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.883+0000 7f9f47200640 1 -- start start 2024-03-04T10:46:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.884+0000 7f9f47200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40158c00 0x7f9f40161e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.884+0000 7f9f47200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f400c7710 0x7f9f40072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.884+0000 7f9f47200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400733d0 con 0x7f9f40162360 2024-03-04T10:46:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.884+0000 7f9f47200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4015f800 con 0x7f9f400c7710 2024-03-04T10:46:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.884+0000 7f9f47200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4015f370 con 0x7f9f40158c00 2024-03-04T10:46:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.885+0000 7f9f37e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9f40162360 0x7f9f400c85b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46806/0 (socket says 172.21.15.46:46806) 2024-03-04T10:46:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.885+0000 7f9f37e00640 1 -- 172.21.15.46:0/1846020234 learned_addr learned my addr 172.21.15.46:0/1846020234 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.886+0000 7f9f45200640 1 --2- 172.21.15.46:0/1846020234 >> v2:172.21.15.73:3300/0 conn(0x7f9f400c7710 0x7f9f40072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.887+0000 7f9f3fe00640 1 --2- 172.21.15.46:0/1846020234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40158c00 0x7f9f40161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.889+0000 7f9f3f400640 1 -- 172.21.15.46:0/1846020234 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338270086 0 0) 0x7f9f400733d0 con 0x7f9f40162360 2024-03-04T10:46:08.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.889+0000 7f9f3f400640 1 -- 172.21.15.46:0/1846020234 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f24003520 con 0x7f9f40162360 2024-03-04T10:46:08.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.890+0000 7f9f3fe00640 1 -- 172.21.15.46:0/1846020234 >> v2:172.21.15.73:3300/0 conn(0x7f9f400c7710 msgr2=0x7f9f40072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.890+0000 7f9f3fe00640 1 --2- 172.21.15.46:0/1846020234 >> v2:172.21.15.73:3300/0 conn(0x7f9f400c7710 0x7f9f40072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.890+0000 7f9f3fe00640 1 -- 172.21.15.46:0/1846020234 >> v1:172.21.15.73:6789/0 conn(0x7f9f40162360 legacy=0x7f9f400c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.890+0000 7f9f3fe00640 1 -- 172.21.15.46:0/1846020234 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4015ea40 con 0x7f9f40158c00 2024-03-04T10:46:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.893+0000 7f9f3fe00640 1 --2- 172.21.15.46:0/1846020234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40158c00 0x7f9f40161e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9f300097a0 tx=0x7f9f3002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638228e8de907b05 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.897+0000 7f9f3f400640 1 -- 172.21.15.46:0/1846020234 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30034070 con 0x7f9f40158c00 2024-03-04T10:46:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.897+0000 7f9f3f400640 1 -- 172.21.15.46:0/1846020234 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30030800 con 0x7f9f40158c00 2024-03-04T10:46:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.897+0000 7f9f3f400640 1 -- 172.21.15.46:0/1846020234 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30030bb0 con 0x7f9f40158c00 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 -- 172.21.15.46:0/1846020234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40158c00 msgr2=0x7f9f40161e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 --2- 172.21.15.46:0/1846020234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40158c00 0x7f9f40161e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9f300097a0 tx=0x7f9f3002b940 comp rx=0 tx=0).stop 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 -- 172.21.15.46:0/1846020234 shutdown_connections 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 --2- 172.21.15.46:0/1846020234 >> v2:172.21.15.73:3300/0 conn(0x7f9f400c7710 0x7f9f40072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 --2- 172.21.15.46:0/1846020234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40158c00 0x7f9f40161e20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 -- 172.21.15.46:0/1846020234 >> 172.21.15.46:0/1846020234 conn(0x7f9f4006aff0 msgr2=0x7f9f4006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 -- 172.21.15.46:0/1846020234 shutdown_connections 2024-03-04T10:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.898+0000 7f9f47200640 1 -- 172.21.15.46:0/1846020234 wait complete. 2024-03-04T10:46:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.900+0000 7f9f47200640 1 Processor -- start 2024-03-04T10:46:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.900+0000 7f9f47200640 1 -- start start 2024-03-04T10:46:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.901+0000 7f9f47200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 0x7f9f400c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.901+0000 7f9f47200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f40158c00 0x7f9f401f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.901+0000 7f9f47200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40162360 0x7f9f4015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.901+0000 7f9f47200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4015f000 con 0x7f9f40158c00 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.901+0000 7f9f47200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40158fe0 con 0x7f9f400c7710 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.901+0000 7f9f47200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400c8cc0 con 0x7f9f40162360 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.902+0000 7f9f3fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 0x7f9f400c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.902+0000 7f9f3fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 0x7f9f400c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:38442/0 (socket says 172.21.15.46:38442) 2024-03-04T10:46:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.902+0000 7f9f3fe00640 1 -- 172.21.15.46:0/2912075443 learned_addr learned my addr 172.21.15.46:0/2912075443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.903+0000 7f9f45200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40162360 0x7f9f4015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.907+0000 7f9f3fe00640 1 -- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40162360 msgr2=0x7f9f4015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.907+0000 7f9f3fe00640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40162360 0x7f9f4015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.907+0000 7f9f3fe00640 1 -- 172.21.15.46:0/2912075443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f40158c00 msgr2=0x7f9f401f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.907+0000 7f9f3fe00640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f40158c00 0x7f9f401f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.907+0000 7f9f3fe00640 1 -- 172.21.15.46:0/2912075443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400c4ad0 con 0x7f9f400c7710 2024-03-04T10:46:08.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.910+0000 7f9f3fe00640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 0x7f9f400c44b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f3002b980 tx=0x7f9f300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.915+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30047070 con 0x7f9f400c7710 2024-03-04T10:46:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.915+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30030600 con 0x7f9f400c7710 2024-03-04T10:46:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.915+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30034050 con 0x7f9f400c7710 2024-03-04T10:46:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.915+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f400c4db0 con 0x7f9f400c7710 2024-03-04T10:46:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.915+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f401f4960 con 0x7f9f400c7710 2024-03-04T10:46:08.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.916+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f401f4470 con 0x7f9f400c7710 2024-03-04T10:46:08.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.947+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f3004a070 con 0x7f9f400c7710 2024-03-04T10:46:08.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.949+0000 7f9f3cc00640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f9f1c06b550 0x7f9f1c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:08.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.949+0000 7f9f37e00640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f9f1c06b550 0x7f9f1c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:08.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.950+0000 7f9f37e00640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f9f1c06b550 0x7f9f1c06da10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9f28000f60 tx=0x7f9f280078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:08.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:08.950+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9f300307b0 con 0x7f9f400c7710 2024-03-04T10:46:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.326+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9f30051080 con 0x7f9f400c7710 2024-03-04T10:46:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.590+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f400680b0 con 0x7f9f400c7710 2024-03-04T10:46:09.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.611+0000 7f9f3cc00640 1 -- 172.21.15.46:0/2912075443 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f3007a690 con 0x7f9f400c7710 2024-03-04T10:46:09.615 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f9f1c06b550 msgr2=0x7f9f1c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f9f1c06b550 0x7f9f1c06da10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9f28000f60 tx=0x7f9f280078f0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 msgr2=0x7f9f400c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 0x7f9f400c44b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f3002b980 tx=0x7f9f300046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 shutdown_connections 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f9f1c06b550 0x7f9f1c06da10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f40162360 0x7f9f4015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f40158c00 0x7f9f401f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 --2- 172.21.15.46:0/2912075443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f400c7710 0x7f9f400c44b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 >> 172.21.15.46:0/2912075443 conn(0x7f9f4006aff0 msgr2=0x7f9f40074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 shutdown_connections 2024-03-04T10:46:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.615+0000 7f9f47200640 1 -- 172.21.15.46:0/2912075443 wait complete. 2024-03-04T10:46:09.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T10:46:09.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.819+0000 7f3e75c00640 1 Processor -- start 2024-03-04T10:46:09.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.820+0000 7f3e75c00640 1 -- start start 2024-03-04T10:46:09.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.821+0000 7f3e75c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e700cd1b0 0x7f3e700ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.821+0000 7f3e75c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e700cf0f0 0x7f3e700ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.821+0000 7f3e75c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7015a5c0 con 0x7f3e70154900 2024-03-04T10:46:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.821+0000 7f3e75c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7015b490 con 0x7f3e700cd1b0 2024-03-04T10:46:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.821+0000 7f3e75c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700ca5c0 con 0x7f3e700cf0f0 2024-03-04T10:46:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.822+0000 7f3e75200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e700cf0f0 0x7f3e700ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.822+0000 7f3e6f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e700cd1b0 0x7f3e700ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.822+0000 7f3e6fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3e70154900 0x7f3e7015ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46818/0 (socket says 172.21.15.46:46818) 2024-03-04T10:46:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.823+0000 7f3e6fe00640 1 -- 172.21.15.46:0/249198178 learned_addr learned my addr 172.21.15.46:0/249198178 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:09.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.826+0000 7f3e6f400640 1 -- 172.21.15.46:0/249198178 >> v2:172.21.15.73:3300/0 conn(0x7f3e700cf0f0 msgr2=0x7f3e700ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:09.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.826+0000 7f3e6f400640 1 --2- 172.21.15.46:0/249198178 >> v2:172.21.15.73:3300/0 conn(0x7f3e700cf0f0 0x7f3e700ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.826+0000 7f3e6f400640 1 -- 172.21.15.46:0/249198178 >> v1:172.21.15.73:6789/0 conn(0x7f3e70154900 legacy=0x7f3e7015ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:09.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.826+0000 7f3e6f400640 1 -- 172.21.15.46:0/249198178 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700ca8a0 con 0x7f3e700cd1b0 2024-03-04T10:46:09.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.826+0000 7f3e75200640 1 --2- 172.21.15.46:0/249198178 >> v2:172.21.15.73:3300/0 conn(0x7f3e700cf0f0 0x7f3e700ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:09.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.830+0000 7f3e6f400640 1 --2- 172.21.15.46:0/249198178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700ce090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006b9f0 tx=0x7f3e5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08b07e32d3d397d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.835+0000 7f3e6ea00640 1 -- 172.21.15.46:0/249198178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c035020 con 0x7f3e700cd1b0 2024-03-04T10:46:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.835+0000 7f3e6ea00640 1 -- 172.21.15.46:0/249198178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c031830 con 0x7f3e700cd1b0 2024-03-04T10:46:09.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.835+0000 7f3e6ea00640 1 -- 172.21.15.46:0/249198178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c031c00 con 0x7f3e700cd1b0 2024-03-04T10:46:09.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 -- 172.21.15.46:0/249198178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 msgr2=0x7f3e700ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:09.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 --2- 172.21.15.46:0/249198178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700ce090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006b9f0 tx=0x7f3e5c02b8d0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 -- 172.21.15.46:0/249198178 shutdown_connections 2024-03-04T10:46:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 --2- 172.21.15.46:0/249198178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700ce090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 --2- 172.21.15.46:0/249198178 >> v2:172.21.15.73:3300/0 conn(0x7f3e700cf0f0 0x7f3e700ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 -- 172.21.15.46:0/249198178 >> 172.21.15.46:0/249198178 conn(0x7f3e700b15b0 msgr2=0x7f3e700b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 -- 172.21.15.46:0/249198178 shutdown_connections 2024-03-04T10:46:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.836+0000 7f3e75c00640 1 -- 172.21.15.46:0/249198178 wait complete. 2024-03-04T10:46:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.838+0000 7f3e75c00640 1 Processor -- start 2024-03-04T10:46:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.838+0000 7f3e75c00640 1 -- start start 2024-03-04T10:46:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.839+0000 7f3e75c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.839+0000 7f3e75c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 0x7f3e7014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.839+0000 7f3e75c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e70154900 0x7f3e700c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.839+0000 7f3e75c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7006c5c0 con 0x7f3e700cd1b0 2024-03-04T10:46:09.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.839+0000 7f3e75c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700cab80 con 0x7f3e700cf0f0 2024-03-04T10:46:09.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.839+0000 7f3e75c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700c8de0 con 0x7f3e70154900 2024-03-04T10:46:09.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.840+0000 7f3e75200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e70154900 0x7f3e700c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:09.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.840+0000 7f3e6fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:09.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.840+0000 7f3e6f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 0x7f3e7014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:09.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.840+0000 7f3e6fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35764/0 (socket says 172.21.15.46:35764) 2024-03-04T10:46:09.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.840+0000 7f3e6f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 0x7f3e7014c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:38458/0 (socket says 172.21.15.46:38458) 2024-03-04T10:46:09.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.840+0000 7f3e6fe00640 1 -- 172.21.15.46:0/1621857074 learned_addr learned my addr 172.21.15.46:0/1621857074 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.844+0000 7f3e6fe00640 1 -- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e70154900 msgr2=0x7f3e700c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.844+0000 7f3e6fe00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e70154900 0x7f3e700c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.844+0000 7f3e6fe00640 1 -- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 msgr2=0x7f3e7014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.844+0000 7f3e6fe00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 0x7f3e7014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.844+0000 7f3e6fe00640 1 -- 172.21.15.46:0/1621857074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700c7350 con 0x7f3e700cd1b0 2024-03-04T10:46:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.844+0000 7f3e6f400640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 0x7f3e7014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:09.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.847+0000 7f3e6fe00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700c8650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c3c0 tx=0x7f3e6000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.851+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60017070 con 0x7f3e700cd1b0 2024-03-04T10:46:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.851+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e60005ce0 con 0x7f3e700cd1b0 2024-03-04T10:46:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.851+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600072f0 con 0x7f3e700cd1b0 2024-03-04T10:46:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.851+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700c7630 con 0x7f3e700cd1b0 2024-03-04T10:46:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.852+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7014b8d0 con 0x7f3e700cd1b0 2024-03-04T10:46:09.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:09.853+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e700b13d0 con 0x7f3e700cd1b0 2024-03-04T10:46:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.192+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e6001a070 con 0x7f3e700cd1b0 2024-03-04T10:46:10.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.193+0000 7f3e67e00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3e5006b520 0x7f3e5006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.194+0000 7f3e6f400640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3e5006b520 0x7f3e5006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.195+0000 7f3e6f400640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3e5006b520 0x7f3e5006d9e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c036000 tx=0x7f3e5c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.208+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3e60056160 con 0x7f3e700cd1b0 2024-03-04T10:46:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.209+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3e700b13d0 con 0x7f3e700cd1b0 2024-03-04T10:46:10.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.415+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e700cba20 con 0x7f3e700cd1b0 2024-03-04T10:46:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.469+0000 7f3e67e00640 1 -- 172.21.15.46:0/1621857074 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e700cba20 con 0x7f3e700cd1b0 2024-03-04T10:46:10.473 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.471+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3e5006b520 msgr2=0x7f3e5006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.471+0000 7f3e75c00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3e5006b520 0x7f3e5006d9e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c036000 tx=0x7f3e5c008030 comp rx=0 tx=0).stop 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.471+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 msgr2=0x7f3e700c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.471+0000 7f3e75c00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700c8650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c3c0 tx=0x7f3e6000c7c0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 shutdown_connections 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f3e5006b520 0x7f3e5006d9e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e700cf0f0 0x7f3e7014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e70154900 0x7f3e700c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 --2- 172.21.15.46:0/1621857074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e700cd1b0 0x7f3e700c8650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 >> 172.21.15.46:0/1621857074 conn(0x7f3e700b15b0 msgr2=0x7f3e7014e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 shutdown_connections 2024-03-04T10:46:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.472+0000 7f3e75c00640 1 -- 172.21.15.46:0/1621857074 wait complete. 2024-03-04T10:46:10.493 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T10:46:10.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.675+0000 7fcfca600640 1 Processor -- start 2024-03-04T10:46:10.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.676+0000 7fcfca600640 1 -- start start 2024-03-04T10:46:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.678+0000 7fcfca600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc406feb0 0x7fcfc4073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.678+0000 7fcfca600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc4159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.678+0000 7fcfca600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc40716b0 con 0x7fcfc4150d20 2024-03-04T10:46:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.678+0000 7fcfca600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc40c6050 con 0x7fcfc406feb0 2024-03-04T10:46:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.678+0000 7fcfca600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc4151100 con 0x7fcfc40c7f70 2024-03-04T10:46:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.679+0000 7fcfc2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc406feb0 0x7fcfc4073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.679+0000 7fcfc3e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc4159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.679+0000 7fcfc2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc406feb0 0x7fcfc4073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:38466/0 (socket says 172.21.15.46:38466) 2024-03-04T10:46:10.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.679+0000 7fcfc2a00640 1 -- 172.21.15.46:0/1489179840 learned_addr learned my addr 172.21.15.46:0/1489179840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.683+0000 7fcfc3e00640 1 -- 172.21.15.46:0/1489179840 >> v2:172.21.15.73:3300/0 conn(0x7fcfc406feb0 msgr2=0x7fcfc4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.683+0000 7fcfc3e00640 1 --2- 172.21.15.46:0/1489179840 >> v2:172.21.15.73:3300/0 conn(0x7fcfc406feb0 0x7fcfc4073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.683+0000 7fcfc3e00640 1 -- 172.21.15.46:0/1489179840 >> v1:172.21.15.73:6789/0 conn(0x7fcfc4150d20 legacy=0x7fcfc40b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.683+0000 7fcfc3e00640 1 -- 172.21.15.46:0/1489179840 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4071970 con 0x7fcfc40c7f70 2024-03-04T10:46:10.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.685+0000 7fcfc3e00640 1 --2- 172.21.15.46:0/1489179840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc4159fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009d90 tx=0x7fcfbc02e020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66dbc2483026c14 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:10.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.688+0000 7fcfc2000640 1 -- 172.21.15.46:0/1489179840 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc03b070 con 0x7fcfc40c7f70 2024-03-04T10:46:10.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.690+0000 7fcfc2000640 1 -- 172.21.15.46:0/1489179840 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc02edd0 con 0x7fcfc40c7f70 2024-03-04T10:46:10.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.690+0000 7fcfc2000640 1 -- 172.21.15.46:0/1489179840 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc036660 con 0x7fcfc40c7f70 2024-03-04T10:46:10.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.690+0000 7fcfca600640 1 -- 172.21.15.46:0/1489179840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 msgr2=0x7fcfc4159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:10.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.690+0000 7fcfca600640 1 --2- 172.21.15.46:0/1489179840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc4159fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009d90 tx=0x7fcfbc02e020 comp rx=0 tx=0).stop 2024-03-04T10:46:10.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.691+0000 7fcfca600640 1 -- 172.21.15.46:0/1489179840 shutdown_connections 2024-03-04T10:46:10.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.691+0000 7fcfca600640 1 --2- 172.21.15.46:0/1489179840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc4159fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.691+0000 7fcfca600640 1 --2- 172.21.15.46:0/1489179840 >> v2:172.21.15.73:3300/0 conn(0x7fcfc406feb0 0x7fcfc4073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.691+0000 7fcfca600640 1 -- 172.21.15.46:0/1489179840 >> 172.21.15.46:0/1489179840 conn(0x7fcfc406aff0 msgr2=0x7fcfc406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:10.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.691+0000 7fcfca600640 1 -- 172.21.15.46:0/1489179840 shutdown_connections 2024-03-04T10:46:10.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.691+0000 7fcfca600640 1 -- 172.21.15.46:0/1489179840 wait complete. 2024-03-04T10:46:10.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.693+0000 7fcfca600640 1 Processor -- start 2024-03-04T10:46:10.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.693+0000 7fcfca600640 1 -- start start 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.695+0000 7fcfca600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406feb0 0x7fcfc414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.695+0000 7fcfca600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc40c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.695+0000 7fcfca600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc4150d20 0x7fcfc41f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.695+0000 7fcfca600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40b1e10 con 0x7fcfc4150d20 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.695+0000 7fcfca600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c2720 con 0x7fcfc406feb0 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.695+0000 7fcfca600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40b1f90 con 0x7fcfc40c7f70 2024-03-04T10:46:10.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.696+0000 7fcfc3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406feb0 0x7fcfc414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.696+0000 7fcfc2a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc40c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.696+0000 7fcfc3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc4150d20 0x7fcfc41f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.696+0000 7fcfc2a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc40c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48206/0 (socket says 172.21.15.46:48206) 2024-03-04T10:46:10.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.696+0000 7fcfc2a00640 1 -- 172.21.15.46:0/3216693188 learned_addr learned my addr 172.21.15.46:0/3216693188 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:10.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.699+0000 7fcfc2a00640 1 -- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406feb0 msgr2=0x7fcfc414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:10.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.699+0000 7fcfc2a00640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406feb0 0x7fcfc414ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.699+0000 7fcfc2a00640 1 -- 172.21.15.46:0/3216693188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc4150d20 msgr2=0x7fcfc41f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:10.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.699+0000 7fcfc2a00640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc4150d20 0x7fcfc41f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:10.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.699+0000 7fcfc2a00640 1 -- 172.21.15.46:0/3216693188 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc41f0350 con 0x7fcfc40c7f70 2024-03-04T10:46:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.702+0000 7fcfc2a00640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc40c3130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009fd0 tx=0x7fcfb000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.706+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0017070 con 0x7fcfc40c7f70 2024-03-04T10:46:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.706+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000c940 con 0x7fcfc40c7f70 2024-03-04T10:46:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.706+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000cd10 con 0x7fcfc40c7f70 2024-03-04T10:46:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.706+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc41f0630 con 0x7fcfc40c7f70 2024-03-04T10:46:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.706+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc41f0bf0 con 0x7fcfc40c7f70 2024-03-04T10:46:10.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.708+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc40680b0 con 0x7fcfc40c7f70 2024-03-04T10:46:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.727+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfb001a070 con 0x7fcfc40c7f70 2024-03-04T10:46:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.728+0000 7fcfbb400640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa406b550 0x7fcfa406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.729+0000 7fcfc3400640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa406b550 0x7fcfa406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.729+0000 7fcfc3400640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa406b550 0x7fcfa406da10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40016e0 tx=0x7fcfb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:10.730+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcfb00570c0 con 0x7fcfc40c7f70 2024-03-04T10:46:10.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:46:10.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:46:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.002+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcfb0059020 con 0x7fcfc40c7f70 2024-03-04T10:46:11.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.233+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfc406f2d0 con 0x7fcfc40c7f70 2024-03-04T10:46:11.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.241+0000 7fcfbb400640 1 -- 172.21.15.46:0/3216693188 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfb005d0c0 con 0x7fcfc40c7f70 2024-03-04T10:46:11.244 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-03-04T10:46:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa406b550 msgr2=0x7fcfa406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa406b550 0x7fcfa406da10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40016e0 tx=0x7fcfb4009040 comp rx=0 tx=0).stop 2024-03-04T10:46:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 msgr2=0x7fcfc40c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc40c3130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009fd0 tx=0x7fcfb000ed40 comp rx=0 tx=0).stop 2024-03-04T10:46:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 shutdown_connections 2024-03-04T10:46:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcfa406b550 0x7fcfa406da10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfc4150d20 0x7fcfc41f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcfc40c7f70 0x7fcfc40c3130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 --2- 172.21.15.46:0/3216693188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406feb0 0x7fcfc414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.243+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 >> 172.21.15.46:0/3216693188 conn(0x7fcfc406aff0 msgr2=0x7fcfc40c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.244+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 shutdown_connections 2024-03-04T10:46:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.244+0000 7fcfca600640 1 -- 172.21.15.46:0/3216693188 wait complete. 2024-03-04T10:46:11.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T10:46:11.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.437+0000 7f2ce8e00640 1 Processor -- start 2024-03-04T10:46:11.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.437+0000 7f2ce8e00640 1 -- start start 2024-03-04T10:46:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.438+0000 7f2ce8e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ce415a3c0 0x7f2ce40cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.438+0000 7f2ce8e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce415a870 con 0x7f2ce40cb3a0 2024-03-04T10:46:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.438+0000 7f2ce8e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce415ab50 con 0x7f2ce4154600 2024-03-04T10:46:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.438+0000 7f2ce8e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40cb8f0 con 0x7f2ce415a3c0 2024-03-04T10:46:11.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.450+0000 7f2ce3e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2ce40cb3a0 0x7f2ce406c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41006/0 (socket says 172.21.15.46:41006) 2024-03-04T10:46:11.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.450+0000 7f2ce3e00640 1 -- 172.21.15.46:0/616951014 learned_addr learned my addr 172.21.15.46:0/616951014 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:11.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.463+0000 7f2ce2a00640 1 --2- 172.21.15.46:0/616951014 >> v2:172.21.15.73:3300/0 conn(0x7f2ce415a3c0 0x7f2ce40cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:11.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.465+0000 7f2ce2000640 1 -- 172.21.15.46:0/616951014 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488019847 0 0) 0x7f2ce415a870 con 0x7f2ce40cb3a0 2024-03-04T10:46:11.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.465+0000 7f2ce2000640 1 -- 172.21.15.46:0/616951014 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc8003520 con 0x7f2ce40cb3a0 2024-03-04T10:46:11.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.467+0000 7f2ce2a00640 1 -- 172.21.15.46:0/616951014 >> v1:172.21.15.73:6789/0 conn(0x7f2ce4154600 legacy=0x7f2ce40cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.467+0000 7f2ce2a00640 1 -- 172.21.15.46:0/616951014 >> v1:172.21.15.46:6789/0 conn(0x7f2ce40cb3a0 legacy=0x7f2ce406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.467+0000 7f2ce2a00640 1 -- 172.21.15.46:0/616951014 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce415ae30 con 0x7f2ce415a3c0 2024-03-04T10:46:11.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.476+0000 7f2ce2a00640 1 --2- 172.21.15.46:0/616951014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce415a3c0 0x7f2ce40cac50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00097a0 tx=0x7f2cd002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48983abce21102b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:11.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.480+0000 7f2ce2000640 1 -- 172.21.15.46:0/616951014 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd002f810 con 0x7f2ce415a3c0 2024-03-04T10:46:11.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.482+0000 7f2ce2000640 1 -- 172.21.15.46:0/616951014 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd002f9b0 con 0x7f2ce415a3c0 2024-03-04T10:46:11.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.482+0000 7f2ce2000640 1 -- 172.21.15.46:0/616951014 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd002fd60 con 0x7f2ce415a3c0 2024-03-04T10:46:11.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.483+0000 7f2ce8e00640 1 -- 172.21.15.46:0/616951014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce415a3c0 msgr2=0x7f2ce40cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.483+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/616951014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce415a3c0 0x7f2ce40cac50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00097a0 tx=0x7f2cd002b9f0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.484+0000 7f2ce8e00640 1 -- 172.21.15.46:0/616951014 shutdown_connections 2024-03-04T10:46:11.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.484+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/616951014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce415a3c0 0x7f2ce40cac50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.484+0000 7f2ce8e00640 1 -- 172.21.15.46:0/616951014 >> 172.21.15.46:0/616951014 conn(0x7f2ce40b17c0 msgr2=0x7f2ce40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:11.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.484+0000 7f2ce8e00640 1 -- 172.21.15.46:0/616951014 shutdown_connections 2024-03-04T10:46:11.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.484+0000 7f2ce8e00640 1 -- 172.21.15.46:0/616951014 wait complete. 2024-03-04T10:46:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.487+0000 7f2ce8e00640 1 Processor -- start 2024-03-04T10:46:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.488+0000 7f2ce8e00640 1 -- start start 2024-03-04T10:46:11.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.490+0000 7f2ce8e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce40cb3a0 0x7f2ce41f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:11.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.490+0000 7f2ce8e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce4154600 0x7f2ce4152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.490+0000 7f2ce8e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ce415a3c0 0x7f2ce40c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.490+0000 7f2ce8e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40cd9d0 con 0x7f2ce4154600 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.490+0000 7f2ce8e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40cb190 con 0x7f2ce40cb3a0 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.490+0000 7f2ce8e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce41549e0 con 0x7f2ce415a3c0 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.491+0000 7f2ce3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce40cb3a0 0x7f2ce41f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.491+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ce415a3c0 0x7f2ce40c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:11.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.491+0000 7f2ce3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce40cb3a0 0x7f2ce41f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47910/0 (socket says 172.21.15.46:47910) 2024-03-04T10:46:11.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.491+0000 7f2ce3400640 1 -- 172.21.15.46:0/383090730 learned_addr learned my addr 172.21.15.46:0/383090730 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:11.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.495+0000 7f2ce3e00640 1 -- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce40cb3a0 msgr2=0x7f2ce41f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.495+0000 7f2ce3e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce40cb3a0 0x7f2ce41f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.495+0000 7f2ce3e00640 1 -- 172.21.15.46:0/383090730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce4154600 msgr2=0x7f2ce4152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:11.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.495+0000 7f2ce3e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce4154600 0x7f2ce4152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:11.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.495+0000 7f2ce3e00640 1 -- 172.21.15.46:0/383090730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4154d90 con 0x7f2ce415a3c0 2024-03-04T10:46:11.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.498+0000 7f2ce3e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ce415a3c0 0x7f2ce40c7680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00cad0 tx=0x7f2cdc00ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.503+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc017070 con 0x7f2ce415a3c0 2024-03-04T10:46:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.503+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00ab70 con 0x7f2ce415a3c0 2024-03-04T10:46:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.503+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc012400 con 0x7f2ce415a3c0 2024-03-04T10:46:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.503+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce41f1050 con 0x7f2ce415a3c0 2024-03-04T10:46:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.503+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40c8fb0 con 0x7f2ce415a3c0 2024-03-04T10:46:11.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.505+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce4075240 con 0x7f2ce415a3c0 2024-03-04T10:46:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.863+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cdc01a070 con 0x7f2ce415a3c0 2024-03-04T10:46:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.865+0000 7f2cdb400640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2cc406b4d0 0x7f2cc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.865+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2cdc08a1c0 con 0x7f2ce415a3c0 2024-03-04T10:46:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.865+0000 7f2ce3400640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2cc406b4d0 0x7f2cc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:11.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.866+0000 7f2ce3400640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2cc406b4d0 0x7f2cc406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4007fd0 tx=0x7f2cd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:11.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:11.876+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2ce4154d90 con 0x7f2ce415a3c0 2024-03-04T10:46:12.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.115+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2ce404f410 con 0x7f2ce415a3c0 2024-03-04T10:46:12.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.125+0000 7f2cdb400640 1 -- 172.21.15.46:0/383090730 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2cdc058ab0 con 0x7f2ce415a3c0 2024-03-04T10:46:12.129 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2cc406b4d0 msgr2=0x7f2cc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2cc406b4d0 0x7f2cc406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4007fd0 tx=0x7f2cd4009040 comp rx=0 tx=0).stop 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ce415a3c0 msgr2=0x7f2ce40c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ce415a3c0 0x7f2ce40c7680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00cad0 tx=0x7f2cdc00ced0 comp rx=0 tx=0).stop 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 shutdown_connections 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f2cc406b4d0 0x7f2cc406d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ce415a3c0 0x7f2ce40c7680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce4154600 0x7f2ce4152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 --2- 172.21.15.46:0/383090730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce40cb3a0 0x7f2ce41f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:12.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 >> 172.21.15.46:0/383090730 conn(0x7f2ce40b17c0 msgr2=0x7f2ce4158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:12.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 shutdown_connections 2024-03-04T10:46:12.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:12.128+0000 7f2ce8e00640 1 -- 172.21.15.46:0/383090730 wait complete. 2024-03-04T10:46:12.151 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-04T10:46:12.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T10:46:12.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-04T10:46:12.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T10:46:12.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T10:46:12.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T10:46:12.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T10:46:12.811 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-03-04T10:46:12.853 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T10:46:12.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T10:46:12.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T10:46:12.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T10:46:12.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-03-04T10:46:13.105 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-04T10:46:13.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T10:46:13.129 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T10:46:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.305+0000 7f0b8e000640 1 Processor -- start 2024-03-04T10:46:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.306+0000 7f0b8e000640 1 -- start start 2024-03-04T10:46:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.307+0000 7f0b8e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b8806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.307+0000 7f0b8e000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8815b960 con 0x7f0b8806d8c0 2024-03-04T10:46:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.307+0000 7f0b8e000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8815bc40 con 0x7f0b880716f0 2024-03-04T10:46:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.307+0000 7f0b8e000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8815bf20 con 0x7f0b8806d4e0 2024-03-04T10:46:13.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.308+0000 7f0b86a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0b8806d8c0 0x7f0b88158750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39078/0 (socket says 172.21.15.46:39078) 2024-03-04T10:46:13.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.308+0000 7f0b86a00640 1 -- 172.21.15.46:0/3684680147 learned_addr learned my addr 172.21.15.46:0/3684680147 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:13.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.308+0000 7f0b87400640 1 --2- 172.21.15.46:0/3684680147 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b8806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:13.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147226784 0 0) 0x7f0b8815bc40 con 0x7f0b880716f0 2024-03-04T10:46:13.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c003520 con 0x7f0b880716f0 2024-03-04T10:46:13.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190112371 0 0) 0x7f0b8815b960 con 0x7f0b8806d8c0 2024-03-04T10:46:13.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b8815bc40 con 0x7f0b8806d8c0 2024-03-04T10:46:13.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b87400640 1 -- 172.21.15.46:0/3684680147 >> v1:172.21.15.73:6789/0 conn(0x7f0b880716f0 legacy=0x7f0b88151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b87400640 1 -- 172.21.15.46:0/3684680147 >> v1:172.21.15.46:6789/0 conn(0x7f0b8806d8c0 legacy=0x7f0b88158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.311+0000 7f0b87400640 1 -- 172.21.15.46:0/3684680147 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8815c200 con 0x7f0b8806d4e0 2024-03-04T10:46:13.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.314+0000 7f0b87400640 1 --2- 172.21.15.46:0/3684680147 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b8806e410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b780097d0 tx=0x7f0b7802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70045c671c8d25eb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:13.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.317+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78035020 con 0x7f0b8806d4e0 2024-03-04T10:46:13.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.317+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78031890 con 0x7f0b8806d4e0 2024-03-04T10:46:13.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.317+0000 7f0b86000640 1 -- 172.21.15.46:0/3684680147 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78031c60 con 0x7f0b8806d4e0 2024-03-04T10:46:13.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 -- 172.21.15.46:0/3684680147 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 msgr2=0x7f0b8806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 --2- 172.21.15.46:0/3684680147 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b8806e410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b780097d0 tx=0x7f0b7802b930 comp rx=0 tx=0).stop 2024-03-04T10:46:13.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 -- 172.21.15.46:0/3684680147 shutdown_connections 2024-03-04T10:46:13.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 --2- 172.21.15.46:0/3684680147 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b8806e410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 -- 172.21.15.46:0/3684680147 >> 172.21.15.46:0/3684680147 conn(0x7f0b880c88d0 msgr2=0x7f0b880c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:13.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 -- 172.21.15.46:0/3684680147 shutdown_connections 2024-03-04T10:46:13.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.318+0000 7f0b8e000640 1 -- 172.21.15.46:0/3684680147 wait complete. 2024-03-04T10:46:13.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.320+0000 7f0b8e000640 1 Processor -- start 2024-03-04T10:46:13.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.320+0000 7f0b8e000640 1 -- start start 2024-03-04T10:46:13.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.321+0000 7f0b8e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b881f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:13.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.321+0000 7f0b8e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b8806d8c0 0x7f0b88149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:13.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.321+0000 7f0b8e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b880716f0 0x7f0b88147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:13.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.321+0000 7f0b8e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88158fe0 con 0x7f0b880716f0 2024-03-04T10:46:13.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.321+0000 7f0b8e000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88158e60 con 0x7f0b8806d8c0 2024-03-04T10:46:13.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.321+0000 7f0b8e000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c4ed0 con 0x7f0b8806d4e0 2024-03-04T10:46:13.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.322+0000 7f0b86a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b8806d8c0 0x7f0b88149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:13.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.322+0000 7f0b87400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b881f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:13.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.322+0000 7f0b87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b880716f0 0x7f0b88147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:13.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.322+0000 7f0b87400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b881f3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44776/0 (socket says 172.21.15.46:44776) 2024-03-04T10:46:13.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.322+0000 7f0b87400640 1 -- 172.21.15.46:0/1445572236 learned_addr learned my addr 172.21.15.46:0/1445572236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:13.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.326+0000 7f0b87400640 1 -- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b8806d8c0 msgr2=0x7f0b88149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.326+0000 7f0b87400640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b8806d8c0 0x7f0b88149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.326+0000 7f0b87400640 1 -- 172.21.15.46:0/1445572236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b880716f0 msgr2=0x7f0b88147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.326+0000 7f0b87400640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b880716f0 0x7f0b88147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.326+0000 7f0b87400640 1 -- 172.21.15.46:0/1445572236 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b881f44c0 con 0x7f0b8806d4e0 2024-03-04T10:46:13.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.328+0000 7f0b87400640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b881f3f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b7802bf40 tx=0x7f0b780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.332+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78035040 con 0x7f0b8806d4e0 2024-03-04T10:46:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.332+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78030b10 con 0x7f0b8806d4e0 2024-03-04T10:46:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.332+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b880c5410 con 0x7f0b8806d4e0 2024-03-04T10:46:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.332+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78044430 con 0x7f0b8806d4e0 2024-03-04T10:46:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.333+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b880c4630 con 0x7f0b8806d4e0 2024-03-04T10:46:13.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.334+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b880680b0 con 0x7f0b8806d4e0 2024-03-04T10:46:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.359+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b78038020 con 0x7f0b8806d4e0 2024-03-04T10:46:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.360+0000 7f0b7f400640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0b6806b550 0x7f0b6806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.360+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0b78077840 con 0x7f0b8806d4e0 2024-03-04T10:46:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.361+0000 7f0b86a00640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0b6806b550 0x7f0b6806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.362+0000 7f0b86a00640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0b6806b550 0x7f0b6806da10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b880c77f0 tx=0x7f0b74007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:13.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.721+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0b7802d040 con 0x7f0b8806d4e0 2024-03-04T10:46:13.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.931+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b88073470 con 0x7f0b6806b550 2024-03-04T10:46:13.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.944+0000 7f0b7f400640 1 -- 172.21.15.46:0/1445572236 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254008 (secure 0 0 0) 0x7f0b88073470 con 0x7f0b6806b550 2024-03-04T10:46:13.951 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:13.953 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0b6806b550 msgr2=0x7f0b6806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0b6806b550 0x7f0b6806da10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b880c77f0 tx=0x7f0b74007d30 comp rx=0 tx=0).stop 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 msgr2=0x7f0b881f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b881f3f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b7802bf40 tx=0x7f0b780046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 shutdown_connections 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0b6806b550 0x7f0b6806da10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b8806d8c0 0x7f0b88149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b880716f0 0x7f0b88147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 --2- 172.21.15.46:0/1445572236 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b8806d4e0 0x7f0b881f3f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 >> 172.21.15.46:0/1445572236 conn(0x7f0b880c88d0 msgr2=0x7f0b880c7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 shutdown_connections 2024-03-04T10:46:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:13.950+0000 7f0b8e000640 1 -- 172.21.15.46:0/1445572236 wait complete. 2024-03-04T10:46:13.979 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":3526,"stamp":"2024-03-04T10:46:12.845789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216238902,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":2670,"num_read_kb":3493837,"num_write":53227,"num_write_kb":4570277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51592,"ondisk_log_size":51592,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":944752,"kb_used_data":424624,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754029968,"statfs":{"total":773094113280,"available":772126687232,"internally_reserved":0,"allocated":434814976,"data_stored":433226359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":532532785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-291388,"num_objects":-67,"num_object_clones":0,"num_object_copies":-134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-67,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":116,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002480"},"pg_stats":[{"pgid":"3.3f","version":"25'422","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.792912+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T10:45:59.792912+0000","last_peered":"2024-03-04T10:45:59.792912+0000","last_clean":"2024-03-04T10:45:59.792912+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T10:45:59.792912+0000","last_undegraded":"2024-03-04T10:45:59.792912+0000","last_fullsized":"2024-03-04T10:45:59.792912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":56779,"num_write":405,"num_write_kb":75850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'414","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.556150+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T10:45:41.556150+0000","last_peered":"2024-03-04T10:45:41.556150+0000","last_clean":"2024-03-04T10:45:41.556150+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T10:45:41.556150+0000","last_undegraded":"2024-03-04T10:45:41.556150+0000","last_fullsized":"2024-03-04T10:45:41.556150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68736,"num_write":382,"num_write_kb":71625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'371","reported_seq":451,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.747145+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T10:45:41.747145+0000","last_peered":"2024-03-04T10:45:41.747145+0000","last_clean":"2024-03-04T10:45:41.747145+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T10:45:41.747145+0000","last_undegraded":"2024-03-04T10:45:41.747145+0000","last_fullsized":"2024-03-04T10:45:41.747145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24226,"num_write":349,"num_write_kb":62283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'358","reported_seq":448,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.279356+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T10:45:42.279356+0000","last_peered":"2024-03-04T10:45:42.279356+0000","last_clean":"2024-03-04T10:45:42.279356+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T10:45:42.279356+0000","last_undegraded":"2024-03-04T10:45:42.279356+0000","last_fullsized":"2024-03-04T10:45:42.279356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":47711,"num_write":338,"num_write_kb":33889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'438","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.364908+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T10:45:59.364908+0000","last_peered":"2024-03-04T10:45:59.364908+0000","last_clean":"2024-03-04T10:45:59.364908+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T10:45:59.364908+0000","last_undegraded":"2024-03-04T10:45:59.364908+0000","last_fullsized":"2024-03-04T10:45:59.364908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":161798,"num_write":413,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'371","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.189408+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T10:45:19.189408+0000","last_peered":"2024-03-04T10:45:19.189408+0000","last_clean":"2024-03-04T10:45:19.189408+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T10:45:19.189408+0000","last_undegraded":"2024-03-04T10:45:19.189408+0000","last_fullsized":"2024-03-04T10:45:19.189408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":34885,"num_write":351,"num_write_kb":34327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'378","reported_seq":464,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.830558+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T10:45:37.830558+0000","last_peered":"2024-03-04T10:45:37.830558+0000","last_clean":"2024-03-04T10:45:37.830558+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T10:45:37.830558+0000","last_undegraded":"2024-03-04T10:45:37.830558+0000","last_fullsized":"2024-03-04T10:45:37.830558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":76194,"num_write":351,"num_write_kb":54499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'351","reported_seq":430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.799112+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T10:45:37.799112+0000","last_peered":"2024-03-04T10:45:37.799112+0000","last_clean":"2024-03-04T10:45:37.799112+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T10:45:37.799112+0000","last_undegraded":"2024-03-04T10:45:37.799112+0000","last_fullsized":"2024-03-04T10:45:37.799112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26383,"num_write":323,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'396","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:58.824658+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T10:45:58.824658+0000","last_peered":"2024-03-04T10:45:58.824658+0000","last_clean":"2024-03-04T10:45:58.824658+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T10:45:58.824658+0000","last_undegraded":"2024-03-04T10:45:58.824658+0000","last_fullsized":"2024-03-04T10:45:58.824658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20946,"num_write":374,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'401","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.742454+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T10:45:43.742454+0000","last_peered":"2024-03-04T10:45:43.742454+0000","last_clean":"2024-03-04T10:45:43.742454+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T10:45:43.742454+0000","last_undegraded":"2024-03-04T10:45:43.742454+0000","last_fullsized":"2024-03-04T10:45:43.742454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":17641,"num_write":374,"num_write_kb":26355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'381","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.742405+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T10:45:43.742405+0000","last_peered":"2024-03-04T10:45:43.742405+0000","last_clean":"2024-03-04T10:45:43.742405+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T10:45:43.742405+0000","last_undegraded":"2024-03-04T10:45:43.742405+0000","last_fullsized":"2024-03-04T10:45:43.742405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":63408,"num_write":366,"num_write_kb":59321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'353","reported_seq":434,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.742346+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T10:45:43.742346+0000","last_peered":"2024-03-04T10:45:43.742346+0000","last_clean":"2024-03-04T10:45:43.742346+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T10:45:43.742346+0000","last_undegraded":"2024-03-04T10:45:43.742346+0000","last_fullsized":"2024-03-04T10:45:43.742346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":49283,"num_write":340,"num_write_kb":63175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'401","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.211189+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T10:45:42.211189+0000","last_peered":"2024-03-04T10:45:42.211189+0000","last_clean":"2024-03-04T10:45:42.211189+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T10:45:42.211189+0000","last_undegraded":"2024-03-04T10:45:42.211189+0000","last_fullsized":"2024-03-04T10:45:42.211189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":54416,"num_write":375,"num_write_kb":38585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'385","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.967894+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T10:45:59.967894+0000","last_peered":"2024-03-04T10:45:59.967894+0000","last_clean":"2024-03-04T10:45:59.967894+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T10:45:59.967894+0000","last_undegraded":"2024-03-04T10:45:59.967894+0000","last_fullsized":"2024-03-04T10:45:59.967894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29624,"num_write":360,"num_write_kb":30114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'404","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.450739+0000","last_change":"2024-03-04T08:50:12.592750+0000","last_active":"2024-03-04T10:45:48.450739+0000","last_peered":"2024-03-04T10:45:48.450739+0000","last_clean":"2024-03-04T10:45:48.450739+0000","last_became_active":"2024-03-04T08:50:12.592374+0000","last_became_peered":"2024-03-04T08:50:12.592374+0000","last_unstale":"2024-03-04T10:45:48.450739+0000","last_undegraded":"2024-03-04T10:45:48.450739+0000","last_fullsized":"2024-03-04T10:45:48.450739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:28.147260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":71598,"num_write":369,"num_write_kb":67511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'416","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.479069+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T10:45:19.479069+0000","last_peered":"2024-03-04T10:45:19.479069+0000","last_clean":"2024-03-04T10:45:19.479069+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T10:45:19.479069+0000","last_undegraded":"2024-03-04T10:45:19.479069+0000","last_fullsized":"2024-03-04T10:45:19.479069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":49152,"num_write":389,"num_write_kb":58855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'431","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.908110+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T10:45:41.908110+0000","last_peered":"2024-03-04T10:45:41.908110+0000","last_clean":"2024-03-04T10:45:41.908110+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T10:45:41.908110+0000","last_undegraded":"2024-03-04T10:45:41.908110+0000","last_fullsized":"2024-03-04T10:45:41.908110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":66011,"num_write":406,"num_write_kb":96427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'407","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.630967+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T10:45:31.630967+0000","last_peered":"2024-03-04T10:45:31.630967+0000","last_clean":"2024-03-04T10:45:31.630967+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T10:45:31.630967+0000","last_undegraded":"2024-03-04T10:45:31.630967+0000","last_fullsized":"2024-03-04T10:45:31.630967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":44968,"num_write":370,"num_write_kb":71715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'421","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.750105+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T10:45:41.750105+0000","last_peered":"2024-03-04T10:45:41.750105+0000","last_clean":"2024-03-04T10:45:41.750105+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T10:45:41.750105+0000","last_undegraded":"2024-03-04T10:45:41.750105+0000","last_fullsized":"2024-03-04T10:45:41.750105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":73465,"num_write":395,"num_write_kb":100388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'430","reported_seq":517,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.568280+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T10:45:48.568280+0000","last_peered":"2024-03-04T10:45:48.568280+0000","last_clean":"2024-03-04T10:45:48.568280+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T10:45:48.568280+0000","last_undegraded":"2024-03-04T10:45:48.568280+0000","last_fullsized":"2024-03-04T10:45:48.568280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":62456,"num_write":411,"num_write_kb":51118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'412","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.750379+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T10:45:24.750379+0000","last_peered":"2024-03-04T10:45:24.750379+0000","last_clean":"2024-03-04T10:45:24.750379+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T10:45:24.750379+0000","last_undegraded":"2024-03-04T10:45:24.750379+0000","last_fullsized":"2024-03-04T10:45:24.750379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":56958,"num_write":379,"num_write_kb":88435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'427","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.746818+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T10:45:59.746818+0000","last_peered":"2024-03-04T10:45:59.746818+0000","last_clean":"2024-03-04T10:45:59.746818+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T10:45:59.746818+0000","last_undegraded":"2024-03-04T10:45:59.746818+0000","last_fullsized":"2024-03-04T10:45:59.746818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84454,"num_write":409,"num_write_kb":67704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'384","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343973+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T10:45:48.343973+0000","last_peered":"2024-03-04T10:45:48.343973+0000","last_clean":"2024-03-04T10:45:48.343973+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T10:45:48.343973+0000","last_undegraded":"2024-03-04T10:45:48.343973+0000","last_fullsized":"2024-03-04T10:45:48.343973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15942,"num_write":359,"num_write_kb":55013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.015140+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T10:46:00.015140+0000","last_peered":"2024-03-04T10:46:00.015140+0000","last_clean":"2024-03-04T10:46:00.015140+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T10:46:00.015140+0000","last_undegraded":"2024-03-04T10:46:00.015140+0000","last_fullsized":"2024-03-04T10:46:00.015140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18489,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":47415,"num_write":403,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'414","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.799178+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T10:45:37.799178+0000","last_peered":"2024-03-04T10:45:37.799178+0000","last_clean":"2024-03-04T10:45:37.799178+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T10:45:37.799178+0000","last_undegraded":"2024-03-04T10:45:37.799178+0000","last_fullsized":"2024-03-04T10:45:37.799178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49227,"num_write":397,"num_write_kb":80014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'498","reported_seq":596,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.280181+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T10:45:42.280181+0000","last_peered":"2024-03-04T10:45:42.280181+0000","last_clean":"2024-03-04T10:45:42.280181+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T10:45:42.280181+0000","last_undegraded":"2024-03-04T10:45:42.280181+0000","last_fullsized":"2024-03-04T10:45:42.280181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":78376,"num_write":475,"num_write_kb":113705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'424","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.742945+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T10:45:41.742945+0000","last_peered":"2024-03-04T10:45:41.742945+0000","last_clean":"2024-03-04T10:45:41.742945+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T10:45:41.742945+0000","last_undegraded":"2024-03-04T10:45:41.742945+0000","last_fullsized":"2024-03-04T10:45:41.742945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75663,"num_write":396,"num_write_kb":55800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'365","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.743746+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T10:45:41.743746+0000","last_peered":"2024-03-04T10:45:41.743746+0000","last_clean":"2024-03-04T10:45:41.743746+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T10:45:41.743746+0000","last_undegraded":"2024-03-04T10:45:41.743746+0000","last_fullsized":"2024-03-04T10:45:41.743746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":29309,"num_write":341,"num_write_kb":42443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'374","reported_seq":462,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.479777+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T10:45:48.479777+0000","last_peered":"2024-03-04T10:45:48.479777+0000","last_clean":"2024-03-04T10:45:48.479777+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T10:45:48.479777+0000","last_undegraded":"2024-03-04T10:45:48.479777+0000","last_fullsized":"2024-03-04T10:45:48.479777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44796,"num_write":353,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'477","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.783241+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T10:45:59.783241+0000","last_peered":"2024-03-04T10:45:59.783241+0000","last_clean":"2024-03-04T10:45:59.783241+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T10:45:59.783241+0000","last_undegraded":"2024-03-04T10:45:59.783241+0000","last_fullsized":"2024-03-04T10:45:59.783241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":91221,"num_write":448,"num_write_kb":101088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'453","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.360760+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T10:45:59.360760+0000","last_peered":"2024-03-04T10:45:59.360760+0000","last_clean":"2024-03-04T10:45:59.360760+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T10:45:59.360760+0000","last_undegraded":"2024-03-04T10:45:59.360760+0000","last_fullsized":"2024-03-04T10:45:59.360760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":144837,"num_write":435,"num_write_kb":130358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'443","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:58.341379+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T10:44:58.341379+0000","last_peered":"2024-03-04T10:44:58.341379+0000","last_clean":"2024-03-04T10:44:58.341379+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T10:44:58.341379+0000","last_undegraded":"2024-03-04T10:44:58.341379+0000","last_fullsized":"2024-03-04T10:44:58.341379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23611,"num_write":420,"num_write_kb":59471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'410","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.604123+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T10:45:59.604123+0000","last_peered":"2024-03-04T10:45:59.604123+0000","last_clean":"2024-03-04T10:45:59.604123+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T10:45:59.604123+0000","last_undegraded":"2024-03-04T10:45:59.604123+0000","last_fullsized":"2024-03-04T10:45:59.604123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":42800,"num_write":385,"num_write_kb":71334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'238","reported_seq":305,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.853775+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T10:44:25.853775+0000","last_peered":"2024-03-04T10:44:25.853775+0000","last_clean":"2024-03-04T10:44:25.853775+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T10:44:25.853775+0000","last_undegraded":"2024-03-04T10:44:25.853775+0000","last_fullsized":"2024-03-04T10:44:25.853775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'361","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.925278+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T10:45:59.925278+0000","last_peered":"2024-03-04T10:45:59.925278+0000","last_clean":"2024-03-04T10:45:59.925278+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T10:45:59.925278+0000","last_undegraded":"2024-03-04T10:45:59.925278+0000","last_fullsized":"2024-03-04T10:45:59.925278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32809,"num_write":342,"num_write_kb":54741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1403","reported_seq":1470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:47.849996+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T10:44:47.849996+0000","last_peered":"2024-03-04T10:44:47.849996+0000","last_clean":"2024-03-04T10:44:47.849996+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T10:44:47.849996+0000","last_undegraded":"2024-03-04T10:44:47.849996+0000","last_fullsized":"2024-03-04T10:44:47.849996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":17039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'794","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.213101+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T10:46:07.213101+0000","last_peered":"2024-03-04T10:46:07.213101+0000","last_clean":"2024-03-04T10:46:07.213101+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T10:46:07.213101+0000","last_undegraded":"2024-03-04T10:46:07.213101+0000","last_fullsized":"2024-03-04T10:46:07.213101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'439","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.097530+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T10:46:00.097530+0000","last_peered":"2024-03-04T10:46:00.097530+0000","last_clean":"2024-03-04T10:46:00.097530+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T10:46:00.097530+0000","last_undegraded":"2024-03-04T10:46:00.097530+0000","last_fullsized":"2024-03-04T10:46:00.097530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":27702,"num_write":417,"num_write_kb":42496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1108","reported_seq":1177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.513140+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T10:45:24.513140+0000","last_peered":"2024-03-04T10:45:24.513140+0000","last_clean":"2024-03-04T10:45:24.513140+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T10:45:24.513140+0000","last_undegraded":"2024-03-04T10:45:24.513140+0000","last_fullsized":"2024-03-04T10:45:24.513140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":12803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'401","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.554301+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T10:45:41.554301+0000","last_peered":"2024-03-04T10:45:41.554301+0000","last_clean":"2024-03-04T10:45:41.554301+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T10:45:41.554301+0000","last_undegraded":"2024-03-04T10:45:41.554301+0000","last_fullsized":"2024-03-04T10:45:41.554301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":31518,"num_write":380,"num_write_kb":54868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'67","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.328254+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T10:45:31.328254+0000","last_peered":"2024-03-04T10:45:31.328254+0000","last_clean":"2024-03-04T10:45:31.328254+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T10:45:31.328254+0000","last_undegraded":"2024-03-04T10:45:31.328254+0000","last_fullsized":"2024-03-04T10:45:31.328254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'448","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.617955+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T10:45:43.617955+0000","last_peered":"2024-03-04T10:45:43.617955+0000","last_clean":"2024-03-04T10:45:43.617955+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T10:45:43.617955+0000","last_undegraded":"2024-03-04T10:45:43.617955+0000","last_fullsized":"2024-03-04T10:45:43.617955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68599,"num_write":425,"num_write_kb":83547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1152","reported_seq":1221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.193839+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T10:46:07.193839+0000","last_peered":"2024-03-04T10:46:07.193839+0000","last_clean":"2024-03-04T10:46:07.193839+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T10:46:07.193839+0000","last_undegraded":"2024-03-04T10:46:07.193839+0000","last_fullsized":"2024-03-04T10:46:07.193839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12821640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":13069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'395","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.348834+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T10:45:42.348834+0000","last_peered":"2024-03-04T10:45:42.348834+0000","last_clean":"2024-03-04T10:45:42.348834+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T10:45:42.348834+0000","last_undegraded":"2024-03-04T10:45:42.348834+0000","last_fullsized":"2024-03-04T10:45:42.348834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":69489,"num_write":372,"num_write_kb":99199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1617","reported_seq":1686,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:04.086239+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T10:46:04.086239+0000","last_peered":"2024-03-04T10:46:04.086239+0000","last_clean":"2024-03-04T10:46:04.086239+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T10:46:04.086239+0000","last_undegraded":"2024-03-04T10:46:04.086239+0000","last_fullsized":"2024-03-04T10:46:04.086239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":9396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.558451+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T10:45:48.558451+0000","last_peered":"2024-03-04T10:45:48.558451+0000","last_clean":"2024-03-04T10:45:48.558451+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T10:45:48.558451+0000","last_undegraded":"2024-03-04T10:45:48.558451+0000","last_fullsized":"2024-03-04T10:45:48.558451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":58935,"num_write":368,"num_write_kb":66938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1669","reported_seq":1739,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.837377+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T10:45:41.837377+0000","last_peered":"2024-03-04T10:45:41.837377+0000","last_clean":"2024-03-04T10:45:41.837377+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T10:45:41.837377+0000","last_undegraded":"2024-03-04T10:45:41.837377+0000","last_fullsized":"2024-03-04T10:45:41.837377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1669,"log_dups_size":0,"ondisk_log_size":1669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1619,"num_write_kb":13254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'384","reported_seq":465,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.604440+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T10:45:24.604440+0000","last_peered":"2024-03-04T10:45:24.604440+0000","last_clean":"2024-03-04T10:45:24.604440+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T10:45:24.604440+0000","last_undegraded":"2024-03-04T10:45:24.604440+0000","last_fullsized":"2024-03-04T10:45:24.604440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":52325,"num_write":353,"num_write_kb":55067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'325","reported_seq":395,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:02.302876+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T10:44:02.302876+0000","last_peered":"2024-03-04T10:44:02.302876+0000","last_clean":"2024-03-04T10:44:02.302876+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T10:44:02.302876+0000","last_undegraded":"2024-03-04T10:44:02.302876+0000","last_fullsized":"2024-03-04T10:44:02.302876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":8340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'406","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.705416+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T10:45:24.705416+0000","last_peered":"2024-03-04T10:45:24.705416+0000","last_clean":"2024-03-04T10:45:24.705416+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T10:45:24.705416+0000","last_undegraded":"2024-03-04T10:45:24.705416+0000","last_fullsized":"2024-03-04T10:45:24.705416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":41706,"num_write":387,"num_write_kb":84154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:37.275661+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T10:44:37.275661+0000","last_peered":"2024-03-04T10:44:37.275661+0000","last_clean":"2024-03-04T10:44:37.275661+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T10:44:37.275661+0000","last_undegraded":"2024-03-04T10:44:37.275661+0000","last_fullsized":"2024-03-04T10:44:37.275661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'402","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.219628+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T10:45:42.219628+0000","last_peered":"2024-03-04T10:45:42.219628+0000","last_clean":"2024-03-04T10:45:42.219628+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T10:45:42.219628+0000","last_undegraded":"2024-03-04T10:45:42.219628+0000","last_fullsized":"2024-03-04T10:45:42.219628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3125,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":71159,"num_write":381,"num_write_kb":34363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'67","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:03.474568+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T10:44:03.474568+0000","last_peered":"2024-03-04T10:44:03.474568+0000","last_clean":"2024-03-04T10:44:03.474568+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T10:44:03.474568+0000","last_undegraded":"2024-03-04T10:44:03.474568+0000","last_fullsized":"2024-03-04T10:44:03.474568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'440","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.776566+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T10:46:08.776566+0000","last_peered":"2024-03-04T10:46:08.776566+0000","last_clean":"2024-03-04T10:46:08.776566+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T10:46:08.776566+0000","last_undegraded":"2024-03-04T10:46:08.776566+0000","last_fullsized":"2024-03-04T10:46:08.776566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":111394,"num_write":416,"num_write_kb":109040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'823","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:18.871918+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T10:44:18.871918+0000","last_peered":"2024-03-04T10:44:18.871918+0000","last_clean":"2024-03-04T10:44:18.871918+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T10:44:18.871918+0000","last_undegraded":"2024-03-04T10:44:18.871918+0000","last_fullsized":"2024-03-04T10:44:18.871918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":8544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'472","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.894666+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T10:46:03.894666+0000","last_peered":"2024-03-04T10:46:03.894666+0000","last_clean":"2024-03-04T10:46:03.894666+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T10:46:03.894666+0000","last_undegraded":"2024-03-04T10:46:03.894666+0000","last_fullsized":"2024-03-04T10:46:03.894666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":59537,"num_write":439,"num_write_kb":76319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'752","reported_seq":824,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:38.732774+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T10:44:38.732774+0000","last_peered":"2024-03-04T10:44:38.732774+0000","last_clean":"2024-03-04T10:44:38.732774+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T10:44:38.732774+0000","last_undegraded":"2024-03-04T10:44:38.732774+0000","last_fullsized":"2024-03-04T10:44:38.732774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'369","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.481915+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T10:45:31.481915+0000","last_peered":"2024-03-04T10:45:31.481915+0000","last_clean":"2024-03-04T10:45:31.481915+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T10:45:31.481915+0000","last_undegraded":"2024-03-04T10:45:31.481915+0000","last_fullsized":"2024-03-04T10:45:31.481915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":68174,"num_write":341,"num_write_kb":71100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'821","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.267058+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T10:44:27.267058+0000","last_peered":"2024-03-04T10:44:27.267058+0000","last_clean":"2024-03-04T10:44:27.267058+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T10:44:27.267058+0000","last_undegraded":"2024-03-04T10:44:27.267058+0000","last_fullsized":"2024-03-04T10:44:27.267058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'375","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:14.759936+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T10:45:14.759936+0000","last_peered":"2024-03-04T10:45:14.759936+0000","last_clean":"2024-03-04T10:45:14.759936+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T10:45:14.759936+0000","last_undegraded":"2024-03-04T10:45:14.759936+0000","last_fullsized":"2024-03-04T10:45:14.759936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":53055,"num_write":347,"num_write_kb":59070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'206","reported_seq":278,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:46.179515+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T10:43:46.179515+0000","last_peered":"2024-03-04T10:43:46.179515+0000","last_clean":"2024-03-04T10:43:46.179515+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T10:43:46.179515+0000","last_undegraded":"2024-03-04T10:43:46.179515+0000","last_fullsized":"2024-03-04T10:43:46.179515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'432","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:31.194588+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T10:44:31.194588+0000","last_peered":"2024-03-04T10:44:31.194588+0000","last_clean":"2024-03-04T10:44:31.194588+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T10:44:31.194588+0000","last_undegraded":"2024-03-04T10:44:31.194588+0000","last_fullsized":"2024-03-04T10:44:31.194588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21944,"num_write":403,"num_write_kb":30840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'307","reported_seq":379,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.205109+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T10:44:27.205109+0000","last_peered":"2024-03-04T10:44:27.205109+0000","last_clean":"2024-03-04T10:44:27.205109+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T10:44:27.205109+0000","last_undegraded":"2024-03-04T10:44:27.205109+0000","last_fullsized":"2024-03-04T10:44:27.205109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195474,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'398","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.220613+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T10:45:42.220613+0000","last_peered":"2024-03-04T10:45:42.220613+0000","last_clean":"2024-03-04T10:45:42.220613+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T10:45:42.220613+0000","last_undegraded":"2024-03-04T10:45:42.220613+0000","last_fullsized":"2024-03-04T10:45:42.220613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10206,"num_write":377,"num_write_kb":38425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":234,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:43.805315+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T10:43:43.805315+0000","last_peered":"2024-03-04T10:43:43.805315+0000","last_clean":"2024-03-04T10:43:43.805315+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T10:43:43.805315+0000","last_undegraded":"2024-03-04T10:43:43.805315+0000","last_fullsized":"2024-03-04T10:43:43.805315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'312","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:47.850069+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T10:44:47.850069+0000","last_peered":"2024-03-04T10:44:47.850069+0000","last_clean":"2024-03-04T10:44:47.850069+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T10:44:47.850069+0000","last_undegraded":"2024-03-04T10:44:47.850069+0000","last_fullsized":"2024-03-04T10:44:47.850069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'375","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.746305+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T10:45:48.746305+0000","last_peered":"2024-03-04T10:45:48.746305+0000","last_clean":"2024-03-04T10:45:48.746305+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T10:45:48.746305+0000","last_undegraded":"2024-03-04T10:45:48.746305+0000","last_fullsized":"2024-03-04T10:45:48.746305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":349,"num_write_kb":66462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'645","reported_seq":724,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:58.766583+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T10:45:58.766583+0000","last_peered":"2024-03-04T10:45:58.766583+0000","last_clean":"2024-03-04T10:45:58.766583+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T10:45:58.766583+0000","last_undegraded":"2024-03-04T10:45:58.766583+0000","last_fullsized":"2024-03-04T10:45:58.766583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":12616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'402","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.939376+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T10:45:59.939376+0000","last_peered":"2024-03-04T10:45:59.939376+0000","last_clean":"2024-03-04T10:45:59.939376+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T10:45:59.939376+0000","last_undegraded":"2024-03-04T10:45:59.939376+0000","last_fullsized":"2024-03-04T10:45:59.939376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":90482,"num_write":377,"num_write_kb":105458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1489","reported_seq":2982,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.715255+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T10:46:08.715255+0000","last_peered":"2024-03-04T10:46:08.715255+0000","last_clean":"2024-03-04T10:46:08.715255+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T10:46:08.715255+0000","last_undegraded":"2024-03-04T10:46:08.715255+0000","last_fullsized":"2024-03-04T10:46:08.715255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1489,"log_dups_size":0,"ondisk_log_size":1489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470369,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1417,"num_read_kb":2453,"num_write":1422,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'406","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.082596+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T10:46:00.082596+0000","last_peered":"2024-03-04T10:46:00.082596+0000","last_clean":"2024-03-04T10:46:00.082596+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T10:46:00.082596+0000","last_undegraded":"2024-03-04T10:46:00.082596+0000","last_fullsized":"2024-03-04T10:46:00.082596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":48072,"num_write":378,"num_write_kb":95952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'419","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:42:08.731313+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T10:42:08.731313+0000","last_peered":"2024-03-04T10:42:08.731313+0000","last_clean":"2024-03-04T10:42:08.731313+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T10:42:08.731313+0000","last_undegraded":"2024-03-04T10:42:08.731313+0000","last_fullsized":"2024-03-04T10:42:08.731313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":8389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'405","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.972460+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T10:45:59.972460+0000","last_peered":"2024-03-04T10:45:59.972460+0000","last_clean":"2024-03-04T10:45:59.972460+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T10:45:59.972460+0000","last_undegraded":"2024-03-04T10:45:59.972460+0000","last_fullsized":"2024-03-04T10:45:59.972460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":26782,"num_write":371,"num_write_kb":63203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'369","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:52.494232+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T10:43:52.494232+0000","last_peered":"2024-03-04T10:43:52.494232+0000","last_clean":"2024-03-04T10:43:52.494232+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T10:43:52.494232+0000","last_undegraded":"2024-03-04T10:43:52.494232+0000","last_fullsized":"2024-03-04T10:43:52.494232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'427","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.183663+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T10:45:42.183663+0000","last_peered":"2024-03-04T10:45:42.183663+0000","last_clean":"2024-03-04T10:45:42.183663+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T10:45:42.183663+0000","last_undegraded":"2024-03-04T10:45:42.183663+0000","last_fullsized":"2024-03-04T10:45:42.183663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":67320,"num_write":391,"num_write_kb":100010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'445","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.677853+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T10:45:37.677853+0000","last_peered":"2024-03-04T10:45:37.677853+0000","last_clean":"2024-03-04T10:45:37.677853+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T10:45:37.677853+0000","last_undegraded":"2024-03-04T10:45:37.677853+0000","last_fullsized":"2024-03-04T10:45:37.677853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'387","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.559731+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T10:45:41.559731+0000","last_peered":"2024-03-04T10:45:41.559731+0000","last_clean":"2024-03-04T10:45:41.559731+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T10:45:41.559731+0000","last_undegraded":"2024-03-04T10:45:41.559731+0000","last_fullsized":"2024-03-04T10:45:41.559731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":38107,"num_write":361,"num_write_kb":51817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'4113","reported_seq":4187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.726360+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T10:46:07.726360+0000","last_peered":"2024-03-04T10:46:07.726360+0000","last_clean":"2024-03-04T10:46:07.726360+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T10:46:07.726360+0000","last_undegraded":"2024-03-04T10:46:07.726360+0000","last_fullsized":"2024-03-04T10:46:07.726360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":0,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9076,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'347","reported_seq":425,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.869570+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T10:45:37.869570+0000","last_peered":"2024-03-04T10:45:37.869570+0000","last_clean":"2024-03-04T10:45:37.869570+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T10:45:37.869570+0000","last_undegraded":"2024-03-04T10:45:37.869570+0000","last_fullsized":"2024-03-04T10:45:37.869570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":326,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'340","reported_seq":414,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:28.752715+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T10:44:28.752715+0000","last_peered":"2024-03-04T10:44:28.752715+0000","last_clean":"2024-03-04T10:44:28.752715+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T10:44:28.752715+0000","last_undegraded":"2024-03-04T10:44:28.752715+0000","last_fullsized":"2024-03-04T10:44:28.752715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'432","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:32.267506+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T10:44:32.267506+0000","last_peered":"2024-03-04T10:44:32.267506+0000","last_clean":"2024-03-04T10:44:32.267506+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T10:44:32.267506+0000","last_undegraded":"2024-03-04T10:44:32.267506+0000","last_fullsized":"2024-03-04T10:44:32.267506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":107561,"num_write":401,"num_write_kb":141953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'188","reported_seq":262,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:02.763056+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T10:45:02.763056+0000","last_peered":"2024-03-04T10:45:02.763056+0000","last_clean":"2024-03-04T10:45:02.763056+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T10:45:02.763056+0000","last_undegraded":"2024-03-04T10:45:02.763056+0000","last_fullsized":"2024-03-04T10:45:02.763056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'435","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.929572+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T10:46:03.929572+0000","last_peered":"2024-03-04T10:46:03.929572+0000","last_clean":"2024-03-04T10:46:03.929572+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T10:46:03.929572+0000","last_undegraded":"2024-03-04T10:46:03.929572+0000","last_fullsized":"2024-03-04T10:46:03.929572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":57584,"num_write":412,"num_write_kb":99809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'422","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:56.938699+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T10:43:56.938699+0000","last_peered":"2024-03-04T10:43:56.938699+0000","last_clean":"2024-03-04T10:43:56.938699+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T10:43:56.938699+0000","last_undegraded":"2024-03-04T10:43:56.938699+0000","last_fullsized":"2024-03-04T10:43:56.938699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'391","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.607414+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T10:45:59.607414+0000","last_peered":"2024-03-04T10:45:59.607414+0000","last_clean":"2024-03-04T10:45:59.607414+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T10:45:59.607414+0000","last_undegraded":"2024-03-04T10:45:59.607414+0000","last_fullsized":"2024-03-04T10:45:59.607414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":13099,"num_write":371,"num_write_kb":42170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1143","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:36.565710+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T10:44:36.565710+0000","last_peered":"2024-03-04T10:44:36.565710+0000","last_clean":"2024-03-04T10:44:36.565710+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T10:44:36.565710+0000","last_undegraded":"2024-03-04T10:44:36.565710+0000","last_fullsized":"2024-03-04T10:44:36.565710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.926710+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T10:46:03.926710+0000","last_peered":"2024-03-04T10:46:03.926710+0000","last_clean":"2024-03-04T10:46:03.926710+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T10:46:03.926710+0000","last_undegraded":"2024-03-04T10:46:03.926710+0000","last_fullsized":"2024-03-04T10:46:03.926710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8812,"num_write":384,"num_write_kb":25790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1101","reported_seq":1173,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:23.752083+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T10:44:23.752083+0000","last_peered":"2024-03-04T10:44:23.752083+0000","last_clean":"2024-03-04T10:44:23.752083+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T10:44:23.752083+0000","last_undegraded":"2024-03-04T10:44:23.752083+0000","last_fullsized":"2024-03-04T10:44:23.752083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1045,"num_write_kb":12781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'428","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.743569+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T10:45:48.743569+0000","last_peered":"2024-03-04T10:45:48.743569+0000","last_clean":"2024-03-04T10:45:48.743569+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T10:45:48.743569+0000","last_undegraded":"2024-03-04T10:45:48.743569+0000","last_fullsized":"2024-03-04T10:45:48.743569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":39178,"num_write":404,"num_write_kb":64477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'394","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.228272+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T10:45:19.228272+0000","last_peered":"2024-03-04T10:45:19.228272+0000","last_clean":"2024-03-04T10:45:19.228272+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T10:45:19.228272+0000","last_undegraded":"2024-03-04T10:45:19.228272+0000","last_fullsized":"2024-03-04T10:45:19.228272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47257,"num_write":366,"num_write_kb":58992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'743","reported_seq":810,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:30.792066+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T10:44:30.792066+0000","last_peered":"2024-03-04T10:44:30.792066+0000","last_clean":"2024-03-04T10:44:30.792066+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T10:44:30.792066+0000","last_undegraded":"2024-03-04T10:44:30.792066+0000","last_fullsized":"2024-03-04T10:44:30.792066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'398","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.153259+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T10:45:19.153259+0000","last_peered":"2024-03-04T10:45:19.153259+0000","last_clean":"2024-03-04T10:45:19.153259+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T10:45:19.153259+0000","last_undegraded":"2024-03-04T10:45:19.153259+0000","last_fullsized":"2024-03-04T10:45:19.153259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":109003,"num_write":376,"num_write_kb":109132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1351","reported_seq":1418,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.257420+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T10:44:25.257420+0000","last_peered":"2024-03-04T10:44:25.257420+0000","last_clean":"2024-03-04T10:44:25.257420+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T10:44:25.257420+0000","last_undegraded":"2024-03-04T10:44:25.257420+0000","last_fullsized":"2024-03-04T10:44:25.257420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'366","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:32.476332+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T10:45:32.476332+0000","last_peered":"2024-03-04T10:45:32.476332+0000","last_clean":"2024-03-04T10:45:32.476332+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T10:45:32.476332+0000","last_undegraded":"2024-03-04T10:45:32.476332+0000","last_fullsized":"2024-03-04T10:45:32.476332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":85639,"num_write":344,"num_write_kb":59290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'544","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343090+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T10:45:48.343090+0000","last_peered":"2024-03-04T10:45:48.343090+0000","last_clean":"2024-03-04T10:45:48.343090+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T10:45:48.343090+0000","last_undegraded":"2024-03-04T10:45:48.343090+0000","last_fullsized":"2024-03-04T10:45:48.343090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'369","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.839193+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T10:45:59.839193+0000","last_peered":"2024-03-04T10:45:59.839193+0000","last_clean":"2024-03-04T10:45:59.839193+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T10:45:59.839193+0000","last_undegraded":"2024-03-04T10:45:59.839193+0000","last_fullsized":"2024-03-04T10:45:59.839193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":32203,"num_write":336,"num_write_kb":38117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'500","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:53.637263+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T10:45:53.637263+0000","last_peered":"2024-03-04T10:45:53.637263+0000","last_clean":"2024-03-04T10:45:53.637263+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T10:45:53.637263+0000","last_undegraded":"2024-03-04T10:45:53.637263+0000","last_fullsized":"2024-03-04T10:45:53.637263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22951,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":3491284,"num_write":24336,"num_write_kb":4342030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":27050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25939,"ondisk_log_size":25939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":215625583,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":1417,"num_read_kb":2453,"num_write":28732,"num_write_kb":225831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":431497216,"data_stored":431251166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25536,"ondisk_log_size":25536,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510846,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149460,"kb_used_data":86348,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94222380,"statfs":{"total":96636764160,"available":96483717120,"internally_reserved":0,"allocated":88420352,"data_stored":88200409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510847,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82268,"kb_used_data":33044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94289572,"statfs":{"total":96636764160,"available":96552521728,"internally_reserved":0,"allocated":33837056,"data_stored":33652338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510846,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121680,"kb_used_data":50248,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250160,"statfs":{"total":96636764160,"available":96512163840,"internally_reserved":0,"allocated":51453952,"data_stored":51261688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510846,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171936,"kb_used_data":82456,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199904,"statfs":{"total":96636764160,"available":96460701696,"internally_reserved":0,"allocated":84434944,"data_stored":84226164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543551,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101764,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270076,"statfs":{"total":96636764160,"available":96532557824,"internally_reserved":0,"allocated":35319808,"data_stored":35121154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78104,"kb_used_data":33040,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293736,"statfs":{"total":96636764160,"available":96556785664,"internally_reserved":0,"allocated":33832960,"data_stored":33652223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114556,"kb_used_data":51444,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":52678656,"data_stored":52488510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543552,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124984,"kb_used_data":53552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94246856,"statfs":{"total":96636764160,"available":96508780544,"internally_reserved":0,"allocated":54837248,"data_stored":54623873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84164608,"data_stored":84127350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50593792,"data_stored":50571790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33570816,"data_stored":33555172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88125440,"data_stored":88083106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54579200,"data_stored":54528462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51826688,"data_stored":51802731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33574912,"data_stored":33556812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35061760,"data_stored":35025743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":21892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T10:46:13.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T10:46:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.200+0000 7f23cf200640 1 Processor -- start 2024-03-04T10:46:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.200+0000 7f23cf200640 1 -- start start 2024-03-04T10:46:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.201+0000 7f23cf200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 0x7f23d00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.201+0000 7f23cf200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f23d00ca900 0x7f23d015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.201+0000 7f23cf200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.201+0000 7f23cf200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d015b310 con 0x7f23d00ca900 2024-03-04T10:46:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.201+0000 7f23cf200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d015c4d0 con 0x7f23d00d01b0 2024-03-04T10:46:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.201+0000 7f23cf200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d015a700 con 0x7f23d015c040 2024-03-04T10:46:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.202+0000 7f23ce800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.202+0000 7f23cd400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f23d00ca900 0x7f23d015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.202+0000 7f23cde00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 0x7f23d00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.203+0000 7f23cde00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 0x7f23d00ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47926/0 (socket says 172.21.15.46:47926) 2024-03-04T10:46:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.203+0000 7f23cde00640 1 -- 172.21.15.46:0/922999802 learned_addr learned my addr 172.21.15.46:0/922999802 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.203+0000 7f23ce800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d006d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44784/0 (socket says 172.21.15.46:44784) 2024-03-04T10:46:14.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.206+0000 7f23ce800640 1 -- 172.21.15.46:0/922999802 >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 msgr2=0x7f23d00ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:14.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.206+0000 7f23ce800640 1 --2- 172.21.15.46:0/922999802 >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 0x7f23d00ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.206+0000 7f23ce800640 1 -- 172.21.15.46:0/922999802 >> v2:172.21.15.46:3300/0 conn(0x7f23d00ca900 msgr2=0x7f23d015bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:14.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.206+0000 7f23ce800640 1 --2- 172.21.15.46:0/922999802 >> v2:172.21.15.46:3300/0 conn(0x7f23d00ca900 0x7f23d015bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.206+0000 7f23ce800640 1 -- 172.21.15.46:0/922999802 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d015a9e0 con 0x7f23d015c040 2024-03-04T10:46:14.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.206+0000 7f23cde00640 1 --2- 172.21.15.46:0/922999802 >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 0x7f23d00ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:14.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.209+0000 7f23ce800640 1 --2- 172.21.15.46:0/922999802 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d006d440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23d00cc420 tx=0x7f23c802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db94b678125fda0f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:14.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.213+0000 7f23cca00640 1 -- 172.21.15.46:0/922999802 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8035020 con 0x7f23d015c040 2024-03-04T10:46:14.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.213+0000 7f23cca00640 1 -- 172.21.15.46:0/922999802 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8031830 con 0x7f23d015c040 2024-03-04T10:46:14.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.213+0000 7f23cca00640 1 -- 172.21.15.46:0/922999802 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8031c00 con 0x7f23d015c040 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 -- 172.21.15.46:0/922999802 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 msgr2=0x7f23d006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 --2- 172.21.15.46:0/922999802 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d006d440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23d00cc420 tx=0x7f23c802b8d0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 -- 172.21.15.46:0/922999802 shutdown_connections 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 --2- 172.21.15.46:0/922999802 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d006d440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 --2- 172.21.15.46:0/922999802 >> v2:172.21.15.46:3300/0 conn(0x7f23d00ca900 0x7f23d015bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 --2- 172.21.15.46:0/922999802 >> v2:172.21.15.73:3300/0 conn(0x7f23d00d01b0 0x7f23d00ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 -- 172.21.15.46:0/922999802 >> 172.21.15.46:0/922999802 conn(0x7f23d0066c40 msgr2=0x7f23d0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:14.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 -- 172.21.15.46:0/922999802 shutdown_connections 2024-03-04T10:46:14.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.214+0000 7f23cf200640 1 -- 172.21.15.46:0/922999802 wait complete. 2024-03-04T10:46:14.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.216+0000 7f23cf200640 1 Processor -- start 2024-03-04T10:46:14.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.216+0000 7f23cf200640 1 -- start start 2024-03-04T10:46:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.217+0000 7f23cf200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d00ca900 0x7f23d00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.217+0000 7f23cf200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d00d01b0 0x7f23d01550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.217+0000 7f23cf200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d0155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.217+0000 7f23cf200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00d0590 con 0x7f23d00ca900 2024-03-04T10:46:14.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.217+0000 7f23cf200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d015afa0 con 0x7f23d00d01b0 2024-03-04T10:46:14.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.217+0000 7f23cf200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d015a3b0 con 0x7f23d015c040 2024-03-04T10:46:14.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.218+0000 7f23ce800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d0155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.218+0000 7f23cde00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d00ca900 0x7f23d00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.218+0000 7f23ce800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d0155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44790/0 (socket says 172.21.15.46:44790) 2024-03-04T10:46:14.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.218+0000 7f23ce800640 1 -- 172.21.15.46:0/2143479169 learned_addr learned my addr 172.21.15.46:0/2143479169 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.220+0000 7f23cd400640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d00d01b0 0x7f23d01550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.222+0000 7f23ce800640 1 -- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d00d01b0 msgr2=0x7f23d01550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:14.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.222+0000 7f23ce800640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d00d01b0 0x7f23d01550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.222+0000 7f23ce800640 1 -- 172.21.15.46:0/2143479169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d00ca900 msgr2=0x7f23d00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:14.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.222+0000 7f23ce800640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d00ca900 0x7f23d00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.222+0000 7f23ce800640 1 -- 172.21.15.46:0/2143479169 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0151bd0 con 0x7f23d015c040 2024-03-04T10:46:14.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.224+0000 7f23ce800640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d0155600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23c802bee0 tx=0x7f23c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:14.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.227+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8035040 con 0x7f23d015c040 2024-03-04T10:46:14.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.228+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c803b920 con 0x7f23d015c040 2024-03-04T10:46:14.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.228+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c803bd10 con 0x7f23d015c040 2024-03-04T10:46:14.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.228+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d0151eb0 con 0x7f23d015c040 2024-03-04T10:46:14.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.228+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d0153480 con 0x7f23d015c040 2024-03-04T10:46:14.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.229+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d004f330 con 0x7f23d015c040 2024-03-04T10:46:14.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.248+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f23c8038020 con 0x7f23d015c040 2024-03-04T10:46:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.248+0000 7f23c6000640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23ac06b550 0x7f23ac06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.249+0000 7f23cde00640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23ac06b550 0x7f23ac06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.250+0000 7f23cde00640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23ac06b550 0x7f23ac06da10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23c00072c0 tx=0x7f23c000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:14.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.506+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f23c80787d0 con 0x7f23d015c040 2024-03-04T10:46:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.524+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f23c807a730 con 0x7f23d015c040 2024-03-04T10:46:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.732+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23d0153680 con 0x7f23ac06b550 2024-03-04T10:46:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.739+0000 7f23c6000640 1 -- 172.21.15.46:0/2143479169 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254008 (secure 0 0 0) 0x7f23d0153680 con 0x7f23ac06b550 2024-03-04T10:46:14.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.743+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23ac06b550 msgr2=0x7f23ac06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.743+0000 7f23cf200640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23ac06b550 0x7f23ac06da10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23c00072c0 tx=0x7f23c000b040 comp rx=0 tx=0).stop 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.743+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 msgr2=0x7f23d0155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.743+0000 7f23cf200640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d0155600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23c802bee0 tx=0x7f23c80046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 shutdown_connections 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f23ac06b550 0x7f23ac06da10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d00d01b0 0x7f23d01550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d015c040 0x7f23d0155600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 --2- 172.21.15.46:0/2143479169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d00ca900 0x7f23d00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 >> 172.21.15.46:0/2143479169 conn(0x7f23d0066c40 msgr2=0x7f23d0158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 shutdown_connections 2024-03-04T10:46:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.744+0000 7f23cf200640 1 -- 172.21.15.46:0/2143479169 wait complete. 2024-03-04T10:46:14.764 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":3526,"stamp":"2024-03-04T10:46:12.845789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216238902,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":2670,"num_read_kb":3493837,"num_write":53227,"num_write_kb":4570277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51592,"ondisk_log_size":51592,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":944752,"kb_used_data":424624,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754029968,"statfs":{"total":773094113280,"available":772126687232,"internally_reserved":0,"allocated":434814976,"data_stored":433226359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":532532785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-291388,"num_objects":-67,"num_object_clones":0,"num_object_copies":-134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-67,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":116,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002480"},"pg_stats":[{"pgid":"3.3f","version":"25'422","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.792912+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T10:45:59.792912+0000","last_peered":"2024-03-04T10:45:59.792912+0000","last_clean":"2024-03-04T10:45:59.792912+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T10:45:59.792912+0000","last_undegraded":"2024-03-04T10:45:59.792912+0000","last_fullsized":"2024-03-04T10:45:59.792912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":56779,"num_write":405,"num_write_kb":75850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'414","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.556150+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T10:45:41.556150+0000","last_peered":"2024-03-04T10:45:41.556150+0000","last_clean":"2024-03-04T10:45:41.556150+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T10:45:41.556150+0000","last_undegraded":"2024-03-04T10:45:41.556150+0000","last_fullsized":"2024-03-04T10:45:41.556150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68736,"num_write":382,"num_write_kb":71625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'371","reported_seq":451,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.747145+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T10:45:41.747145+0000","last_peered":"2024-03-04T10:45:41.747145+0000","last_clean":"2024-03-04T10:45:41.747145+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T10:45:41.747145+0000","last_undegraded":"2024-03-04T10:45:41.747145+0000","last_fullsized":"2024-03-04T10:45:41.747145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24226,"num_write":349,"num_write_kb":62283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'358","reported_seq":448,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.279356+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T10:45:42.279356+0000","last_peered":"2024-03-04T10:45:42.279356+0000","last_clean":"2024-03-04T10:45:42.279356+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T10:45:42.279356+0000","last_undegraded":"2024-03-04T10:45:42.279356+0000","last_fullsized":"2024-03-04T10:45:42.279356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":47711,"num_write":338,"num_write_kb":33889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'438","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.364908+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T10:45:59.364908+0000","last_peered":"2024-03-04T10:45:59.364908+0000","last_clean":"2024-03-04T10:45:59.364908+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T10:45:59.364908+0000","last_undegraded":"2024-03-04T10:45:59.364908+0000","last_fullsized":"2024-03-04T10:45:59.364908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":161798,"num_write":413,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'371","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.189408+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T10:45:19.189408+0000","last_peered":"2024-03-04T10:45:19.189408+0000","last_clean":"2024-03-04T10:45:19.189408+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T10:45:19.189408+0000","last_undegraded":"2024-03-04T10:45:19.189408+0000","last_fullsized":"2024-03-04T10:45:19.189408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":34885,"num_write":351,"num_write_kb":34327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'378","reported_seq":464,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.830558+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T10:45:37.830558+0000","last_peered":"2024-03-04T10:45:37.830558+0000","last_clean":"2024-03-04T10:45:37.830558+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T10:45:37.830558+0000","last_undegraded":"2024-03-04T10:45:37.830558+0000","last_fullsized":"2024-03-04T10:45:37.830558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":76194,"num_write":351,"num_write_kb":54499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'351","reported_seq":430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.799112+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T10:45:37.799112+0000","last_peered":"2024-03-04T10:45:37.799112+0000","last_clean":"2024-03-04T10:45:37.799112+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T10:45:37.799112+0000","last_undegraded":"2024-03-04T10:45:37.799112+0000","last_fullsized":"2024-03-04T10:45:37.799112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26383,"num_write":323,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'396","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:58.824658+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T10:45:58.824658+0000","last_peered":"2024-03-04T10:45:58.824658+0000","last_clean":"2024-03-04T10:45:58.824658+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T10:45:58.824658+0000","last_undegraded":"2024-03-04T10:45:58.824658+0000","last_fullsized":"2024-03-04T10:45:58.824658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20946,"num_write":374,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'401","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.742454+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T10:45:43.742454+0000","last_peered":"2024-03-04T10:45:43.742454+0000","last_clean":"2024-03-04T10:45:43.742454+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T10:45:43.742454+0000","last_undegraded":"2024-03-04T10:45:43.742454+0000","last_fullsized":"2024-03-04T10:45:43.742454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":17641,"num_write":374,"num_write_kb":26355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'381","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.742405+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T10:45:43.742405+0000","last_peered":"2024-03-04T10:45:43.742405+0000","last_clean":"2024-03-04T10:45:43.742405+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T10:45:43.742405+0000","last_undegraded":"2024-03-04T10:45:43.742405+0000","last_fullsized":"2024-03-04T10:45:43.742405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":63408,"num_write":366,"num_write_kb":59321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'353","reported_seq":434,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.742346+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T10:45:43.742346+0000","last_peered":"2024-03-04T10:45:43.742346+0000","last_clean":"2024-03-04T10:45:43.742346+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T10:45:43.742346+0000","last_undegraded":"2024-03-04T10:45:43.742346+0000","last_fullsized":"2024-03-04T10:45:43.742346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":49283,"num_write":340,"num_write_kb":63175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'401","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.211189+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T10:45:42.211189+0000","last_peered":"2024-03-04T10:45:42.211189+0000","last_clean":"2024-03-04T10:45:42.211189+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T10:45:42.211189+0000","last_undegraded":"2024-03-04T10:45:42.211189+0000","last_fullsized":"2024-03-04T10:45:42.211189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":54416,"num_write":375,"num_write_kb":38585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'385","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.967894+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T10:45:59.967894+0000","last_peered":"2024-03-04T10:45:59.967894+0000","last_clean":"2024-03-04T10:45:59.967894+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T10:45:59.967894+0000","last_undegraded":"2024-03-04T10:45:59.967894+0000","last_fullsized":"2024-03-04T10:45:59.967894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29624,"num_write":360,"num_write_kb":30114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'404","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.450739+0000","last_change":"2024-03-04T08:50:12.592750+0000","last_active":"2024-03-04T10:45:48.450739+0000","last_peered":"2024-03-04T10:45:48.450739+0000","last_clean":"2024-03-04T10:45:48.450739+0000","last_became_active":"2024-03-04T08:50:12.592374+0000","last_became_peered":"2024-03-04T08:50:12.592374+0000","last_unstale":"2024-03-04T10:45:48.450739+0000","last_undegraded":"2024-03-04T10:45:48.450739+0000","last_fullsized":"2024-03-04T10:45:48.450739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:28.147260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":71598,"num_write":369,"num_write_kb":67511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'416","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.479069+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T10:45:19.479069+0000","last_peered":"2024-03-04T10:45:19.479069+0000","last_clean":"2024-03-04T10:45:19.479069+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T10:45:19.479069+0000","last_undegraded":"2024-03-04T10:45:19.479069+0000","last_fullsized":"2024-03-04T10:45:19.479069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":49152,"num_write":389,"num_write_kb":58855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'431","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.908110+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T10:45:41.908110+0000","last_peered":"2024-03-04T10:45:41.908110+0000","last_clean":"2024-03-04T10:45:41.908110+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T10:45:41.908110+0000","last_undegraded":"2024-03-04T10:45:41.908110+0000","last_fullsized":"2024-03-04T10:45:41.908110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":66011,"num_write":406,"num_write_kb":96427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'407","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.630967+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T10:45:31.630967+0000","last_peered":"2024-03-04T10:45:31.630967+0000","last_clean":"2024-03-04T10:45:31.630967+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T10:45:31.630967+0000","last_undegraded":"2024-03-04T10:45:31.630967+0000","last_fullsized":"2024-03-04T10:45:31.630967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":44968,"num_write":370,"num_write_kb":71715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'421","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.750105+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T10:45:41.750105+0000","last_peered":"2024-03-04T10:45:41.750105+0000","last_clean":"2024-03-04T10:45:41.750105+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T10:45:41.750105+0000","last_undegraded":"2024-03-04T10:45:41.750105+0000","last_fullsized":"2024-03-04T10:45:41.750105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":73465,"num_write":395,"num_write_kb":100388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'430","reported_seq":517,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.568280+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T10:45:48.568280+0000","last_peered":"2024-03-04T10:45:48.568280+0000","last_clean":"2024-03-04T10:45:48.568280+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T10:45:48.568280+0000","last_undegraded":"2024-03-04T10:45:48.568280+0000","last_fullsized":"2024-03-04T10:45:48.568280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":62456,"num_write":411,"num_write_kb":51118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'412","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.750379+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T10:45:24.750379+0000","last_peered":"2024-03-04T10:45:24.750379+0000","last_clean":"2024-03-04T10:45:24.750379+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T10:45:24.750379+0000","last_undegraded":"2024-03-04T10:45:24.750379+0000","last_fullsized":"2024-03-04T10:45:24.750379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":56958,"num_write":379,"num_write_kb":88435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'427","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.746818+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T10:45:59.746818+0000","last_peered":"2024-03-04T10:45:59.746818+0000","last_clean":"2024-03-04T10:45:59.746818+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T10:45:59.746818+0000","last_undegraded":"2024-03-04T10:45:59.746818+0000","last_fullsized":"2024-03-04T10:45:59.746818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84454,"num_write":409,"num_write_kb":67704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'384","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343973+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T10:45:48.343973+0000","last_peered":"2024-03-04T10:45:48.343973+0000","last_clean":"2024-03-04T10:45:48.343973+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T10:45:48.343973+0000","last_undegraded":"2024-03-04T10:45:48.343973+0000","last_fullsized":"2024-03-04T10:45:48.343973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15942,"num_write":359,"num_write_kb":55013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.015140+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T10:46:00.015140+0000","last_peered":"2024-03-04T10:46:00.015140+0000","last_clean":"2024-03-04T10:46:00.015140+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T10:46:00.015140+0000","last_undegraded":"2024-03-04T10:46:00.015140+0000","last_fullsized":"2024-03-04T10:46:00.015140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18489,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":47415,"num_write":403,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'414","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.799178+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T10:45:37.799178+0000","last_peered":"2024-03-04T10:45:37.799178+0000","last_clean":"2024-03-04T10:45:37.799178+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T10:45:37.799178+0000","last_undegraded":"2024-03-04T10:45:37.799178+0000","last_fullsized":"2024-03-04T10:45:37.799178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49227,"num_write":397,"num_write_kb":80014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'498","reported_seq":596,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.280181+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T10:45:42.280181+0000","last_peered":"2024-03-04T10:45:42.280181+0000","last_clean":"2024-03-04T10:45:42.280181+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T10:45:42.280181+0000","last_undegraded":"2024-03-04T10:45:42.280181+0000","last_fullsized":"2024-03-04T10:45:42.280181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":78376,"num_write":475,"num_write_kb":113705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'424","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.742945+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T10:45:41.742945+0000","last_peered":"2024-03-04T10:45:41.742945+0000","last_clean":"2024-03-04T10:45:41.742945+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T10:45:41.742945+0000","last_undegraded":"2024-03-04T10:45:41.742945+0000","last_fullsized":"2024-03-04T10:45:41.742945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75663,"num_write":396,"num_write_kb":55800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'365","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.743746+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T10:45:41.743746+0000","last_peered":"2024-03-04T10:45:41.743746+0000","last_clean":"2024-03-04T10:45:41.743746+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T10:45:41.743746+0000","last_undegraded":"2024-03-04T10:45:41.743746+0000","last_fullsized":"2024-03-04T10:45:41.743746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":29309,"num_write":341,"num_write_kb":42443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'374","reported_seq":462,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.479777+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T10:45:48.479777+0000","last_peered":"2024-03-04T10:45:48.479777+0000","last_clean":"2024-03-04T10:45:48.479777+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T10:45:48.479777+0000","last_undegraded":"2024-03-04T10:45:48.479777+0000","last_fullsized":"2024-03-04T10:45:48.479777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44796,"num_write":353,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'477","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.783241+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T10:45:59.783241+0000","last_peered":"2024-03-04T10:45:59.783241+0000","last_clean":"2024-03-04T10:45:59.783241+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T10:45:59.783241+0000","last_undegraded":"2024-03-04T10:45:59.783241+0000","last_fullsized":"2024-03-04T10:45:59.783241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":91221,"num_write":448,"num_write_kb":101088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'453","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.360760+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T10:45:59.360760+0000","last_peered":"2024-03-04T10:45:59.360760+0000","last_clean":"2024-03-04T10:45:59.360760+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T10:45:59.360760+0000","last_undegraded":"2024-03-04T10:45:59.360760+0000","last_fullsized":"2024-03-04T10:45:59.360760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":144837,"num_write":435,"num_write_kb":130358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'443","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:58.341379+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T10:44:58.341379+0000","last_peered":"2024-03-04T10:44:58.341379+0000","last_clean":"2024-03-04T10:44:58.341379+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T10:44:58.341379+0000","last_undegraded":"2024-03-04T10:44:58.341379+0000","last_fullsized":"2024-03-04T10:44:58.341379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23611,"num_write":420,"num_write_kb":59471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'410","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.604123+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T10:45:59.604123+0000","last_peered":"2024-03-04T10:45:59.604123+0000","last_clean":"2024-03-04T10:45:59.604123+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T10:45:59.604123+0000","last_undegraded":"2024-03-04T10:45:59.604123+0000","last_fullsized":"2024-03-04T10:45:59.604123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":42800,"num_write":385,"num_write_kb":71334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'238","reported_seq":305,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.853775+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T10:44:25.853775+0000","last_peered":"2024-03-04T10:44:25.853775+0000","last_clean":"2024-03-04T10:44:25.853775+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T10:44:25.853775+0000","last_undegraded":"2024-03-04T10:44:25.853775+0000","last_fullsized":"2024-03-04T10:44:25.853775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'361","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.925278+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T10:45:59.925278+0000","last_peered":"2024-03-04T10:45:59.925278+0000","last_clean":"2024-03-04T10:45:59.925278+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T10:45:59.925278+0000","last_undegraded":"2024-03-04T10:45:59.925278+0000","last_fullsized":"2024-03-04T10:45:59.925278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32809,"num_write":342,"num_write_kb":54741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1403","reported_seq":1470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:47.849996+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T10:44:47.849996+0000","last_peered":"2024-03-04T10:44:47.849996+0000","last_clean":"2024-03-04T10:44:47.849996+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T10:44:47.849996+0000","last_undegraded":"2024-03-04T10:44:47.849996+0000","last_fullsized":"2024-03-04T10:44:47.849996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":17039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'794","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.213101+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T10:46:07.213101+0000","last_peered":"2024-03-04T10:46:07.213101+0000","last_clean":"2024-03-04T10:46:07.213101+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T10:46:07.213101+0000","last_undegraded":"2024-03-04T10:46:07.213101+0000","last_fullsized":"2024-03-04T10:46:07.213101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'439","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.097530+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T10:46:00.097530+0000","last_peered":"2024-03-04T10:46:00.097530+0000","last_clean":"2024-03-04T10:46:00.097530+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T10:46:00.097530+0000","last_undegraded":"2024-03-04T10:46:00.097530+0000","last_fullsized":"2024-03-04T10:46:00.097530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":27702,"num_write":417,"num_write_kb":42496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1108","reported_seq":1177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.513140+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T10:45:24.513140+0000","last_peered":"2024-03-04T10:45:24.513140+0000","last_clean":"2024-03-04T10:45:24.513140+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T10:45:24.513140+0000","last_undegraded":"2024-03-04T10:45:24.513140+0000","last_fullsized":"2024-03-04T10:45:24.513140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":12803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'401","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.554301+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T10:45:41.554301+0000","last_peered":"2024-03-04T10:45:41.554301+0000","last_clean":"2024-03-04T10:45:41.554301+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T10:45:41.554301+0000","last_undegraded":"2024-03-04T10:45:41.554301+0000","last_fullsized":"2024-03-04T10:45:41.554301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":31518,"num_write":380,"num_write_kb":54868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'67","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.328254+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T10:45:31.328254+0000","last_peered":"2024-03-04T10:45:31.328254+0000","last_clean":"2024-03-04T10:45:31.328254+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T10:45:31.328254+0000","last_undegraded":"2024-03-04T10:45:31.328254+0000","last_fullsized":"2024-03-04T10:45:31.328254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'448","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:43.617955+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T10:45:43.617955+0000","last_peered":"2024-03-04T10:45:43.617955+0000","last_clean":"2024-03-04T10:45:43.617955+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T10:45:43.617955+0000","last_undegraded":"2024-03-04T10:45:43.617955+0000","last_fullsized":"2024-03-04T10:45:43.617955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68599,"num_write":425,"num_write_kb":83547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1152","reported_seq":1221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.193839+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T10:46:07.193839+0000","last_peered":"2024-03-04T10:46:07.193839+0000","last_clean":"2024-03-04T10:46:07.193839+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T10:46:07.193839+0000","last_undegraded":"2024-03-04T10:46:07.193839+0000","last_fullsized":"2024-03-04T10:46:07.193839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12821640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":13069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'395","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.348834+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T10:45:42.348834+0000","last_peered":"2024-03-04T10:45:42.348834+0000","last_clean":"2024-03-04T10:45:42.348834+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T10:45:42.348834+0000","last_undegraded":"2024-03-04T10:45:42.348834+0000","last_fullsized":"2024-03-04T10:45:42.348834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":69489,"num_write":372,"num_write_kb":99199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1617","reported_seq":1686,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:04.086239+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T10:46:04.086239+0000","last_peered":"2024-03-04T10:46:04.086239+0000","last_clean":"2024-03-04T10:46:04.086239+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T10:46:04.086239+0000","last_undegraded":"2024-03-04T10:46:04.086239+0000","last_fullsized":"2024-03-04T10:46:04.086239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":9396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.558451+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T10:45:48.558451+0000","last_peered":"2024-03-04T10:45:48.558451+0000","last_clean":"2024-03-04T10:45:48.558451+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T10:45:48.558451+0000","last_undegraded":"2024-03-04T10:45:48.558451+0000","last_fullsized":"2024-03-04T10:45:48.558451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":58935,"num_write":368,"num_write_kb":66938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1669","reported_seq":1739,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.837377+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T10:45:41.837377+0000","last_peered":"2024-03-04T10:45:41.837377+0000","last_clean":"2024-03-04T10:45:41.837377+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T10:45:41.837377+0000","last_undegraded":"2024-03-04T10:45:41.837377+0000","last_fullsized":"2024-03-04T10:45:41.837377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1669,"log_dups_size":0,"ondisk_log_size":1669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1619,"num_write_kb":13254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'384","reported_seq":465,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.604440+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T10:45:24.604440+0000","last_peered":"2024-03-04T10:45:24.604440+0000","last_clean":"2024-03-04T10:45:24.604440+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T10:45:24.604440+0000","last_undegraded":"2024-03-04T10:45:24.604440+0000","last_fullsized":"2024-03-04T10:45:24.604440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":52325,"num_write":353,"num_write_kb":55067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'325","reported_seq":395,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:02.302876+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T10:44:02.302876+0000","last_peered":"2024-03-04T10:44:02.302876+0000","last_clean":"2024-03-04T10:44:02.302876+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T10:44:02.302876+0000","last_undegraded":"2024-03-04T10:44:02.302876+0000","last_fullsized":"2024-03-04T10:44:02.302876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":8340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'406","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.705416+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T10:45:24.705416+0000","last_peered":"2024-03-04T10:45:24.705416+0000","last_clean":"2024-03-04T10:45:24.705416+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T10:45:24.705416+0000","last_undegraded":"2024-03-04T10:45:24.705416+0000","last_fullsized":"2024-03-04T10:45:24.705416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":41706,"num_write":387,"num_write_kb":84154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:37.275661+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T10:44:37.275661+0000","last_peered":"2024-03-04T10:44:37.275661+0000","last_clean":"2024-03-04T10:44:37.275661+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T10:44:37.275661+0000","last_undegraded":"2024-03-04T10:44:37.275661+0000","last_fullsized":"2024-03-04T10:44:37.275661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'402","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.219628+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T10:45:42.219628+0000","last_peered":"2024-03-04T10:45:42.219628+0000","last_clean":"2024-03-04T10:45:42.219628+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T10:45:42.219628+0000","last_undegraded":"2024-03-04T10:45:42.219628+0000","last_fullsized":"2024-03-04T10:45:42.219628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3125,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":71159,"num_write":381,"num_write_kb":34363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'67","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:03.474568+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T10:44:03.474568+0000","last_peered":"2024-03-04T10:44:03.474568+0000","last_clean":"2024-03-04T10:44:03.474568+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T10:44:03.474568+0000","last_undegraded":"2024-03-04T10:44:03.474568+0000","last_fullsized":"2024-03-04T10:44:03.474568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'440","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.776566+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T10:46:08.776566+0000","last_peered":"2024-03-04T10:46:08.776566+0000","last_clean":"2024-03-04T10:46:08.776566+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T10:46:08.776566+0000","last_undegraded":"2024-03-04T10:46:08.776566+0000","last_fullsized":"2024-03-04T10:46:08.776566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":111394,"num_write":416,"num_write_kb":109040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'823","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:18.871918+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T10:44:18.871918+0000","last_peered":"2024-03-04T10:44:18.871918+0000","last_clean":"2024-03-04T10:44:18.871918+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T10:44:18.871918+0000","last_undegraded":"2024-03-04T10:44:18.871918+0000","last_fullsized":"2024-03-04T10:44:18.871918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":8544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'472","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.894666+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T10:46:03.894666+0000","last_peered":"2024-03-04T10:46:03.894666+0000","last_clean":"2024-03-04T10:46:03.894666+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T10:46:03.894666+0000","last_undegraded":"2024-03-04T10:46:03.894666+0000","last_fullsized":"2024-03-04T10:46:03.894666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":59537,"num_write":439,"num_write_kb":76319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'752","reported_seq":824,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:38.732774+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T10:44:38.732774+0000","last_peered":"2024-03-04T10:44:38.732774+0000","last_clean":"2024-03-04T10:44:38.732774+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T10:44:38.732774+0000","last_undegraded":"2024-03-04T10:44:38.732774+0000","last_fullsized":"2024-03-04T10:44:38.732774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'369","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.481915+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T10:45:31.481915+0000","last_peered":"2024-03-04T10:45:31.481915+0000","last_clean":"2024-03-04T10:45:31.481915+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T10:45:31.481915+0000","last_undegraded":"2024-03-04T10:45:31.481915+0000","last_fullsized":"2024-03-04T10:45:31.481915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":68174,"num_write":341,"num_write_kb":71100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'821","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.267058+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T10:44:27.267058+0000","last_peered":"2024-03-04T10:44:27.267058+0000","last_clean":"2024-03-04T10:44:27.267058+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T10:44:27.267058+0000","last_undegraded":"2024-03-04T10:44:27.267058+0000","last_fullsized":"2024-03-04T10:44:27.267058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'375","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:14.759936+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T10:45:14.759936+0000","last_peered":"2024-03-04T10:45:14.759936+0000","last_clean":"2024-03-04T10:45:14.759936+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T10:45:14.759936+0000","last_undegraded":"2024-03-04T10:45:14.759936+0000","last_fullsized":"2024-03-04T10:45:14.759936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":53055,"num_write":347,"num_write_kb":59070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'206","reported_seq":278,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:46.179515+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T10:43:46.179515+0000","last_peered":"2024-03-04T10:43:46.179515+0000","last_clean":"2024-03-04T10:43:46.179515+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T10:43:46.179515+0000","last_undegraded":"2024-03-04T10:43:46.179515+0000","last_fullsized":"2024-03-04T10:43:46.179515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'432","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:31.194588+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T10:44:31.194588+0000","last_peered":"2024-03-04T10:44:31.194588+0000","last_clean":"2024-03-04T10:44:31.194588+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T10:44:31.194588+0000","last_undegraded":"2024-03-04T10:44:31.194588+0000","last_fullsized":"2024-03-04T10:44:31.194588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21944,"num_write":403,"num_write_kb":30840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'307","reported_seq":379,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.205109+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T10:44:27.205109+0000","last_peered":"2024-03-04T10:44:27.205109+0000","last_clean":"2024-03-04T10:44:27.205109+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T10:44:27.205109+0000","last_undegraded":"2024-03-04T10:44:27.205109+0000","last_fullsized":"2024-03-04T10:44:27.205109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195474,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'398","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.220613+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T10:45:42.220613+0000","last_peered":"2024-03-04T10:45:42.220613+0000","last_clean":"2024-03-04T10:45:42.220613+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T10:45:42.220613+0000","last_undegraded":"2024-03-04T10:45:42.220613+0000","last_fullsized":"2024-03-04T10:45:42.220613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10206,"num_write":377,"num_write_kb":38425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":234,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:43.805315+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T10:43:43.805315+0000","last_peered":"2024-03-04T10:43:43.805315+0000","last_clean":"2024-03-04T10:43:43.805315+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T10:43:43.805315+0000","last_undegraded":"2024-03-04T10:43:43.805315+0000","last_fullsized":"2024-03-04T10:43:43.805315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'312","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:47.850069+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T10:44:47.850069+0000","last_peered":"2024-03-04T10:44:47.850069+0000","last_clean":"2024-03-04T10:44:47.850069+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T10:44:47.850069+0000","last_undegraded":"2024-03-04T10:44:47.850069+0000","last_fullsized":"2024-03-04T10:44:47.850069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'375","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.746305+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T10:45:48.746305+0000","last_peered":"2024-03-04T10:45:48.746305+0000","last_clean":"2024-03-04T10:45:48.746305+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T10:45:48.746305+0000","last_undegraded":"2024-03-04T10:45:48.746305+0000","last_fullsized":"2024-03-04T10:45:48.746305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":349,"num_write_kb":66462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'645","reported_seq":724,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:58.766583+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T10:45:58.766583+0000","last_peered":"2024-03-04T10:45:58.766583+0000","last_clean":"2024-03-04T10:45:58.766583+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T10:45:58.766583+0000","last_undegraded":"2024-03-04T10:45:58.766583+0000","last_fullsized":"2024-03-04T10:45:58.766583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":12616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'402","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.939376+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T10:45:59.939376+0000","last_peered":"2024-03-04T10:45:59.939376+0000","last_clean":"2024-03-04T10:45:59.939376+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T10:45:59.939376+0000","last_undegraded":"2024-03-04T10:45:59.939376+0000","last_fullsized":"2024-03-04T10:45:59.939376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":90482,"num_write":377,"num_write_kb":105458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1489","reported_seq":2982,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.715255+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T10:46:08.715255+0000","last_peered":"2024-03-04T10:46:08.715255+0000","last_clean":"2024-03-04T10:46:08.715255+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T10:46:08.715255+0000","last_undegraded":"2024-03-04T10:46:08.715255+0000","last_fullsized":"2024-03-04T10:46:08.715255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1489,"log_dups_size":0,"ondisk_log_size":1489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470369,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1417,"num_read_kb":2453,"num_write":1422,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'406","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.082596+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T10:46:00.082596+0000","last_peered":"2024-03-04T10:46:00.082596+0000","last_clean":"2024-03-04T10:46:00.082596+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T10:46:00.082596+0000","last_undegraded":"2024-03-04T10:46:00.082596+0000","last_fullsized":"2024-03-04T10:46:00.082596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":48072,"num_write":378,"num_write_kb":95952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'419","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:42:08.731313+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T10:42:08.731313+0000","last_peered":"2024-03-04T10:42:08.731313+0000","last_clean":"2024-03-04T10:42:08.731313+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T10:42:08.731313+0000","last_undegraded":"2024-03-04T10:42:08.731313+0000","last_fullsized":"2024-03-04T10:42:08.731313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":8389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'405","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.972460+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T10:45:59.972460+0000","last_peered":"2024-03-04T10:45:59.972460+0000","last_clean":"2024-03-04T10:45:59.972460+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T10:45:59.972460+0000","last_undegraded":"2024-03-04T10:45:59.972460+0000","last_fullsized":"2024-03-04T10:45:59.972460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":26782,"num_write":371,"num_write_kb":63203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'369","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:52.494232+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T10:43:52.494232+0000","last_peered":"2024-03-04T10:43:52.494232+0000","last_clean":"2024-03-04T10:43:52.494232+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T10:43:52.494232+0000","last_undegraded":"2024-03-04T10:43:52.494232+0000","last_fullsized":"2024-03-04T10:43:52.494232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'427","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.183663+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T10:45:42.183663+0000","last_peered":"2024-03-04T10:45:42.183663+0000","last_clean":"2024-03-04T10:45:42.183663+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T10:45:42.183663+0000","last_undegraded":"2024-03-04T10:45:42.183663+0000","last_fullsized":"2024-03-04T10:45:42.183663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":67320,"num_write":391,"num_write_kb":100010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'445","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.677853+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T10:45:37.677853+0000","last_peered":"2024-03-04T10:45:37.677853+0000","last_clean":"2024-03-04T10:45:37.677853+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T10:45:37.677853+0000","last_undegraded":"2024-03-04T10:45:37.677853+0000","last_fullsized":"2024-03-04T10:45:37.677853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'387","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.559731+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T10:45:41.559731+0000","last_peered":"2024-03-04T10:45:41.559731+0000","last_clean":"2024-03-04T10:45:41.559731+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T10:45:41.559731+0000","last_undegraded":"2024-03-04T10:45:41.559731+0000","last_fullsized":"2024-03-04T10:45:41.559731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":38107,"num_write":361,"num_write_kb":51817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'4113","reported_seq":4187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.726360+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T10:46:07.726360+0000","last_peered":"2024-03-04T10:46:07.726360+0000","last_clean":"2024-03-04T10:46:07.726360+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T10:46:07.726360+0000","last_undegraded":"2024-03-04T10:46:07.726360+0000","last_fullsized":"2024-03-04T10:46:07.726360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":0,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9076,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'347","reported_seq":425,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.869570+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T10:45:37.869570+0000","last_peered":"2024-03-04T10:45:37.869570+0000","last_clean":"2024-03-04T10:45:37.869570+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T10:45:37.869570+0000","last_undegraded":"2024-03-04T10:45:37.869570+0000","last_fullsized":"2024-03-04T10:45:37.869570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":326,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'340","reported_seq":414,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:28.752715+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T10:44:28.752715+0000","last_peered":"2024-03-04T10:44:28.752715+0000","last_clean":"2024-03-04T10:44:28.752715+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T10:44:28.752715+0000","last_undegraded":"2024-03-04T10:44:28.752715+0000","last_fullsized":"2024-03-04T10:44:28.752715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'432","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:32.267506+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T10:44:32.267506+0000","last_peered":"2024-03-04T10:44:32.267506+0000","last_clean":"2024-03-04T10:44:32.267506+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T10:44:32.267506+0000","last_undegraded":"2024-03-04T10:44:32.267506+0000","last_fullsized":"2024-03-04T10:44:32.267506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":107561,"num_write":401,"num_write_kb":141953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'188","reported_seq":262,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:02.763056+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T10:45:02.763056+0000","last_peered":"2024-03-04T10:45:02.763056+0000","last_clean":"2024-03-04T10:45:02.763056+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T10:45:02.763056+0000","last_undegraded":"2024-03-04T10:45:02.763056+0000","last_fullsized":"2024-03-04T10:45:02.763056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'435","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.929572+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T10:46:03.929572+0000","last_peered":"2024-03-04T10:46:03.929572+0000","last_clean":"2024-03-04T10:46:03.929572+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T10:46:03.929572+0000","last_undegraded":"2024-03-04T10:46:03.929572+0000","last_fullsized":"2024-03-04T10:46:03.929572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":57584,"num_write":412,"num_write_kb":99809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'422","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:56.938699+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T10:43:56.938699+0000","last_peered":"2024-03-04T10:43:56.938699+0000","last_clean":"2024-03-04T10:43:56.938699+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T10:43:56.938699+0000","last_undegraded":"2024-03-04T10:43:56.938699+0000","last_fullsized":"2024-03-04T10:43:56.938699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'391","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.607414+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T10:45:59.607414+0000","last_peered":"2024-03-04T10:45:59.607414+0000","last_clean":"2024-03-04T10:45:59.607414+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T10:45:59.607414+0000","last_undegraded":"2024-03-04T10:45:59.607414+0000","last_fullsized":"2024-03-04T10:45:59.607414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":13099,"num_write":371,"num_write_kb":42170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1143","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:36.565710+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T10:44:36.565710+0000","last_peered":"2024-03-04T10:44:36.565710+0000","last_clean":"2024-03-04T10:44:36.565710+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T10:44:36.565710+0000","last_undegraded":"2024-03-04T10:44:36.565710+0000","last_fullsized":"2024-03-04T10:44:36.565710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.926710+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T10:46:03.926710+0000","last_peered":"2024-03-04T10:46:03.926710+0000","last_clean":"2024-03-04T10:46:03.926710+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T10:46:03.926710+0000","last_undegraded":"2024-03-04T10:46:03.926710+0000","last_fullsized":"2024-03-04T10:46:03.926710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8812,"num_write":384,"num_write_kb":25790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1101","reported_seq":1173,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:23.752083+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T10:44:23.752083+0000","last_peered":"2024-03-04T10:44:23.752083+0000","last_clean":"2024-03-04T10:44:23.752083+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T10:44:23.752083+0000","last_undegraded":"2024-03-04T10:44:23.752083+0000","last_fullsized":"2024-03-04T10:44:23.752083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1045,"num_write_kb":12781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'428","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.743569+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T10:45:48.743569+0000","last_peered":"2024-03-04T10:45:48.743569+0000","last_clean":"2024-03-04T10:45:48.743569+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T10:45:48.743569+0000","last_undegraded":"2024-03-04T10:45:48.743569+0000","last_fullsized":"2024-03-04T10:45:48.743569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":39178,"num_write":404,"num_write_kb":64477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'394","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.228272+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T10:45:19.228272+0000","last_peered":"2024-03-04T10:45:19.228272+0000","last_clean":"2024-03-04T10:45:19.228272+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T10:45:19.228272+0000","last_undegraded":"2024-03-04T10:45:19.228272+0000","last_fullsized":"2024-03-04T10:45:19.228272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47257,"num_write":366,"num_write_kb":58992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'743","reported_seq":810,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:30.792066+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T10:44:30.792066+0000","last_peered":"2024-03-04T10:44:30.792066+0000","last_clean":"2024-03-04T10:44:30.792066+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T10:44:30.792066+0000","last_undegraded":"2024-03-04T10:44:30.792066+0000","last_fullsized":"2024-03-04T10:44:30.792066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'398","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:19.153259+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T10:45:19.153259+0000","last_peered":"2024-03-04T10:45:19.153259+0000","last_clean":"2024-03-04T10:45:19.153259+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T10:45:19.153259+0000","last_undegraded":"2024-03-04T10:45:19.153259+0000","last_fullsized":"2024-03-04T10:45:19.153259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":109003,"num_write":376,"num_write_kb":109132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1351","reported_seq":1418,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.257420+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T10:44:25.257420+0000","last_peered":"2024-03-04T10:44:25.257420+0000","last_clean":"2024-03-04T10:44:25.257420+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T10:44:25.257420+0000","last_undegraded":"2024-03-04T10:44:25.257420+0000","last_fullsized":"2024-03-04T10:44:25.257420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'366","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:32.476332+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T10:45:32.476332+0000","last_peered":"2024-03-04T10:45:32.476332+0000","last_clean":"2024-03-04T10:45:32.476332+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T10:45:32.476332+0000","last_undegraded":"2024-03-04T10:45:32.476332+0000","last_fullsized":"2024-03-04T10:45:32.476332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":85639,"num_write":344,"num_write_kb":59290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'544","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343090+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T10:45:48.343090+0000","last_peered":"2024-03-04T10:45:48.343090+0000","last_clean":"2024-03-04T10:45:48.343090+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T10:45:48.343090+0000","last_undegraded":"2024-03-04T10:45:48.343090+0000","last_fullsized":"2024-03-04T10:45:48.343090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'369","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.839193+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T10:45:59.839193+0000","last_peered":"2024-03-04T10:45:59.839193+0000","last_clean":"2024-03-04T10:45:59.839193+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T10:45:59.839193+0000","last_undegraded":"2024-03-04T10:45:59.839193+0000","last_fullsized":"2024-03-04T10:45:59.839193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":32203,"num_write":336,"num_write_kb":38117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'500","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:53.637263+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T10:45:53.637263+0000","last_peered":"2024-03-04T10:45:53.637263+0000","last_clean":"2024-03-04T10:45:53.637263+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T10:45:53.637263+0000","last_undegraded":"2024-03-04T10:45:53.637263+0000","last_fullsized":"2024-03-04T10:45:53.637263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22951,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":3491284,"num_write":24336,"num_write_kb":4342030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":27050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25939,"ondisk_log_size":25939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":215625583,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":1417,"num_read_kb":2453,"num_write":28732,"num_write_kb":225831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":431497216,"data_stored":431251166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25536,"ondisk_log_size":25536,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510846,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149460,"kb_used_data":86348,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94222380,"statfs":{"total":96636764160,"available":96483717120,"internally_reserved":0,"allocated":88420352,"data_stored":88200409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510847,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82268,"kb_used_data":33044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94289572,"statfs":{"total":96636764160,"available":96552521728,"internally_reserved":0,"allocated":33837056,"data_stored":33652338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510846,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121680,"kb_used_data":50248,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250160,"statfs":{"total":96636764160,"available":96512163840,"internally_reserved":0,"allocated":51453952,"data_stored":51261688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510846,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171936,"kb_used_data":82456,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199904,"statfs":{"total":96636764160,"available":96460701696,"internally_reserved":0,"allocated":84434944,"data_stored":84226164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543551,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101764,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270076,"statfs":{"total":96636764160,"available":96532557824,"internally_reserved":0,"allocated":35319808,"data_stored":35121154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78104,"kb_used_data":33040,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293736,"statfs":{"total":96636764160,"available":96556785664,"internally_reserved":0,"allocated":33832960,"data_stored":33652223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114556,"kb_used_data":51444,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":52678656,"data_stored":52488510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543552,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124984,"kb_used_data":53552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94246856,"statfs":{"total":96636764160,"available":96508780544,"internally_reserved":0,"allocated":54837248,"data_stored":54623873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84164608,"data_stored":84127350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50593792,"data_stored":50571790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33570816,"data_stored":33555172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88125440,"data_stored":88083106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54579200,"data_stored":54528462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51826688,"data_stored":51802731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33574912,"data_stored":33556812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35061760,"data_stored":35025743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":21892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T10:46:14.768 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T10:46:14.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T10:46:14.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.994+0000 7efe0f200640 1 Processor -- start 2024-03-04T10:46:14.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.995+0000 7efe0f200640 1 -- start start 2024-03-04T10:46:14.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.996+0000 7efe0f200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe08151f40 0x7efe080c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.996+0000 7efe0f200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe080c7a90 0x7efe080c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:14.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.996+0000 7efe0f200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe08158e20 con 0x7efe080c8ac0 2024-03-04T10:46:15.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.996+0000 7efe0f200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe081582a0 con 0x7efe080c7a90 2024-03-04T10:46:15.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:14.996+0000 7efe0f200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe08158580 con 0x7efe08151f40 2024-03-04T10:46:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.020+0000 7efe0de00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe08151f40 0x7efe080c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.020+0000 7efe0de00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe08151f40 0x7efe080c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47946/0 (socket says 172.21.15.46:47946) 2024-03-04T10:46:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.020+0000 7efe0de00640 1 -- 172.21.15.46:0/3096895375 learned_addr learned my addr 172.21.15.46:0/3096895375 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.026+0000 7efe0de00640 1 -- 172.21.15.46:0/3096895375 >> v2:172.21.15.46:3300/0 conn(0x7efe080c7a90 msgr2=0x7efe080c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.026+0000 7efe0de00640 1 --2- 172.21.15.46:0/3096895375 >> v2:172.21.15.46:3300/0 conn(0x7efe080c7a90 0x7efe080c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.026+0000 7efe0de00640 1 -- 172.21.15.46:0/3096895375 >> v1:172.21.15.73:6789/0 conn(0x7efe080c8ac0 legacy=0x7efe0815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.026+0000 7efe0de00640 1 -- 172.21.15.46:0/3096895375 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08158860 con 0x7efe08151f40 2024-03-04T10:46:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.030+0000 7efe0de00640 1 --2- 172.21.15.46:0/3096895375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe080c7550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe0806bd90 tx=0x7efdfc02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fab760004f3d6ca server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:15.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.034+0000 7efe0ca00640 1 -- 172.21.15.46:0/3096895375 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc02f850 con 0x7efe08151f40 2024-03-04T10:46:15.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.034+0000 7efe0ca00640 1 -- 172.21.15.46:0/3096895375 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc02f9f0 con 0x7efe08151f40 2024-03-04T10:46:15.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.034+0000 7efe0ca00640 1 -- 172.21.15.46:0/3096895375 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc02fdc0 con 0x7efe08151f40 2024-03-04T10:46:15.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 -- 172.21.15.46:0/3096895375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 msgr2=0x7efe080c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 --2- 172.21.15.46:0/3096895375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe080c7550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe0806bd90 tx=0x7efdfc02ba30 comp rx=0 tx=0).stop 2024-03-04T10:46:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 -- 172.21.15.46:0/3096895375 shutdown_connections 2024-03-04T10:46:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 --2- 172.21.15.46:0/3096895375 >> v2:172.21.15.46:3300/0 conn(0x7efe080c7a90 0x7efe080c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 --2- 172.21.15.46:0/3096895375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe080c7550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 -- 172.21.15.46:0/3096895375 >> 172.21.15.46:0/3096895375 conn(0x7efe0806aff0 msgr2=0x7efe0806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.035+0000 7efe0f200640 1 -- 172.21.15.46:0/3096895375 shutdown_connections 2024-03-04T10:46:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.036+0000 7efe0f200640 1 -- 172.21.15.46:0/3096895375 wait complete. 2024-03-04T10:46:15.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.038+0000 7efe0f200640 1 Processor -- start 2024-03-04T10:46:15.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.038+0000 7efe0f200640 1 -- start start 2024-03-04T10:46:15.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.040+0000 7efe0f200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe080c7a90 0x7efe081f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.040+0000 7efe0f200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080c8ac0 0x7efe080718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.040+0000 7efe0f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe08071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.040+0000 7efe0f200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe08152320 con 0x7efe080c8ac0 2024-03-04T10:46:15.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.040+0000 7efe0f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0815b560 con 0x7efe08151f40 2024-03-04T10:46:15.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.040+0000 7efe0f200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe08157ed0 con 0x7efe080c7a90 2024-03-04T10:46:15.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.041+0000 7efe0e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe08071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.041+0000 7efe0e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe08071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47950/0 (socket says 172.21.15.46:47950) 2024-03-04T10:46:15.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.041+0000 7efe0e800640 1 -- 172.21.15.46:0/2881807088 learned_addr learned my addr 172.21.15.46:0/2881807088 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:15.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.045+0000 7efe0e800640 1 -- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe080c7a90 msgr2=0x7efe081f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.045+0000 7efe0e800640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe080c7a90 0x7efe081f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.045+0000 7efe0e800640 1 -- 172.21.15.46:0/2881807088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080c8ac0 msgr2=0x7efe080718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.045+0000 7efe0e800640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080c8ac0 0x7efe080718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.045+0000 7efe0e800640 1 -- 172.21.15.46:0/2881807088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08155d20 con 0x7efe08151f40 2024-03-04T10:46:15.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.052+0000 7efe0e800640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe08071e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c7d0 tx=0x7efe0400cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.063+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04003b70 con 0x7efe08151f40 2024-03-04T10:46:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.063+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04003d30 con 0x7efe08151f40 2024-03-04T10:46:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.063+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400aa90 con 0x7efe08151f40 2024-03-04T10:46:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.063+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe081f3870 con 0x7efe08151f40 2024-03-04T10:46:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.064+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08151380 con 0x7efe08151f40 2024-03-04T10:46:15.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.066+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0804f330 con 0x7efe08151f40 2024-03-04T10:46:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.449+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe0400ac30 con 0x7efe08151f40 2024-03-04T10:46:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.450+0000 7efe02000640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdec06b520 0x7efdec06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.451+0000 7efe0de00640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdec06b520 0x7efdec06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.452+0000 7efe0de00640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdec06b520 0x7efdec06d9e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efdfc036000 tx=0x7efdfc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:15.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.456+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efe04057410 con 0x7efe08151f40 2024-03-04T10:46:15.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.471+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efe04059a70 con 0x7efe08151f40 2024-03-04T10:46:15.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.673+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe080c7330 con 0x7efdec06b520 2024-03-04T10:46:15.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.686+0000 7efe02000640 1 -- 172.21.15.46:0/2881807088 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253975 (secure 0 0 0) 0x7efe080c7330 con 0x7efdec06b520 2024-03-04T10:46:15.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:15.694 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T10:46:15.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdec06b520 msgr2=0x7efdec06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdec06b520 0x7efdec06d9e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efdfc036000 tx=0x7efdfc030000 comp rx=0 tx=0).stop 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 msgr2=0x7efe08071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe08071e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c7d0 tx=0x7efe0400cc90 comp rx=0 tx=0).stop 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 shutdown_connections 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7efdec06b520 0x7efdec06d9e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe08151f40 0x7efe08071e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080c8ac0 0x7efe080718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 --2- 172.21.15.46:0/2881807088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe080c7a90 0x7efe081f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 >> 172.21.15.46:0/2881807088 conn(0x7efe0806aff0 msgr2=0x7efe08156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 shutdown_connections 2024-03-04T10:46:15.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.691+0000 7efe0f200640 1 -- 172.21.15.46:0/2881807088 wait complete. 2024-03-04T10:46:15.712 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":3527,"stamp":"2024-03-04T10:46:14.846268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216229373,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":2670,"num_read_kb":3493837,"num_write":53237,"num_write_kb":4570293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51837,"ondisk_log_size":51837,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":944712,"kb_used_data":424584,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754030008,"statfs":{"total":773094113280,"available":772126728192,"internally_reserved":0,"allocated":434774016,"data_stored":433222034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":532532785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-48693,"num_objects":-50,"num_object_clones":0,"num_object_copies":-100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-50,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":93,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002585"},"pg_stats":[{"pgid":"3.3f","version":"25'429","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.754804+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T10:46:12.754804+0000","last_peered":"2024-03-04T10:46:12.754804+0000","last_clean":"2024-03-04T10:46:12.754804+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T10:46:12.754804+0000","last_undegraded":"2024-03-04T10:46:12.754804+0000","last_fullsized":"2024-03-04T10:46:12.754804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.021574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":56779,"num_write":405,"num_write_kb":75850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'414","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.556150+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T10:45:41.556150+0000","last_peered":"2024-03-04T10:45:41.556150+0000","last_clean":"2024-03-04T10:45:41.556150+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T10:45:41.556150+0000","last_undegraded":"2024-03-04T10:45:41.556150+0000","last_fullsized":"2024-03-04T10:45:41.556150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68736,"num_write":382,"num_write_kb":71625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'371","reported_seq":451,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.747145+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T10:45:41.747145+0000","last_peered":"2024-03-04T10:45:41.747145+0000","last_clean":"2024-03-04T10:45:41.747145+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T10:45:41.747145+0000","last_undegraded":"2024-03-04T10:45:41.747145+0000","last_fullsized":"2024-03-04T10:45:41.747145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24226,"num_write":349,"num_write_kb":62283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'365","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.619196+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T10:46:12.619196+0000","last_peered":"2024-03-04T10:46:12.619196+0000","last_clean":"2024-03-04T10:46:12.619196+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T10:46:12.619196+0000","last_undegraded":"2024-03-04T10:46:12.619196+0000","last_fullsized":"2024-03-04T10:46:12.619196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:07.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":47711,"num_write":338,"num_write_kb":33889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'444","reported_seq":556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.750214+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T10:46:12.750214+0000","last_peered":"2024-03-04T10:46:12.750214+0000","last_clean":"2024-03-04T10:46:12.750214+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T10:46:12.750214+0000","last_undegraded":"2024-03-04T10:46:12.750214+0000","last_fullsized":"2024-03-04T10:46:12.750214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:05.221010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":161798,"num_write":413,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'380","reported_seq":454,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.620021+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T10:46:12.620021+0000","last_peered":"2024-03-04T10:46:12.620021+0000","last_clean":"2024-03-04T10:46:12.620021+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T10:46:12.620021+0000","last_undegraded":"2024-03-04T10:46:12.620021+0000","last_fullsized":"2024-03-04T10:46:12.620021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":34885,"num_write":352,"num_write_kb":34327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'382","reported_seq":468,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.750152+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T10:46:12.750152+0000","last_peered":"2024-03-04T10:46:12.750152+0000","last_clean":"2024-03-04T10:46:12.750152+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T10:46:12.750152+0000","last_undegraded":"2024-03-04T10:46:12.750152+0000","last_fullsized":"2024-03-04T10:46:12.750152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:01.553798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":76194,"num_write":351,"num_write_kb":54499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'351","reported_seq":430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.799112+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T10:45:37.799112+0000","last_peered":"2024-03-04T10:45:37.799112+0000","last_clean":"2024-03-04T10:45:37.799112+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T10:45:37.799112+0000","last_undegraded":"2024-03-04T10:45:37.799112+0000","last_fullsized":"2024-03-04T10:45:37.799112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26383,"num_write":323,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'401","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.661297+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T10:46:12.661297+0000","last_peered":"2024-03-04T10:46:12.661297+0000","last_clean":"2024-03-04T10:46:12.661297+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T10:46:12.661297+0000","last_undegraded":"2024-03-04T10:46:12.661297+0000","last_fullsized":"2024-03-04T10:46:12.661297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20946,"num_write":374,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'408","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.752053+0000","last_change":"2024-03-04T08:49:40.147604+0000","last_active":"2024-03-04T10:46:12.752053+0000","last_peered":"2024-03-04T10:46:12.752053+0000","last_clean":"2024-03-04T10:46:12.752053+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T10:46:12.752053+0000","last_undegraded":"2024-03-04T10:46:12.752053+0000","last_fullsized":"2024-03-04T10:46:12.752053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:00.011918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":17641,"num_write":374,"num_write_kb":26355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'385","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.750344+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T10:46:12.750344+0000","last_peered":"2024-03-04T10:46:12.750344+0000","last_clean":"2024-03-04T10:46:12.750344+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T10:46:12.750344+0000","last_undegraded":"2024-03-04T10:46:12.750344+0000","last_fullsized":"2024-03-04T10:46:12.750344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:01.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":63408,"num_write":367,"num_write_kb":59321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'360","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755198+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T10:46:12.755198+0000","last_peered":"2024-03-04T10:46:12.755198+0000","last_clean":"2024-03-04T10:46:12.755198+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T10:46:12.755198+0000","last_undegraded":"2024-03-04T10:46:12.755198+0000","last_fullsized":"2024-03-04T10:46:12.755198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:14.189718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":49283,"num_write":340,"num_write_kb":63175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'401","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.211189+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T10:45:42.211189+0000","last_peered":"2024-03-04T10:45:42.211189+0000","last_clean":"2024-03-04T10:45:42.211189+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T10:45:42.211189+0000","last_undegraded":"2024-03-04T10:45:42.211189+0000","last_fullsized":"2024-03-04T10:45:42.211189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":54416,"num_write":375,"num_write_kb":38585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'385","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.967894+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T10:45:59.967894+0000","last_peered":"2024-03-04T10:45:59.967894+0000","last_clean":"2024-03-04T10:45:59.967894+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T10:45:59.967894+0000","last_undegraded":"2024-03-04T10:45:59.967894+0000","last_fullsized":"2024-03-04T10:45:59.967894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29624,"num_write":360,"num_write_kb":30114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'404","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.450739+0000","last_change":"2024-03-04T08:50:12.592750+0000","last_active":"2024-03-04T10:45:48.450739+0000","last_peered":"2024-03-04T10:45:48.450739+0000","last_clean":"2024-03-04T10:45:48.450739+0000","last_became_active":"2024-03-04T08:50:12.592374+0000","last_became_peered":"2024-03-04T08:50:12.592374+0000","last_unstale":"2024-03-04T10:45:48.450739+0000","last_undegraded":"2024-03-04T10:45:48.450739+0000","last_fullsized":"2024-03-04T10:45:48.450739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:28.147260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":71598,"num_write":369,"num_write_kb":67511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'422","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.641764+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T10:46:12.641764+0000","last_peered":"2024-03-04T10:46:12.641764+0000","last_clean":"2024-03-04T10:46:12.641764+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T10:46:12.641764+0000","last_undegraded":"2024-03-04T10:46:12.641764+0000","last_fullsized":"2024-03-04T10:46:12.641764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":49152,"num_write":389,"num_write_kb":58855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'440","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.653876+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T10:46:12.653876+0000","last_peered":"2024-03-04T10:46:12.653876+0000","last_clean":"2024-03-04T10:46:12.653876+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T10:46:12.653876+0000","last_undegraded":"2024-03-04T10:46:12.653876+0000","last_fullsized":"2024-03-04T10:46:12.653876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:51.233752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":66011,"num_write":406,"num_write_kb":96427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'407","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.630967+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T10:45:31.630967+0000","last_peered":"2024-03-04T10:45:31.630967+0000","last_clean":"2024-03-04T10:45:31.630967+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T10:45:31.630967+0000","last_undegraded":"2024-03-04T10:45:31.630967+0000","last_fullsized":"2024-03-04T10:45:31.630967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":44968,"num_write":370,"num_write_kb":71715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'428","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.651504+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T10:46:12.651504+0000","last_peered":"2024-03-04T10:46:12.651504+0000","last_clean":"2024-03-04T10:46:12.651504+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T10:46:12.651504+0000","last_undegraded":"2024-03-04T10:46:12.651504+0000","last_fullsized":"2024-03-04T10:46:12.651504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:25.275384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":73465,"num_write":395,"num_write_kb":100388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'437","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755591+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T10:46:12.755591+0000","last_peered":"2024-03-04T10:46:12.755591+0000","last_clean":"2024-03-04T10:46:12.755591+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T10:46:12.755591+0000","last_undegraded":"2024-03-04T10:46:12.755591+0000","last_fullsized":"2024-03-04T10:46:12.755591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:59.562992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":62456,"num_write":411,"num_write_kb":51118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'412","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.750379+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T10:45:24.750379+0000","last_peered":"2024-03-04T10:45:24.750379+0000","last_clean":"2024-03-04T10:45:24.750379+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T10:45:24.750379+0000","last_undegraded":"2024-03-04T10:45:24.750379+0000","last_fullsized":"2024-03-04T10:45:24.750379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":56958,"num_write":379,"num_write_kb":88435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'432","reported_seq":526,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.662777+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T10:46:12.662777+0000","last_peered":"2024-03-04T10:46:12.662777+0000","last_clean":"2024-03-04T10:46:12.662777+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T10:46:12.662777+0000","last_undegraded":"2024-03-04T10:46:12.662777+0000","last_fullsized":"2024-03-04T10:46:12.662777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:41.239265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84454,"num_write":409,"num_write_kb":67704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'384","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343973+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T10:45:48.343973+0000","last_peered":"2024-03-04T10:45:48.343973+0000","last_clean":"2024-03-04T10:45:48.343973+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T10:45:48.343973+0000","last_undegraded":"2024-03-04T10:45:48.343973+0000","last_fullsized":"2024-03-04T10:45:48.343973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15942,"num_write":359,"num_write_kb":55013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'444","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.651751+0000","last_change":"2024-03-04T08:49:40.151058+0000","last_active":"2024-03-04T10:46:12.651751+0000","last_peered":"2024-03-04T10:46:12.651751+0000","last_clean":"2024-03-04T10:46:12.651751+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T10:46:12.651751+0000","last_undegraded":"2024-03-04T10:46:12.651751+0000","last_fullsized":"2024-03-04T10:46:12.651751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:02:27.256518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47415,"num_write":405,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'414","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.799178+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T10:45:37.799178+0000","last_peered":"2024-03-04T10:45:37.799178+0000","last_clean":"2024-03-04T10:45:37.799178+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T10:45:37.799178+0000","last_undegraded":"2024-03-04T10:45:37.799178+0000","last_fullsized":"2024-03-04T10:45:37.799178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49227,"num_write":397,"num_write_kb":80014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'505","reported_seq":603,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.650164+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T10:46:12.650164+0000","last_peered":"2024-03-04T10:46:12.650164+0000","last_clean":"2024-03-04T10:46:12.650164+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T10:46:12.650164+0000","last_undegraded":"2024-03-04T10:46:12.650164+0000","last_fullsized":"2024-03-04T10:46:12.650164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:08.276781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":78376,"num_write":475,"num_write_kb":113705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'424","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.742945+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T10:45:41.742945+0000","last_peered":"2024-03-04T10:45:41.742945+0000","last_clean":"2024-03-04T10:45:41.742945+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T10:45:41.742945+0000","last_undegraded":"2024-03-04T10:45:41.742945+0000","last_fullsized":"2024-03-04T10:45:41.742945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75663,"num_write":396,"num_write_kb":55800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'365","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.743746+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T10:45:41.743746+0000","last_peered":"2024-03-04T10:45:41.743746+0000","last_clean":"2024-03-04T10:45:41.743746+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T10:45:41.743746+0000","last_undegraded":"2024-03-04T10:45:41.743746+0000","last_fullsized":"2024-03-04T10:45:41.743746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":29309,"num_write":341,"num_write_kb":42443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'374","reported_seq":462,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.479777+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T10:45:48.479777+0000","last_peered":"2024-03-04T10:45:48.479777+0000","last_clean":"2024-03-04T10:45:48.479777+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T10:45:48.479777+0000","last_undegraded":"2024-03-04T10:45:48.479777+0000","last_fullsized":"2024-03-04T10:45:48.479777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44796,"num_write":353,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'484","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.652098+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T10:46:12.652098+0000","last_peered":"2024-03-04T10:46:12.652098+0000","last_clean":"2024-03-04T10:46:12.652098+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T10:46:12.652098+0000","last_undegraded":"2024-03-04T10:46:12.652098+0000","last_fullsized":"2024-03-04T10:46:12.652098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:32.231992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":91221,"num_write":448,"num_write_kb":101088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'453","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.360760+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T10:45:59.360760+0000","last_peered":"2024-03-04T10:45:59.360760+0000","last_clean":"2024-03-04T10:45:59.360760+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T10:45:59.360760+0000","last_undegraded":"2024-03-04T10:45:59.360760+0000","last_fullsized":"2024-03-04T10:45:59.360760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":144837,"num_write":435,"num_write_kb":130358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'449","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.620132+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T10:46:12.620132+0000","last_peered":"2024-03-04T10:46:12.620132+0000","last_clean":"2024-03-04T10:46:12.620132+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T10:46:12.620132+0000","last_undegraded":"2024-03-04T10:46:12.620132+0000","last_fullsized":"2024-03-04T10:46:12.620132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23611,"num_write":420,"num_write_kb":59471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.661618+0000","last_change":"2024-03-04T08:49:40.140352+0000","last_active":"2024-03-04T10:46:12.661618+0000","last_peered":"2024-03-04T10:46:12.661618+0000","last_clean":"2024-03-04T10:46:12.661618+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T10:46:12.661618+0000","last_undegraded":"2024-03-04T10:46:12.661618+0000","last_fullsized":"2024-03-04T10:46:12.661618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":42800,"num_write":385,"num_write_kb":71334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'238","reported_seq":305,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.853775+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T10:44:25.853775+0000","last_peered":"2024-03-04T10:44:25.853775+0000","last_clean":"2024-03-04T10:44:25.853775+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T10:44:25.853775+0000","last_undegraded":"2024-03-04T10:44:25.853775+0000","last_fullsized":"2024-03-04T10:44:25.853775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'361","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.925278+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T10:45:59.925278+0000","last_peered":"2024-03-04T10:45:59.925278+0000","last_clean":"2024-03-04T10:45:59.925278+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T10:45:59.925278+0000","last_undegraded":"2024-03-04T10:45:59.925278+0000","last_fullsized":"2024-03-04T10:45:59.925278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32809,"num_write":342,"num_write_kb":54741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1404","reported_seq":1471,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:55.873939+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T10:45:55.873939+0000","last_peered":"2024-03-04T10:45:55.873939+0000","last_clean":"2024-03-04T10:45:55.873939+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T10:45:55.873939+0000","last_undegraded":"2024-03-04T10:45:55.873939+0000","last_fullsized":"2024-03-04T10:45:55.873939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1404,"log_dups_size":0,"ondisk_log_size":1404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":17039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'794","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.213101+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T10:46:07.213101+0000","last_peered":"2024-03-04T10:46:07.213101+0000","last_clean":"2024-03-04T10:46:07.213101+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T10:46:07.213101+0000","last_undegraded":"2024-03-04T10:46:07.213101+0000","last_fullsized":"2024-03-04T10:46:07.213101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'439","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.097530+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T10:46:00.097530+0000","last_peered":"2024-03-04T10:46:00.097530+0000","last_clean":"2024-03-04T10:46:00.097530+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T10:46:00.097530+0000","last_undegraded":"2024-03-04T10:46:00.097530+0000","last_fullsized":"2024-03-04T10:46:00.097530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":27702,"num_write":417,"num_write_kb":42496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1108","reported_seq":1177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.513140+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T10:45:24.513140+0000","last_peered":"2024-03-04T10:45:24.513140+0000","last_clean":"2024-03-04T10:45:24.513140+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T10:45:24.513140+0000","last_undegraded":"2024-03-04T10:45:24.513140+0000","last_fullsized":"2024-03-04T10:45:24.513140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":12803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'401","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.554301+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T10:45:41.554301+0000","last_peered":"2024-03-04T10:45:41.554301+0000","last_clean":"2024-03-04T10:45:41.554301+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T10:45:41.554301+0000","last_undegraded":"2024-03-04T10:45:41.554301+0000","last_fullsized":"2024-03-04T10:45:41.554301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":31518,"num_write":380,"num_write_kb":54868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'67","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:31.328254+0000","last_change":"2024-03-04T08:49:39.006916+0000","last_active":"2024-03-04T10:45:31.328254+0000","last_peered":"2024-03-04T10:45:31.328254+0000","last_clean":"2024-03-04T10:45:31.328254+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T10:45:31.328254+0000","last_undegraded":"2024-03-04T10:45:31.328254+0000","last_fullsized":"2024-03-04T10:45:31.328254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:14.537944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'455","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.650552+0000","last_change":"2024-03-04T08:49:40.147922+0000","last_active":"2024-03-04T10:46:12.650552+0000","last_peered":"2024-03-04T10:46:12.650552+0000","last_clean":"2024-03-04T10:46:12.650552+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T10:46:12.650552+0000","last_undegraded":"2024-03-04T10:46:12.650552+0000","last_fullsized":"2024-03-04T10:46:12.650552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:36.838742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68599,"num_write":425,"num_write_kb":83547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1155","reported_seq":1224,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.315627+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T10:46:12.315627+0000","last_peered":"2024-03-04T10:46:12.315627+0000","last_clean":"2024-03-04T10:46:12.315627+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T10:46:12.315627+0000","last_undegraded":"2024-03-04T10:46:12.315627+0000","last_fullsized":"2024-03-04T10:46:12.315627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:01:29.676290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12835062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":13084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'395","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:42.348834+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T10:45:42.348834+0000","last_peered":"2024-03-04T10:45:42.348834+0000","last_clean":"2024-03-04T10:45:42.348834+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T10:45:42.348834+0000","last_undegraded":"2024-03-04T10:45:42.348834+0000","last_fullsized":"2024-03-04T10:45:42.348834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":69489,"num_write":372,"num_write_kb":99199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1617","reported_seq":1686,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:04.086239+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T10:46:04.086239+0000","last_peered":"2024-03-04T10:46:04.086239+0000","last_clean":"2024-03-04T10:46:04.086239+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T10:46:04.086239+0000","last_undegraded":"2024-03-04T10:46:04.086239+0000","last_fullsized":"2024-03-04T10:46:04.086239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":9396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'404","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.650072+0000","last_change":"2024-03-04T08:49:40.153079+0000","last_active":"2024-03-04T10:46:12.650072+0000","last_peered":"2024-03-04T10:46:12.650072+0000","last_clean":"2024-03-04T10:46:12.650072+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T10:46:12.650072+0000","last_undegraded":"2024-03-04T10:46:12.650072+0000","last_fullsized":"2024-03-04T10:46:12.650072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:44.928334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":58935,"num_write":368,"num_write_kb":66938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1670","reported_seq":1740,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:57.041052+0000","last_change":"2024-03-04T08:49:39.002295+0000","last_active":"2024-03-04T10:45:57.041052+0000","last_peered":"2024-03-04T10:45:57.041052+0000","last_clean":"2024-03-04T10:45:57.041052+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T10:45:57.041052+0000","last_undegraded":"2024-03-04T10:45:57.041052+0000","last_fullsized":"2024-03-04T10:45:57.041052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:40.913836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'390","reported_seq":471,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.750574+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T10:46:12.750574+0000","last_peered":"2024-03-04T10:46:12.750574+0000","last_clean":"2024-03-04T10:46:12.750574+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T10:46:12.750574+0000","last_undegraded":"2024-03-04T10:46:12.750574+0000","last_fullsized":"2024-03-04T10:46:12.750574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:46.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":52325,"num_write":353,"num_write_kb":55067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'325","reported_seq":395,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:02.302876+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T10:44:02.302876+0000","last_peered":"2024-03-04T10:44:02.302876+0000","last_clean":"2024-03-04T10:44:02.302876+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T10:44:02.302876+0000","last_undegraded":"2024-03-04T10:44:02.302876+0000","last_fullsized":"2024-03-04T10:44:02.302876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":8340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'406","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:24.705416+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T10:45:24.705416+0000","last_peered":"2024-03-04T10:45:24.705416+0000","last_clean":"2024-03-04T10:45:24.705416+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T10:45:24.705416+0000","last_undegraded":"2024-03-04T10:45:24.705416+0000","last_fullsized":"2024-03-04T10:45:24.705416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":41706,"num_write":387,"num_write_kb":84154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'64","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.445988+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T10:45:48.445988+0000","last_peered":"2024-03-04T10:45:48.445988+0000","last_clean":"2024-03-04T10:45:48.445988+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T10:45:48.445988+0000","last_undegraded":"2024-03-04T10:45:48.445988+0000","last_fullsized":"2024-03-04T10:45:48.445988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:10.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'410","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.654055+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T10:46:12.654055+0000","last_peered":"2024-03-04T10:46:12.654055+0000","last_clean":"2024-03-04T10:46:12.654055+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T10:46:12.654055+0000","last_undegraded":"2024-03-04T10:46:12.654055+0000","last_fullsized":"2024-03-04T10:46:12.654055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:28.802844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71159,"num_write":383,"num_write_kb":34363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'67","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:03.474568+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T10:44:03.474568+0000","last_peered":"2024-03-04T10:44:03.474568+0000","last_clean":"2024-03-04T10:44:03.474568+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T10:44:03.474568+0000","last_undegraded":"2024-03-04T10:44:03.474568+0000","last_fullsized":"2024-03-04T10:44:03.474568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:50.136999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'444","reported_seq":544,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.662296+0000","last_change":"2024-03-04T08:49:40.146916+0000","last_active":"2024-03-04T10:46:12.662296+0000","last_peered":"2024-03-04T10:46:12.662296+0000","last_clean":"2024-03-04T10:46:12.662296+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T10:46:12.662296+0000","last_undegraded":"2024-03-04T10:46:12.662296+0000","last_fullsized":"2024-03-04T10:46:12.662296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.775021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":111394,"num_write":416,"num_write_kb":109040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'823","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:18.871918+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T10:44:18.871918+0000","last_peered":"2024-03-04T10:44:18.871918+0000","last_clean":"2024-03-04T10:44:18.871918+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T10:44:18.871918+0000","last_undegraded":"2024-03-04T10:44:18.871918+0000","last_fullsized":"2024-03-04T10:44:18.871918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":8544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'477","reported_seq":568,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.643219+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T10:46:12.643219+0000","last_peered":"2024-03-04T10:46:12.643219+0000","last_clean":"2024-03-04T10:46:12.643219+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T10:46:12.643219+0000","last_undegraded":"2024-03-04T10:46:12.643219+0000","last_fullsized":"2024-03-04T10:46:12.643219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:14.765374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":59537,"num_write":439,"num_write_kb":76319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'752","reported_seq":824,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:38.732774+0000","last_change":"2024-03-04T08:49:39.007710+0000","last_active":"2024-03-04T10:44:38.732774+0000","last_peered":"2024-03-04T10:44:38.732774+0000","last_clean":"2024-03-04T10:44:38.732774+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T10:44:38.732774+0000","last_undegraded":"2024-03-04T10:44:38.732774+0000","last_fullsized":"2024-03-04T10:44:38.732774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:24.157354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'373","reported_seq":465,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.633877+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T10:46:12.633877+0000","last_peered":"2024-03-04T10:46:12.633877+0000","last_clean":"2024-03-04T10:46:12.633877+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T10:46:12.633877+0000","last_undegraded":"2024-03-04T10:46:12.633877+0000","last_fullsized":"2024-03-04T10:46:12.633877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:22.000771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":68174,"num_write":341,"num_write_kb":71100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'821","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.267058+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T10:44:27.267058+0000","last_peered":"2024-03-04T10:44:27.267058+0000","last_clean":"2024-03-04T10:44:27.267058+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T10:44:27.267058+0000","last_undegraded":"2024-03-04T10:44:27.267058+0000","last_fullsized":"2024-03-04T10:44:27.267058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'386","reported_seq":472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.754944+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T10:46:12.754944+0000","last_peered":"2024-03-04T10:46:12.754944+0000","last_clean":"2024-03-04T10:46:12.754944+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T10:46:12.754944+0000","last_undegraded":"2024-03-04T10:46:12.754944+0000","last_fullsized":"2024-03-04T10:46:12.754944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:16.189458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":53055,"num_write":347,"num_write_kb":59070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'206","reported_seq":278,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:46.179515+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T10:43:46.179515+0000","last_peered":"2024-03-04T10:43:46.179515+0000","last_clean":"2024-03-04T10:43:46.179515+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T10:43:46.179515+0000","last_undegraded":"2024-03-04T10:43:46.179515+0000","last_fullsized":"2024-03-04T10:43:46.179515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'441","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755436+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T10:46:12.755436+0000","last_peered":"2024-03-04T10:46:12.755436+0000","last_clean":"2024-03-04T10:46:12.755436+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T10:46:12.755436+0000","last_undegraded":"2024-03-04T10:46:12.755436+0000","last_fullsized":"2024-03-04T10:46:12.755436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:15.315602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21944,"num_write":403,"num_write_kb":30840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'307","reported_seq":379,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.205109+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T10:44:27.205109+0000","last_peered":"2024-03-04T10:44:27.205109+0000","last_clean":"2024-03-04T10:44:27.205109+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T10:44:27.205109+0000","last_undegraded":"2024-03-04T10:44:27.205109+0000","last_fullsized":"2024-03-04T10:44:27.205109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195474,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'401","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.655021+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T10:46:12.655021+0000","last_peered":"2024-03-04T10:46:12.655021+0000","last_clean":"2024-03-04T10:46:12.655021+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T10:46:12.655021+0000","last_undegraded":"2024-03-04T10:46:12.655021+0000","last_fullsized":"2024-03-04T10:46:12.655021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:57.379139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10206,"num_write":377,"num_write_kb":38425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":234,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:43.805315+0000","last_change":"2024-03-04T08:49:25.375385+0000","last_active":"2024-03-04T10:43:43.805315+0000","last_peered":"2024-03-04T10:43:43.805315+0000","last_clean":"2024-03-04T10:43:43.805315+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T10:43:43.805315+0000","last_undegraded":"2024-03-04T10:43:43.805315+0000","last_fullsized":"2024-03-04T10:43:43.805315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:23.547969+0000","last_clean_scrub_stamp":"2024-03-04T08:49:23.547969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:54.012872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'313","reported_seq":389,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.943522+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T10:45:59.943522+0000","last_peered":"2024-03-04T10:45:59.943522+0000","last_clean":"2024-03-04T10:45:59.943522+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T10:45:59.943522+0000","last_undegraded":"2024-03-04T10:45:59.943522+0000","last_fullsized":"2024-03-04T10:45:59.943522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:00.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'375","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.746305+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T10:45:48.746305+0000","last_peered":"2024-03-04T10:45:48.746305+0000","last_clean":"2024-03-04T10:45:48.746305+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T10:45:48.746305+0000","last_undegraded":"2024-03-04T10:45:48.746305+0000","last_fullsized":"2024-03-04T10:45:48.746305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":349,"num_write_kb":66462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'645","reported_seq":724,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:58.766583+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T10:45:58.766583+0000","last_peered":"2024-03-04T10:45:58.766583+0000","last_clean":"2024-03-04T10:45:58.766583+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T10:45:58.766583+0000","last_undegraded":"2024-03-04T10:45:58.766583+0000","last_fullsized":"2024-03-04T10:45:58.766583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:49.614355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":12616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'402","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.939376+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T10:45:59.939376+0000","last_peered":"2024-03-04T10:45:59.939376+0000","last_clean":"2024-03-04T10:45:59.939376+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T10:45:59.939376+0000","last_undegraded":"2024-03-04T10:45:59.939376+0000","last_fullsized":"2024-03-04T10:45:59.939376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":90482,"num_write":377,"num_write_kb":105458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1489","reported_seq":2982,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.715255+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T10:46:08.715255+0000","last_peered":"2024-03-04T10:46:08.715255+0000","last_clean":"2024-03-04T10:46:08.715255+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T10:46:08.715255+0000","last_undegraded":"2024-03-04T10:46:08.715255+0000","last_fullsized":"2024-03-04T10:46:08.715255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1489,"log_dups_size":0,"ondisk_log_size":1489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470369,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1417,"num_read_kb":2453,"num_write":1422,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'406","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:00.082596+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T10:46:00.082596+0000","last_peered":"2024-03-04T10:46:00.082596+0000","last_clean":"2024-03-04T10:46:00.082596+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T10:46:00.082596+0000","last_undegraded":"2024-03-04T10:46:00.082596+0000","last_fullsized":"2024-03-04T10:46:00.082596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":48072,"num_write":378,"num_write_kb":95952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'419","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:42:08.731313+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T10:42:08.731313+0000","last_peered":"2024-03-04T10:42:08.731313+0000","last_clean":"2024-03-04T10:42:08.731313+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T10:42:08.731313+0000","last_undegraded":"2024-03-04T10:42:08.731313+0000","last_fullsized":"2024-03-04T10:42:08.731313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:09:58.483358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":8389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'412","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.750054+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T10:46:12.750054+0000","last_peered":"2024-03-04T10:46:12.750054+0000","last_clean":"2024-03-04T10:46:12.750054+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T10:46:12.750054+0000","last_undegraded":"2024-03-04T10:46:12.750054+0000","last_fullsized":"2024-03-04T10:46:12.750054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:11.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":26782,"num_write":371,"num_write_kb":63203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'369","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:52.494232+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T10:43:52.494232+0000","last_peered":"2024-03-04T10:43:52.494232+0000","last_clean":"2024-03-04T10:43:52.494232+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T10:43:52.494232+0000","last_undegraded":"2024-03-04T10:43:52.494232+0000","last_fullsized":"2024-03-04T10:43:52.494232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'439","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.622749+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T10:46:12.622749+0000","last_peered":"2024-03-04T10:46:12.622749+0000","last_clean":"2024-03-04T10:46:12.622749+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T10:46:12.622749+0000","last_undegraded":"2024-03-04T10:46:12.622749+0000","last_fullsized":"2024-03-04T10:46:12.622749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:11.254594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":67320,"num_write":391,"num_write_kb":100010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'445","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.677853+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T10:45:37.677853+0000","last_peered":"2024-03-04T10:45:37.677853+0000","last_clean":"2024-03-04T10:45:37.677853+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T10:45:37.677853+0000","last_undegraded":"2024-03-04T10:45:37.677853+0000","last_fullsized":"2024-03-04T10:45:37.677853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:27:45.598850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'387","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:41.559731+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T10:45:41.559731+0000","last_peered":"2024-03-04T10:45:41.559731+0000","last_clean":"2024-03-04T10:45:41.559731+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T10:45:41.559731+0000","last_undegraded":"2024-03-04T10:45:41.559731+0000","last_fullsized":"2024-03-04T10:45:41.559731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":38107,"num_write":361,"num_write_kb":51817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'4113","reported_seq":4187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.726360+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T10:46:07.726360+0000","last_peered":"2024-03-04T10:46:07.726360+0000","last_clean":"2024-03-04T10:46:07.726360+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T10:46:07.726360+0000","last_undegraded":"2024-03-04T10:46:07.726360+0000","last_fullsized":"2024-03-04T10:46:07.726360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":0,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9076,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'347","reported_seq":425,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:37.869570+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T10:45:37.869570+0000","last_peered":"2024-03-04T10:45:37.869570+0000","last_clean":"2024-03-04T10:45:37.869570+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T10:45:37.869570+0000","last_undegraded":"2024-03-04T10:45:37.869570+0000","last_fullsized":"2024-03-04T10:45:37.869570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":326,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'342","reported_seq":416,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.786444+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T10:46:08.786444+0000","last_peered":"2024-03-04T10:46:08.786444+0000","last_clean":"2024-03-04T10:46:08.786444+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T10:46:08.786444+0000","last_undegraded":"2024-03-04T10:46:08.786444+0000","last_fullsized":"2024-03-04T10:46:08.786444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:58.932284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'432","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:32.267506+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T10:44:32.267506+0000","last_peered":"2024-03-04T10:44:32.267506+0000","last_clean":"2024-03-04T10:44:32.267506+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T10:44:32.267506+0000","last_undegraded":"2024-03-04T10:44:32.267506+0000","last_fullsized":"2024-03-04T10:44:32.267506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":107561,"num_write":401,"num_write_kb":141953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'188","reported_seq":262,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:02.763056+0000","last_change":"2024-03-04T08:49:39.004512+0000","last_active":"2024-03-04T10:45:02.763056+0000","last_peered":"2024-03-04T10:45:02.763056+0000","last_clean":"2024-03-04T10:45:02.763056+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T10:45:02.763056+0000","last_undegraded":"2024-03-04T10:45:02.763056+0000","last_fullsized":"2024-03-04T10:45:02.763056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:25.195030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.655123+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T10:46:12.655123+0000","last_peered":"2024-03-04T10:46:12.655123+0000","last_clean":"2024-03-04T10:46:12.655123+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T10:46:12.655123+0000","last_undegraded":"2024-03-04T10:46:12.655123+0000","last_fullsized":"2024-03-04T10:46:12.655123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:35:55.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":57584,"num_write":412,"num_write_kb":99809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'422","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:56.938699+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T10:43:56.938699+0000","last_peered":"2024-03-04T10:43:56.938699+0000","last_clean":"2024-03-04T10:43:56.938699+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T10:43:56.938699+0000","last_undegraded":"2024-03-04T10:43:56.938699+0000","last_fullsized":"2024-03-04T10:43:56.938699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'391","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.607414+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T10:45:59.607414+0000","last_peered":"2024-03-04T10:45:59.607414+0000","last_clean":"2024-03-04T10:45:59.607414+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T10:45:59.607414+0000","last_undegraded":"2024-03-04T10:45:59.607414+0000","last_fullsized":"2024-03-04T10:45:59.607414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":13099,"num_write":371,"num_write_kb":42170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1143","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:36.565710+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T10:44:36.565710+0000","last_peered":"2024-03-04T10:44:36.565710+0000","last_clean":"2024-03-04T10:44:36.565710+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T10:44:36.565710+0000","last_undegraded":"2024-03-04T10:44:36.565710+0000","last_fullsized":"2024-03-04T10:44:36.565710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.926710+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T10:46:03.926710+0000","last_peered":"2024-03-04T10:46:03.926710+0000","last_clean":"2024-03-04T10:46:03.926710+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T10:46:03.926710+0000","last_undegraded":"2024-03-04T10:46:03.926710+0000","last_fullsized":"2024-03-04T10:46:03.926710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8812,"num_write":384,"num_write_kb":25790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1101","reported_seq":1173,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:23.752083+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T10:44:23.752083+0000","last_peered":"2024-03-04T10:44:23.752083+0000","last_clean":"2024-03-04T10:44:23.752083+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T10:44:23.752083+0000","last_undegraded":"2024-03-04T10:44:23.752083+0000","last_fullsized":"2024-03-04T10:44:23.752083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:24.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1045,"num_write_kb":12781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'434","reported_seq":518,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.652557+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T10:46:12.652557+0000","last_peered":"2024-03-04T10:46:12.652557+0000","last_clean":"2024-03-04T10:46:12.652557+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T10:46:12.652557+0000","last_undegraded":"2024-03-04T10:46:12.652557+0000","last_fullsized":"2024-03-04T10:46:12.652557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:29.174929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":39178,"num_write":404,"num_write_kb":64477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'406","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.654808+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T10:46:12.654808+0000","last_peered":"2024-03-04T10:46:12.654808+0000","last_clean":"2024-03-04T10:46:12.654808+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T10:46:12.654808+0000","last_undegraded":"2024-03-04T10:46:12.654808+0000","last_fullsized":"2024-03-04T10:46:12.654808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:52.550106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47257,"num_write":366,"num_write_kb":58992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'743","reported_seq":810,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:30.792066+0000","last_change":"2024-03-04T08:49:39.007626+0000","last_active":"2024-03-04T10:44:30.792066+0000","last_peered":"2024-03-04T10:44:30.792066+0000","last_clean":"2024-03-04T10:44:30.792066+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T10:44:30.792066+0000","last_undegraded":"2024-03-04T10:44:30.792066+0000","last_fullsized":"2024-03-04T10:44:30.792066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:27.289605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'402","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.662583+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T10:46:12.662583+0000","last_peered":"2024-03-04T10:46:12.662583+0000","last_clean":"2024-03-04T10:46:12.662583+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T10:46:12.662583+0000","last_undegraded":"2024-03-04T10:46:12.662583+0000","last_fullsized":"2024-03-04T10:46:12.662583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:41.141799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":109003,"num_write":376,"num_write_kb":109132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1351","reported_seq":1418,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.257420+0000","last_change":"2024-03-04T08:49:39.005586+0000","last_active":"2024-03-04T10:44:25.257420+0000","last_peered":"2024-03-04T10:44:25.257420+0000","last_clean":"2024-03-04T10:44:25.257420+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T10:44:25.257420+0000","last_undegraded":"2024-03-04T10:44:25.257420+0000","last_fullsized":"2024-03-04T10:44:25.257420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:00.117081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'366","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:32.476332+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T10:45:32.476332+0000","last_peered":"2024-03-04T10:45:32.476332+0000","last_clean":"2024-03-04T10:45:32.476332+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T10:45:32.476332+0000","last_undegraded":"2024-03-04T10:45:32.476332+0000","last_fullsized":"2024-03-04T10:45:32.476332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":85639,"num_write":344,"num_write_kb":59290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'544","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343090+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T10:45:48.343090+0000","last_peered":"2024-03-04T10:45:48.343090+0000","last_clean":"2024-03-04T10:45:48.343090+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T10:45:48.343090+0000","last_undegraded":"2024-03-04T10:45:48.343090+0000","last_fullsized":"2024-03-04T10:45:48.343090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'369","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.839193+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T10:45:59.839193+0000","last_peered":"2024-03-04T10:45:59.839193+0000","last_clean":"2024-03-04T10:45:59.839193+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T10:45:59.839193+0000","last_undegraded":"2024-03-04T10:45:59.839193+0000","last_fullsized":"2024-03-04T10:45:59.839193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":32203,"num_write":336,"num_write_kb":38117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'500","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:53.637263+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T10:45:53.637263+0000","last_peered":"2024-03-04T10:45:53.637263+0000","last_clean":"2024-03-04T10:45:53.637263+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T10:45:53.637263+0000","last_undegraded":"2024-03-04T10:45:53.637263+0000","last_fullsized":"2024-03-04T10:45:53.637263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1137,"num_read_kb":3491284,"num_write":24342,"num_write_kb":4342030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26175,"ondisk_log_size":26175,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":215639005,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":1417,"num_read_kb":2453,"num_write":28736,"num_write_kb":225847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":431521792,"data_stored":431278010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25545,"ondisk_log_size":25545,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510847,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149424,"kb_used_data":86312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94222416,"statfs":{"total":96636764160,"available":96483753984,"internally_reserved":0,"allocated":88383488,"data_stored":88178517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510848,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82260,"kb_used_data":33036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94289580,"statfs":{"total":96636764160,"available":96552529920,"internally_reserved":0,"allocated":33828864,"data_stored":33650583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510847,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121684,"kb_used_data":50252,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250156,"statfs":{"total":96636764160,"available":96512159744,"internally_reserved":0,"allocated":51458048,"data_stored":51270991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510847,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171936,"kb_used_data":82456,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199904,"statfs":{"total":96636764160,"available":96460701696,"internally_reserved":0,"allocated":84434944,"data_stored":84236183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543551,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101764,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270076,"statfs":{"total":96636764160,"available":96532557824,"internally_reserved":0,"allocated":35319808,"data_stored":35121154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78104,"kb_used_data":33040,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293736,"statfs":{"total":96636764160,"available":96556785664,"internally_reserved":0,"allocated":33832960,"data_stored":33652223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114556,"kb_used_data":51444,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":52678656,"data_stored":52488510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543552,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124984,"kb_used_data":53552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94246856,"statfs":{"total":96636764160,"available":96508780544,"internally_reserved":0,"allocated":54837248,"data_stored":54623873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84176896,"data_stored":84140772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50606080,"data_stored":50585212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33570816,"data_stored":33555172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88125440,"data_stored":88083106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54579200,"data_stored":54528462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51826688,"data_stored":51802731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33574912,"data_stored":33556812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35061760,"data_stored":35025743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T10:46:15.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T10:46:15.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.936+0000 7fb312600640 1 Processor -- start 2024-03-04T10:46:15.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.936+0000 7fb312600640 1 -- start start 2024-03-04T10:46:15.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.937+0000 7fb312600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.937+0000 7fb312600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb30c0ca900 0x7fb30c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.937+0000 7fb312600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb30c15c040 0x7fb30c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.937+0000 7fb312600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c15b310 con 0x7fb30c15c040 2024-03-04T10:46:15.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.937+0000 7fb312600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c15c4a0 con 0x7fb30c0ca900 2024-03-04T10:46:15.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.937+0000 7fb312600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c15a700 con 0x7fb30c0d01b0 2024-03-04T10:46:15.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.938+0000 7fb311200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.938+0000 7fb30be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb30c0ca900 0x7fb30c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.938+0000 7fb311c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb30c15c040 0x7fb30c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.939+0000 7fb30be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb30c0ca900 0x7fb30c15bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47964/0 (socket says 172.21.15.46:47964) 2024-03-04T10:46:15.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.939+0000 7fb30be00640 1 -- 172.21.15.46:0/3100844027 learned_addr learned my addr 172.21.15.46:0/3100844027 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.942+0000 7fb311c00640 1 -- 172.21.15.46:0/3100844027 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 msgr2=0x7fb30c0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.942+0000 7fb311c00640 1 --2- 172.21.15.46:0/3100844027 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.942+0000 7fb311c00640 1 -- 172.21.15.46:0/3100844027 >> v2:172.21.15.73:3300/0 conn(0x7fb30c0ca900 msgr2=0x7fb30c15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.942+0000 7fb311c00640 1 --2- 172.21.15.46:0/3100844027 >> v2:172.21.15.73:3300/0 conn(0x7fb30c0ca900 0x7fb30c15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.942+0000 7fb311c00640 1 -- 172.21.15.46:0/3100844027 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c15a9e0 con 0x7fb30c15c040 2024-03-04T10:46:15.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.944+0000 7fb311c00640 1 --2- 172.21.15.46:0/3100844027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c06d440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cd5c0 tx=0x7fb30402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb954fc22124648 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:15.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.949+0000 7fb30b400640 1 -- 172.21.15.46:0/3100844027 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304035020 con 0x7fb30c15c040 2024-03-04T10:46:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.949+0000 7fb30b400640 1 -- 172.21.15.46:0/3100844027 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb304031830 con 0x7fb30c15c040 2024-03-04T10:46:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.949+0000 7fb30b400640 1 -- 172.21.15.46:0/3100844027 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304031c00 con 0x7fb30c15c040 2024-03-04T10:46:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 -- 172.21.15.46:0/3100844027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 msgr2=0x7fb30c06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 --2- 172.21.15.46:0/3100844027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c06d440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cd5c0 tx=0x7fb30402b8d0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 -- 172.21.15.46:0/3100844027 shutdown_connections 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 --2- 172.21.15.46:0/3100844027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c06d440 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 --2- 172.21.15.46:0/3100844027 >> v2:172.21.15.73:3300/0 conn(0x7fb30c0ca900 0x7fb30c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 --2- 172.21.15.46:0/3100844027 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 -- 172.21.15.46:0/3100844027 >> 172.21.15.46:0/3100844027 conn(0x7fb30c066c40 msgr2=0x7fb30c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 -- 172.21.15.46:0/3100844027 shutdown_connections 2024-03-04T10:46:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.950+0000 7fb312600640 1 -- 172.21.15.46:0/3100844027 wait complete. 2024-03-04T10:46:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.952+0000 7fb312600640 1 Processor -- start 2024-03-04T10:46:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.952+0000 7fb312600640 1 -- start start 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.953+0000 7fb312600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0ca900 0x7fb30c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.953+0000 7fb312600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.953+0000 7fb312600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.953+0000 7fb312600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0d0590 con 0x7fb30c15c040 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.953+0000 7fb312600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c15afa0 con 0x7fb30c0ca900 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.953+0000 7fb312600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c15a3b0 con 0x7fb30c0d01b0 2024-03-04T10:46:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.954+0000 7fb311200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0ca900 0x7fb30c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.954+0000 7fb30be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.954+0000 7fb311c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:15.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.954+0000 7fb311200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0ca900 0x7fb30c0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47968/0 (socket says 172.21.15.46:47968) 2024-03-04T10:46:15.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.954+0000 7fb311200640 1 -- 172.21.15.46:0/2309528527 learned_addr learned my addr 172.21.15.46:0/2309528527 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:15.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.959+0000 7fb30be00640 1 -- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0ca900 msgr2=0x7fb30c0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.959+0000 7fb30be00640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0ca900 0x7fb30c0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.959+0000 7fb30be00640 1 -- 172.21.15.46:0/2309528527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 msgr2=0x7fb30c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:15.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.959+0000 7fb30be00640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:15.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.959+0000 7fb30be00640 1 -- 172.21.15.46:0/2309528527 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c1f3110 con 0x7fb30c0d01b0 2024-03-04T10:46:15.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.962+0000 7fb30be00640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ce110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800e870 tx=0x7fb2f800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:15.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.967+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8017070 con 0x7fb30c0d01b0 2024-03-04T10:46:15.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.967+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800ee60 con 0x7fb30c0d01b0 2024-03-04T10:46:15.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.967+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800cb60 con 0x7fb30c0d01b0 2024-03-04T10:46:15.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.967+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c1f33b0 con 0x7fb30c0d01b0 2024-03-04T10:46:15.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.968+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c1560a0 con 0x7fb30c0d01b0 2024-03-04T10:46:15.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:15.969+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c04f330 con 0x7fb30c0d01b0 2024-03-04T10:46:16.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.005+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2f801a070 con 0x7fb30c0d01b0 2024-03-04T10:46:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.005+0000 7fb308c00640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb2ec06b520 0x7fb2ec06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.006+0000 7fb311200640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb2ec06b520 0x7fb2ec06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.007+0000 7fb311200640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb2ec06b520 0x7fb2ec06d9e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb300009a40 tx=0x7fb30000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.007+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb2f8056fc0 con 0x7fb30c0d01b0 2024-03-04T10:46:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.329+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb2f8058f20 con 0x7fb30c0d01b0 2024-03-04T10:46:16.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.539+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb30c0671c0 con 0x7fb30c0d01b0 2024-03-04T10:46:16.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.605+0000 7fb308c00640 1 -- 172.21.15.46:0/2309528527 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16598 (secure 0 0 0) 0x7fb2f805cfc0 con 0x7fb30c0d01b0 2024-03-04T10:46:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:16.609 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:50:11.544052+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T10:46:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb2ec06b520 msgr2=0x7fb2ec06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb2ec06b520 0x7fb2ec06d9e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb300009a40 tx=0x7fb30000b040 comp rx=0 tx=0).stop 2024-03-04T10:46:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 msgr2=0x7fb30c0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ce110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800e870 tx=0x7fb2f800ed30 comp rx=0 tx=0).stop 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 shutdown_connections 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb2ec06b520 0x7fb2ec06d9e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb30c15c040 0x7fb30c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb30c0d01b0 0x7fb30c0ce110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 --2- 172.21.15.46:0/2309528527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0ca900 0x7fb30c0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 >> 172.21.15.46:0/2309528527 conn(0x7fb30c066c40 msgr2=0x7fb30c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 shutdown_connections 2024-03-04T10:46:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:16.608+0000 7fb312600640 1 -- 172.21.15.46:0/2309528527 wait complete. 2024-03-04T10:46:17.638 INFO:tasks.ceph:Scrubbing osd.0 2024-03-04T10:46:17.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:17.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.834+0000 7ff5bd400640 1 Processor -- start 2024-03-04T10:46:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.834+0000 7ff5bd400640 1 -- start start 2024-03-04T10:46:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.836+0000 7ff5bd400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5b8152250 0x7ff5b80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.836+0000 7ff5bd400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5b806f8a0 0x7ff5b81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.836+0000 7ff5bd400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b815bab0 con 0x7ff5b8158cf0 2024-03-04T10:46:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.836+0000 7ff5bd400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b815bd90 con 0x7ff5b806f8a0 2024-03-04T10:46:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.836+0000 7ff5bd400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b815c070 con 0x7ff5b8152250 2024-03-04T10:46:17.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.838+0000 7ff5b7200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff5b8158cf0 0x7ff5b80c5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39094/0 (socket says 172.21.15.46:39094) 2024-03-04T10:46:17.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.838+0000 7ff5b7200640 1 -- 172.21.15.46:0/3305818843 learned_addr learned my addr 172.21.15.46:0/3305818843 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:17.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.838+0000 7ff5b6800640 1 --2- 172.21.15.46:0/3305818843 >> v2:172.21.15.73:3300/0 conn(0x7ff5b8152250 0x7ff5b80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.838+0000 7ff5b5e00640 1 --2- 172.21.15.46:0/3305818843 >> v2:172.21.15.46:3300/0 conn(0x7ff5b806f8a0 0x7ff5b81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.843+0000 7ff5b6800640 1 -- 172.21.15.46:0/3305818843 >> v2:172.21.15.46:3300/0 conn(0x7ff5b806f8a0 msgr2=0x7ff5b81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:17.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.843+0000 7ff5b6800640 1 --2- 172.21.15.46:0/3305818843 >> v2:172.21.15.46:3300/0 conn(0x7ff5b806f8a0 0x7ff5b81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:17.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.843+0000 7ff5b6800640 1 -- 172.21.15.46:0/3305818843 >> v1:172.21.15.46:6789/0 conn(0x7ff5b8158cf0 legacy=0x7ff5b80c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.843+0000 7ff5b6800640 1 -- 172.21.15.46:0/3305818843 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b815c350 con 0x7ff5b8152250 2024-03-04T10:46:17.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.847+0000 7ff5b6800640 1 --2- 172.21.15.46:0/3305818843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b8152250 0x7ff5b80c6d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80c83e0 tx=0x7ff5a802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1376a7f1d83db792 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:17.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.854+0000 7ff5b5400640 1 -- 172.21.15.46:0/3305818843 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8034070 con 0x7ff5b8152250 2024-03-04T10:46:17.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.854+0000 7ff5b5400640 1 -- 172.21.15.46:0/3305818843 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8030610 con 0x7ff5b8152250 2024-03-04T10:46:17.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.854+0000 7ff5b5400640 1 -- 172.21.15.46:0/3305818843 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80309e0 con 0x7ff5b8152250 2024-03-04T10:46:17.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 -- 172.21.15.46:0/3305818843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b8152250 msgr2=0x7ff5b80c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 --2- 172.21.15.46:0/3305818843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b8152250 0x7ff5b80c6d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80c83e0 tx=0x7ff5a802b960 comp rx=0 tx=0).stop 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 -- 172.21.15.46:0/3305818843 shutdown_connections 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 --2- 172.21.15.46:0/3305818843 >> v2:172.21.15.46:3300/0 conn(0x7ff5b806f8a0 0x7ff5b81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 --2- 172.21.15.46:0/3305818843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b8152250 0x7ff5b80c6d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 -- 172.21.15.46:0/3305818843 >> 172.21.15.46:0/3305818843 conn(0x7ff5b806aff0 msgr2=0x7ff5b806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 -- 172.21.15.46:0/3305818843 shutdown_connections 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.855+0000 7ff5bd400640 1 -- 172.21.15.46:0/3305818843 wait complete. 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.857+0000 7ff5bd400640 1 Processor -- start 2024-03-04T10:46:17.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.857+0000 7ff5bd400640 1 -- start start 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.858+0000 7ff5bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b806f8a0 0x7ff5b814a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.858+0000 7ff5bd400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5b8152250 0x7ff5b815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.858+0000 7ff5bd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5b8158cf0 0x7ff5b81e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.858+0000 7ff5bd400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b806fe70 con 0x7ff5b8158cf0 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.858+0000 7ff5bd400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b806fcf0 con 0x7ff5b806f8a0 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.858+0000 7ff5bd400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b8152630 con 0x7ff5b8152250 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.859+0000 7ff5b6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b806f8a0 0x7ff5b814a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.859+0000 7ff5b7200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5b8158cf0 0x7ff5b81e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.859+0000 7ff5b7200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5b8158cf0 0x7ff5b81e1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39620/0 (socket says 172.21.15.46:39620) 2024-03-04T10:46:17.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.859+0000 7ff5b7200640 1 -- 172.21.15.46:0/4114928931 learned_addr learned my addr 172.21.15.46:0/4114928931 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:17.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.859+0000 7ff5b5e00640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5b8152250 0x7ff5b815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.863+0000 7ff5b7200640 1 -- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5b8152250 msgr2=0x7ff5b815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.863+0000 7ff5b7200640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5b8152250 0x7ff5b815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:17.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.863+0000 7ff5b7200640 1 -- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b806f8a0 msgr2=0x7ff5b814a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.863+0000 7ff5b7200640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b806f8a0 0x7ff5b814a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:17.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.863+0000 7ff5b7200640 1 -- 172.21.15.46:0/4114928931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b81f1660 con 0x7ff5b8158cf0 2024-03-04T10:46:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.865+0000 7ff5b7200640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5b8158cf0 0x7ff5b81e1340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000cbf0 tx=0x7ff5b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.870+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0017070 con 0x7ff5b8158cf0 2024-03-04T10:46:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.870+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b000ad40 con 0x7ff5b8158cf0 2024-03-04T10:46:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.870+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0012600 con 0x7ff5b8158cf0 2024-03-04T10:46:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.870+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b81f1940 con 0x7ff5b8158cf0 2024-03-04T10:46:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.870+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b81f1f00 con 0x7ff5b8158cf0 2024-03-04T10:46:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.872+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5b81f1410 con 0x7ff5b8158cf0 2024-03-04T10:46:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.902+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5b001a070 con 0x7ff5b8158cf0 2024-03-04T10:46:17.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.903+0000 7ff5aea00640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff59806b520 0x7ff59806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.904+0000 7ff5b6800640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff59806b520 0x7ff59806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.905+0000 7ff5b6800640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff59806b520 0x7ff59806d9e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8036000 tx=0x7ff5a803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:17.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.909+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff5b0056f90 con 0x7ff5b8158cf0 2024-03-04T10:46:17.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.909+0000 7ff5aea00640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7ff598073780 0x7ff598075ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:17.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.909+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 --> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5b000de50 con 0x7ff598073780 2024-03-04T10:46:17.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.909+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b0055190 con 0x7ff5b8158cf0 2024-03-04T10:46:17.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.909+0000 7ff5b5e00640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7ff598073780 0x7ff598075ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:17.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.910+0000 7ff5b5e00640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7ff598073780 0x7ff598075ba0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:17.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.912+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== osd.0 v2:172.21.15.46:6807/873994847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff5b000de50 con 0x7ff598073780 2024-03-04T10:46:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.931+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 --> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5b8068ad0 con 0x7ff598073780 2024-03-04T10:46:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.931+0000 7ff5aea00640 1 -- 172.21.15.46:0/4114928931 <== osd.0 v2:172.21.15.46:6807/873994847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff5b8068ad0 con 0x7ff598073780 2024-03-04T10:46:17.935 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:17.935 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:17.935 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7ff598073780 msgr2=0x7ff598075ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:6807/873994847,v1:172.21.15.46:6809/873994847] conn(0x7ff598073780 0x7ff598075ba0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff59806b520 msgr2=0x7ff59806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff59806b520 0x7ff59806d9e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8036000 tx=0x7ff5a803b040 comp rx=0 tx=0).stop 2024-03-04T10:46:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5b8158cf0 msgr2=0x7ff5b81e1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 --2- 172.21.15.46:0/4114928931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5b8158cf0 0x7ff5b81e1340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000cbf0 tx=0x7ff5b000a430 comp rx=0 tx=0).stop 2024-03-04T10:46:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5b7200640 1 -- 172.21.15.46:0/4114928931 reap_dead start 2024-03-04T10:46:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 shutdown_connections 2024-03-04T10:46:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.932+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 >> 172.21.15.46:0/4114928931 conn(0x7ff5b806aff0 msgr2=0x7ff5b8156570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.933+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 shutdown_connections 2024-03-04T10:46:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:17.933+0000 7ff5bd400640 1 -- 172.21.15.46:0/4114928931 wait complete. 2024-03-04T10:46:17.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-04T10:46:18.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.133+0000 7fcca4e00640 1 Processor -- start 2024-03-04T10:46:18.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.133+0000 7fcca4e00640 1 -- start start 2024-03-04T10:46:18.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.134+0000 7fcca4e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcca0154600 0x7fcca00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.134+0000 7fcca4e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca015a3c0 0x7fcca00cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.134+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00cb3a0 0x7fcca006c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.134+0000 7fcca4e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00cb8f0 con 0x7fcca0154600 2024-03-04T10:46:18.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.134+0000 7fcca4e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00cb190 con 0x7fcca015a3c0 2024-03-04T10:46:18.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.134+0000 7fcca4e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015a870 con 0x7fcca00cb3a0 2024-03-04T10:46:18.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.135+0000 7fcc9f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcca0154600 0x7fcca00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.135+0000 7fcc9ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca015a3c0 0x7fcca00cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.136+0000 7fcc9fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00cb3a0 0x7fcca006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.136+0000 7fcc9f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcca0154600 0x7fcca00cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39628/0 (socket says 172.21.15.46:39628) 2024-03-04T10:46:18.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.136+0000 7fcc9f400640 1 -- 172.21.15.46:0/645078890 learned_addr learned my addr 172.21.15.46:0/645078890 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.138+0000 7fcc9fe00640 1 -- 172.21.15.46:0/645078890 >> v2:172.21.15.73:3300/0 conn(0x7fcca015a3c0 msgr2=0x7fcca00cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.138+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/645078890 >> v2:172.21.15.73:3300/0 conn(0x7fcca015a3c0 0x7fcca00cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.138+0000 7fcc9fe00640 1 -- 172.21.15.46:0/645078890 >> v2:172.21.15.46:3300/0 conn(0x7fcca0154600 msgr2=0x7fcca00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.138+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/645078890 >> v2:172.21.15.46:3300/0 conn(0x7fcca0154600 0x7fcca00cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.138+0000 7fcc9fe00640 1 -- 172.21.15.46:0/645078890 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca015ab50 con 0x7fcca00cb3a0 2024-03-04T10:46:18.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.141+0000 7fcc9fe00640 1 --2- 172.21.15.46:0/645078890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00cb3a0 0x7fcca006c130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcca006da30 tx=0x7fcc9802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2dc723a8230bfa9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.143+0000 7fcc9e000640 1 -- 172.21.15.46:0/645078890 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98039070 con 0x7fcca00cb3a0 2024-03-04T10:46:18.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.145+0000 7fcc9e000640 1 -- 172.21.15.46:0/645078890 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9802cbd0 con 0x7fcca00cb3a0 2024-03-04T10:46:18.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.145+0000 7fcc9e000640 1 -- 172.21.15.46:0/645078890 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98034440 con 0x7fcca00cb3a0 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 -- 172.21.15.46:0/645078890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00cb3a0 msgr2=0x7fcca006c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 --2- 172.21.15.46:0/645078890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00cb3a0 0x7fcca006c130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcca006da30 tx=0x7fcc9802be20 comp rx=0 tx=0).stop 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 -- 172.21.15.46:0/645078890 shutdown_connections 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 --2- 172.21.15.46:0/645078890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca00cb3a0 0x7fcca006c130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 --2- 172.21.15.46:0/645078890 >> v2:172.21.15.73:3300/0 conn(0x7fcca015a3c0 0x7fcca00cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 --2- 172.21.15.46:0/645078890 >> v2:172.21.15.46:3300/0 conn(0x7fcca0154600 0x7fcca00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 -- 172.21.15.46:0/645078890 >> 172.21.15.46:0/645078890 conn(0x7fcca00b17c0 msgr2=0x7fcca00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 -- 172.21.15.46:0/645078890 shutdown_connections 2024-03-04T10:46:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.146+0000 7fcca4e00640 1 -- 172.21.15.46:0/645078890 wait complete. 2024-03-04T10:46:18.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.149+0000 7fcca4e00640 1 Processor -- start 2024-03-04T10:46:18.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.149+0000 7fcca4e00640 1 -- start start 2024-03-04T10:46:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca00cb3a0 0x7fcca01f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 0x7fcca00cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca015a3c0 0x7fcca01497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcca4e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00cd9d0 con 0x7fcca00cb3a0 2024-03-04T10:46:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcca4e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015b110 con 0x7fcca015a3c0 2024-03-04T10:46:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcca4e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca01549e0 con 0x7fcca0154600 2024-03-04T10:46:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.151+0000 7fcc9ea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 0x7fcca00cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.152+0000 7fcc9fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca015a3c0 0x7fcca01497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.152+0000 7fcc9f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca00cb3a0 0x7fcca01f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.152+0000 7fcc9ea00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 0x7fcca00cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44834/0 (socket says 172.21.15.46:44834) 2024-03-04T10:46:18.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.152+0000 7fcc9ea00640 1 -- 172.21.15.46:0/18154306 learned_addr learned my addr 172.21.15.46:0/18154306 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.155+0000 7fcc9ea00640 1 -- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca015a3c0 msgr2=0x7fcca01497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.155+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca015a3c0 0x7fcca01497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.155+0000 7fcc9ea00640 1 -- 172.21.15.46:0/18154306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca00cb3a0 msgr2=0x7fcca01f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.155+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca00cb3a0 0x7fcca01f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.155+0000 7fcc9ea00640 1 -- 172.21.15.46:0/18154306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00b55a0 con 0x7fcca0154600 2024-03-04T10:46:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.158+0000 7fcc9ea00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 0x7fcca00cfc40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e840 tx=0x7fcc8c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.160+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c017070 con 0x7fcca0154600 2024-03-04T10:46:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.160+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca0150100 con 0x7fcca0154600 2024-03-04T10:46:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.160+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca00b2770 con 0x7fcca0154600 2024-03-04T10:46:18.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.162+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca0075240 con 0x7fcca0154600 2024-03-04T10:46:18.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.369+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c005990 con 0x7fcca0154600 2024-03-04T10:46:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.448+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c021060 con 0x7fcca0154600 2024-03-04T10:46:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.451+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc8c01a070 con 0x7fcca0154600 2024-03-04T10:46:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.453+0000 7fcc97400640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b4d0 0x7fcc8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.453+0000 7fcc9f400640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b4d0 0x7fcc8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.454+0000 7fcc9f400640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b4d0 0x7fcc8006d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009bd0 tx=0x7fcc90009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.459+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcc8c056ff0 con 0x7fcca0154600 2024-03-04T10:46:18.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.472+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcc8c058f50 con 0x7fcca0154600 2024-03-04T10:46:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.697+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcca00cd200 con 0x7fcc8006b4d0 2024-03-04T10:46:18.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.698+0000 7fcc97400640 1 -- 172.21.15.46:0/18154306 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcca00cd200 con 0x7fcc8006b4d0 2024-03-04T10:46:18.702 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b4d0 msgr2=0x7fcc8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b4d0 0x7fcc8006d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009bd0 tx=0x7fcc90009240 comp rx=0 tx=0).stop 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 msgr2=0x7fcca00cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 0x7fcca00cfc40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e840 tx=0x7fcc8c00ed00 comp rx=0 tx=0).stop 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 shutdown_connections 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fcc8006b4d0 0x7fcc8006d990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca015a3c0 0x7fcca01497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcca0154600 0x7fcca00cfc40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 --2- 172.21.15.46:0/18154306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcca00cb3a0 0x7fcca01f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 >> 172.21.15.46:0/18154306 conn(0x7fcca00b17c0 msgr2=0x7fcca00cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 shutdown_connections 2024-03-04T10:46:18.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.701+0000 7fcca4e00640 1 -- 172.21.15.46:0/18154306 wait complete. 2024-03-04T10:46:18.729 INFO:tasks.ceph:Scrubbing osd.1 2024-03-04T10:46:18.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:18.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.934+0000 7f33a7400640 1 Processor -- start 2024-03-04T10:46:18.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.934+0000 7f33a7400640 1 -- start start 2024-03-04T10:46:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.935+0000 7f33a7400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 0x7f33a00cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.935+0000 7f33a7400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33a00cd800 0x7f33a00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.935+0000 7f33a7400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a015a820 con 0x7f33a015a2e0 2024-03-04T10:46:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.935+0000 7f33a7400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a015aae0 con 0x7f33a00cd800 2024-03-04T10:46:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.935+0000 7f33a7400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a015adc0 con 0x7f33a00cd420 2024-03-04T10:46:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.936+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 0x7f33a00cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.936+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 0x7f33a00cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44848/0 (socket says 172.21.15.46:44848) 2024-03-04T10:46:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.936+0000 7f33a4a00640 1 -- 172.21.15.46:0/2868603706 learned_addr learned my addr 172.21.15.46:0/2868603706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.940+0000 7f33a4a00640 1 -- 172.21.15.46:0/2868603706 >> v2:172.21.15.46:3300/0 conn(0x7f33a00cd800 msgr2=0x7f33a00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.940+0000 7f33a4a00640 1 --2- 172.21.15.46:0/2868603706 >> v2:172.21.15.46:3300/0 conn(0x7f33a00cd800 0x7f33a00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.940+0000 7f33a4a00640 1 -- 172.21.15.46:0/2868603706 >> v1:172.21.15.46:6789/0 conn(0x7f33a015a2e0 legacy=0x7f33a0150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.940+0000 7f33a4a00640 1 -- 172.21.15.46:0/2868603706 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a015b0a0 con 0x7f33a00cd420 2024-03-04T10:46:18.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.943+0000 7f33a4a00640 1 --2- 172.21.15.46:0/2868603706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 0x7f33a00cc1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3394009870 tx=0x7f339402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3011f01b13475eb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.946+0000 7f339f400640 1 -- 172.21.15.46:0/2868603706 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394034070 con 0x7f33a00cd420 2024-03-04T10:46:18.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.949+0000 7f339f400640 1 -- 172.21.15.46:0/2868603706 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3394030840 con 0x7f33a00cd420 2024-03-04T10:46:18.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.949+0000 7f339f400640 1 -- 172.21.15.46:0/2868603706 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394030c10 con 0x7f33a00cd420 2024-03-04T10:46:18.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.949+0000 7f33a7400640 1 -- 172.21.15.46:0/2868603706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 msgr2=0x7f33a00cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.949+0000 7f33a7400640 1 --2- 172.21.15.46:0/2868603706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 0x7f33a00cc1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3394009870 tx=0x7f339402b980 comp rx=0 tx=0).stop 2024-03-04T10:46:18.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.950+0000 7f33a7400640 1 -- 172.21.15.46:0/2868603706 shutdown_connections 2024-03-04T10:46:18.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.950+0000 7f33a7400640 1 --2- 172.21.15.46:0/2868603706 >> v2:172.21.15.46:3300/0 conn(0x7f33a00cd800 0x7f33a00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.950+0000 7f33a7400640 1 --2- 172.21.15.46:0/2868603706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd420 0x7f33a00cc1b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.950+0000 7f33a7400640 1 -- 172.21.15.46:0/2868603706 >> 172.21.15.46:0/2868603706 conn(0x7f33a0066c40 msgr2=0x7f33a0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:18.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.950+0000 7f33a7400640 1 -- 172.21.15.46:0/2868603706 shutdown_connections 2024-03-04T10:46:18.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.950+0000 7f33a7400640 1 -- 172.21.15.46:0/2868603706 wait complete. 2024-03-04T10:46:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.951+0000 7f33a7400640 1 Processor -- start 2024-03-04T10:46:18.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.951+0000 7f33a7400640 1 -- start start 2024-03-04T10:46:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.952+0000 7f33a7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a00cd420 0x7f33a006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.952+0000 7f33a7400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd800 0x7f33a00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.952+0000 7f33a7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a015a2e0 0x7f33a00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.952+0000 7f33a7400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0151450 con 0x7f33a015a2e0 2024-03-04T10:46:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.952+0000 7f33a7400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01512d0 con 0x7f33a00cd420 2024-03-04T10:46:18.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.952+0000 7f33a7400640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00ca6c0 con 0x7f33a00cd800 2024-03-04T10:46:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.953+0000 7f339fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd800 0x7f33a00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.953+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a00cd420 0x7f33a006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.953+0000 7f33a5400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a015a2e0 0x7f33a00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.953+0000 7f339fe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd800 0x7f33a00c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44856/0 (socket says 172.21.15.46:44856) 2024-03-04T10:46:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.953+0000 7f339fe00640 1 -- 172.21.15.46:0/3075864916 learned_addr learned my addr 172.21.15.46:0/3075864916 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.957+0000 7f339fe00640 1 -- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a00cd420 msgr2=0x7f33a006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.957+0000 7f339fe00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a00cd420 0x7f33a006eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.957+0000 7f339fe00640 1 -- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a015a2e0 msgr2=0x7f33a00c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.957+0000 7f339fe00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a015a2e0 0x7f33a00c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.957+0000 7f339fe00640 1 -- 172.21.15.46:0/3075864916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a014d060 con 0x7f33a00cd800 2024-03-04T10:46:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.960+0000 7f339fe00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd800 0x7f33a00c9830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b4a0 tx=0x7f338c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.965+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c014070 con 0x7f33a00cd800 2024-03-04T10:46:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.965+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c010610 con 0x7f33a00cd800 2024-03-04T10:46:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.965+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c010a00 con 0x7f33a00cd800 2024-03-04T10:46:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.965+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01f1540 con 0x7f33a00cd800 2024-03-04T10:46:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.965+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a014cd80 con 0x7f33a00cd800 2024-03-04T10:46:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.966+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33a00680b0 con 0x7f33a00cd800 2024-03-04T10:46:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.988+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f338c017070 con 0x7f33a00cd800 2024-03-04T10:46:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.989+0000 7f339cc00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f338006b520 0x7f338006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.990+0000 7f33a4a00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f338006b520 0x7f338006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.990+0000 7f33a4a00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f338006b520 0x7f338006d9e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3394036000 tx=0x7f3394008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.993+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f338c0569d0 con 0x7f33a00cd800 2024-03-04T10:46:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.994+0000 7f339cc00640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7f3380073780 0x7f3380075ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.994+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 --> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3380076270 con 0x7f3380073780 2024-03-04T10:46:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.994+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f338c054bd0 con 0x7f33a00cd800 2024-03-04T10:46:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.994+0000 7f33a5400640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7f3380073780 0x7f3380075ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:18.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.995+0000 7f33a5400640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7f3380073780 0x7f3380075ba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:18.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:18.996+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== osd.1 v2:172.21.15.46:6800/2230640805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3380076270 con 0x7f3380073780 2024-03-04T10:46:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.014+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 --> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33a0157d00 con 0x7f3380073780 2024-03-04T10:46:19.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f339cc00640 1 -- 172.21.15.46:0/3075864916 <== osd.1 v2:172.21.15.46:6800/2230640805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f33a0157d00 con 0x7f3380073780 2024-03-04T10:46:19.018 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:19.019 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:19.019 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7f3380073780 msgr2=0x7f3380075ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f33a7400640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.46:6800/2230640805,v1:172.21.15.46:6801/2230640805] conn(0x7f3380073780 0x7f3380075ba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f338006b520 msgr2=0x7f338006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f33a7400640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f338006b520 0x7f338006d9e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3394036000 tx=0x7f3394008030 comp rx=0 tx=0).stop 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd800 msgr2=0x7f33a00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.015+0000 7f33a7400640 1 --2- 172.21.15.46:0/3075864916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33a00cd800 0x7f33a00c9830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b4a0 tx=0x7f338c00b960 comp rx=0 tx=0).stop 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.016+0000 7f33a5400640 1 -- 172.21.15.46:0/3075864916 reap_dead start 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.016+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 shutdown_connections 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.016+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 >> 172.21.15.46:0/3075864916 conn(0x7f33a0066c40 msgr2=0x7f33a006cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.016+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 shutdown_connections 2024-03-04T10:46:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.016+0000 7f33a7400640 1 -- 172.21.15.46:0/3075864916 wait complete. 2024-03-04T10:46:19.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-04T10:46:19.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.216+0000 7f0a43000640 1 Processor -- start 2024-03-04T10:46:19.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.217+0000 7f0a43000640 1 -- start start 2024-03-04T10:46:19.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.218+0000 7f0a43000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0a3c154750 0x7f0a3c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:19.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.218+0000 7f0a43000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 0x7f0a3c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:19.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.218+0000 7f0a43000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0ca6d0 con 0x7f0a3c154b30 2024-03-04T10:46:19.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.218+0000 7f0a43000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0ca990 con 0x7f0a3c154750 2024-03-04T10:46:19.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.219+0000 7f0a43000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0cac70 con 0x7f0a3c0cc700 2024-03-04T10:46:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.219+0000 7f0a41000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 0x7f0a3c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.220+0000 7f0a3be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0a3c154750 0x7f0a3c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.220+0000 7f0a41000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 0x7f0a3c0ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44870/0 (socket says 172.21.15.46:44870) 2024-03-04T10:46:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.220+0000 7f0a41000640 1 -- 172.21.15.46:0/3309614469 learned_addr learned my addr 172.21.15.46:0/3309614469 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.223+0000 7f0a41000640 1 -- 172.21.15.46:0/3309614469 >> v2:172.21.15.46:3300/0 conn(0x7f0a3c154750 msgr2=0x7f0a3c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.223+0000 7f0a41000640 1 --2- 172.21.15.46:0/3309614469 >> v2:172.21.15.46:3300/0 conn(0x7f0a3c154750 0x7f0a3c0cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.223+0000 7f0a41000640 1 -- 172.21.15.46:0/3309614469 >> v1:172.21.15.46:6789/0 conn(0x7f0a3c154b30 legacy=0x7f0a3c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.223+0000 7f0a41000640 1 -- 172.21.15.46:0/3309614469 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c15a900 con 0x7f0a3c0cc700 2024-03-04T10:46:19.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.226+0000 7f0a41000640 1 --2- 172.21.15.46:0/3309614469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 0x7f0a3c0ccb70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009e50 tx=0x7f0a3402bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce3523fccd110a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.231+0000 7f0a3aa00640 1 -- 172.21.15.46:0/3309614469 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3402cb80 con 0x7f0a3c0cc700 2024-03-04T10:46:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.231+0000 7f0a3aa00640 1 -- 172.21.15.46:0/3309614469 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3402cd20 con 0x7f0a3c0cc700 2024-03-04T10:46:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.231+0000 7f0a3aa00640 1 -- 172.21.15.46:0/3309614469 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34034610 con 0x7f0a3c0cc700 2024-03-04T10:46:19.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 -- 172.21.15.46:0/3309614469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 msgr2=0x7f0a3c0ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 --2- 172.21.15.46:0/3309614469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 0x7f0a3c0ccb70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009e50 tx=0x7f0a3402bfe0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 -- 172.21.15.46:0/3309614469 shutdown_connections 2024-03-04T10:46:19.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 --2- 172.21.15.46:0/3309614469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0cc700 0x7f0a3c0ccb70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 --2- 172.21.15.46:0/3309614469 >> v2:172.21.15.46:3300/0 conn(0x7f0a3c154750 0x7f0a3c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 -- 172.21.15.46:0/3309614469 >> 172.21.15.46:0/3309614469 conn(0x7f0a3c066c40 msgr2=0x7f0a3c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:19.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 -- 172.21.15.46:0/3309614469 shutdown_connections 2024-03-04T10:46:19.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.232+0000 7f0a43000640 1 -- 172.21.15.46:0/3309614469 wait complete. 2024-03-04T10:46:19.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.235+0000 7f0a43000640 1 Processor -- start 2024-03-04T10:46:19.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.235+0000 7f0a43000640 1 -- start start 2024-03-04T10:46:19.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.236+0000 7f0a43000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a3c0cc700 0x7f0a3c14c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:19.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.236+0000 7f0a43000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3c154750 0x7f0a3c1f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:19.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.236+0000 7f0a43000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 0x7f0a3c1f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:19.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.236+0000 7f0a43000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0ce820 con 0x7f0a3c0cc700 2024-03-04T10:46:19.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.236+0000 7f0a43000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c15aec0 con 0x7f0a3c154750 2024-03-04T10:46:19.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.236+0000 7f0a43000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c15a5b0 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.237+0000 7f0a41000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 0x7f0a3c1f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:19.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.237+0000 7f0a3b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3c154750 0x7f0a3c1f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:19.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.237+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a3c0cc700 0x7f0a3c14c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:19.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.237+0000 7f0a41000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 0x7f0a3c1f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44876/0 (socket says 172.21.15.46:44876) 2024-03-04T10:46:19.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.237+0000 7f0a41000640 1 -- 172.21.15.46:0/2040478098 learned_addr learned my addr 172.21.15.46:0/2040478098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:19.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.241+0000 7f0a41000640 1 -- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3c154750 msgr2=0x7f0a3c1f10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.241+0000 7f0a41000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3c154750 0x7f0a3c1f10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.241+0000 7f0a41000640 1 -- 172.21.15.46:0/2040478098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a3c0cc700 msgr2=0x7f0a3c14c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.241+0000 7f0a41000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a3c0cc700 0x7f0a3c14c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.241+0000 7f0a41000640 1 -- 172.21.15.46:0/2040478098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c1e4a70 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.243+0000 7f0a41000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 0x7f0a3c1f3e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009e50 tx=0x7f0a34004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:19.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.247+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34043020 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.247+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3403e450 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.247+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34009510 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.247+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c1f08e0 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.247+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c1e3bf0 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.248+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c0680b0 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.270+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a34046020 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.271+0000 7f0a33e00640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0a1c06b520 0x7f0a1c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:19.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.271+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0a340acba0 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.272+0000 7f0a3be00640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0a1c06b520 0x7f0a1c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:19.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.273+0000 7f0a3be00640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0a1c06b520 0x7f0a1c06d9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009b40 tx=0x7f0a2c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:19.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.556+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0a3404d030 con 0x7f0a3c0b59a0 2024-03-04T10:46:19.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.787+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a3c0cd260 con 0x7f0a1c06b520 2024-03-04T10:46:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.787+0000 7f0a33e00640 1 -- 172.21.15.46:0/2040478098 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0a3c0cd260 con 0x7f0a1c06b520 2024-03-04T10:46:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0a1c06b520 msgr2=0x7f0a1c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0a1c06b520 0x7f0a1c06d9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009b40 tx=0x7f0a2c009190 comp rx=0 tx=0).stop 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 msgr2=0x7f0a3c1f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 0x7f0a3c1f3e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009e50 tx=0x7f0a34004a40 comp rx=0 tx=0).stop 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 shutdown_connections 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f0a1c06b520 0x7f0a1c06d9e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3c154750 0x7f0a3c1f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a3c0b59a0 0x7f0a3c1f3e50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 --2- 172.21.15.46:0/2040478098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a3c0cc700 0x7f0a3c14c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 >> 172.21.15.46:0/2040478098 conn(0x7f0a3c066c40 msgr2=0x7f0a3c150280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 shutdown_connections 2024-03-04T10:46:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:19.790+0000 7f0a43000640 1 -- 172.21.15.46:0/2040478098 wait complete. 2024-03-04T10:46:19.811 INFO:tasks.ceph:Scrubbing osd.2 2024-03-04T10:46:19.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:20.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.027+0000 7f1c28a00640 1 Processor -- start 2024-03-04T10:46:20.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.027+0000 7f1c28a00640 1 -- start start 2024-03-04T10:46:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.029+0000 7f1c28a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c24150fa0 0x7f1c240c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.029+0000 7f1c28a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c240c85b0 0x7f1c240c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.029+0000 7f1c28a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c24073600 con 0x7f1c240c80f0 2024-03-04T10:46:20.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.029+0000 7f1c28a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240c8b00 con 0x7f1c240c85b0 2024-03-04T10:46:20.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.029+0000 7f1c28a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c7320 con 0x7f1c24150fa0 2024-03-04T10:46:20.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.030+0000 7f1c22800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c24150fa0 0x7f1c240c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.030+0000 7f1c23200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c240c85b0 0x7f1c240c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.030+0000 7f1c22800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c24150fa0 0x7f1c240c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44886/0 (socket says 172.21.15.46:44886) 2024-03-04T10:46:20.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.030+0000 7f1c22800640 1 -- 172.21.15.46:0/109991648 learned_addr learned my addr 172.21.15.46:0/109991648 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.032+0000 7f1c23200640 1 -- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c24150fa0 msgr2=0x7f1c240c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.032+0000 7f1c23200640 1 --2- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c24150fa0 0x7f1c240c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.032+0000 7f1c23200640 1 -- 172.21.15.46:0/109991648 >> v1:172.21.15.46:6789/0 conn(0x7f1c240c80f0 legacy=0x7f1c24072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.033+0000 7f1c23200640 1 -- 172.21.15.46:0/109991648 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240c8d30 con 0x7f1c240c85b0 2024-03-04T10:46:20.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.041+0000 7f1c23200640 1 --2- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c85b0 0x7f1c240c93b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009d90 tx=0x7f1c1c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f03b5b33d40fb3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.127+0000 7f1c21400640 1 -- 172.21.15.46:0/109991648 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c039070 con 0x7f1c240c85b0 2024-03-04T10:46:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.127+0000 7f1c21400640 1 -- 172.21.15.46:0/109991648 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c02cc50 con 0x7f1c240c85b0 2024-03-04T10:46:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.127+0000 7f1c21400640 1 -- 172.21.15.46:0/109991648 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c034440 con 0x7f1c240c85b0 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 -- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c85b0 msgr2=0x7f1c240c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 --2- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c85b0 0x7f1c240c93b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009d90 tx=0x7f1c1c02bea0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 -- 172.21.15.46:0/109991648 shutdown_connections 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 --2- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c85b0 0x7f1c240c93b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 --2- 172.21.15.46:0/109991648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c24150fa0 0x7f1c240c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 -- 172.21.15.46:0/109991648 >> 172.21.15.46:0/109991648 conn(0x7f1c2406c100 msgr2=0x7f1c2406c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 -- 172.21.15.46:0/109991648 shutdown_connections 2024-03-04T10:46:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.128+0000 7f1c28a00640 1 -- 172.21.15.46:0/109991648 wait complete. 2024-03-04T10:46:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.131+0000 7f1c28a00640 1 Processor -- start 2024-03-04T10:46:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.131+0000 7f1c28a00640 1 -- start start 2024-03-04T10:46:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.132+0000 7f1c28a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c80f0 0x7f1c2413b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.132+0000 7f1c28a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c240c85b0 0x7f1c2414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.132+0000 7f1c28a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c24150fa0 0x7f1c24150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.132+0000 7f1c28a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c78a0 con 0x7f1c24150fa0 2024-03-04T10:46:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.132+0000 7f1c28a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c75c0 con 0x7f1c240c80f0 2024-03-04T10:46:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.132+0000 7f1c28a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c5f10 con 0x7f1c240c85b0 2024-03-04T10:46:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.133+0000 7f1c22800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c80f0 0x7f1c2413b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.133+0000 7f1c21e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c240c85b0 0x7f1c2414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.133+0000 7f1c22800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c80f0 0x7f1c2413b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48052/0 (socket says 172.21.15.46:48052) 2024-03-04T10:46:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.133+0000 7f1c22800640 1 -- 172.21.15.46:0/101636480 learned_addr learned my addr 172.21.15.46:0/101636480 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.133+0000 7f1c21e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c240c85b0 0x7f1c2414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44902/0 (socket says 172.21.15.46:44902) 2024-03-04T10:46:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.136+0000 7f1c23200640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c24150fa0 0x7f1c24150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.138+0000 7f1c22800640 1 -- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c240c85b0 msgr2=0x7f1c2414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.138+0000 7f1c22800640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c240c85b0 0x7f1c2414fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.138+0000 7f1c22800640 1 -- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c24150fa0 msgr2=0x7f1c24150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.138+0000 7f1c22800640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c24150fa0 0x7f1c24150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.138+0000 7f1c22800640 1 -- 172.21.15.46:0/101636480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2413d8e0 con 0x7f1c240c80f0 2024-03-04T10:46:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.138+0000 7f1c21e00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c240c85b0 0x7f1c2414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.141+0000 7f1c22800640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c80f0 0x7f1c2413b470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e840 tx=0x7f1c1400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.145+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14017070 con 0x7f1c240c80f0 2024-03-04T10:46:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.145+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400c8e0 con 0x7f1c240c80f0 2024-03-04T10:46:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.145+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24140cf0 con 0x7f1c240c80f0 2024-03-04T10:46:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.145+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400ccd0 con 0x7f1c240c80f0 2024-03-04T10:46:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.145+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c241f0390 con 0x7f1c240c80f0 2024-03-04T10:46:20.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.146+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c24074df0 con 0x7f1c240c80f0 2024-03-04T10:46:20.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.166+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c1401a070 con 0x7f1c240c80f0 2024-03-04T10:46:20.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.167+0000 7f1c1aa00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1c0406b520 0x7f1c0406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.167+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1c14056c70 con 0x7f1c240c80f0 2024-03-04T10:46:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.168+0000 7f1c21e00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1c0406b520 0x7f1c0406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.168+0000 7f1c1aa00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f1c04073780 0x7f1c04075ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.168+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 --> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c1400fe50 con 0x7f1c04073780 2024-03-04T10:46:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.168+0000 7f1c23200640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f1c04073780 0x7f1c04075ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.168+0000 7f1c21e00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1c0406b520 0x7f1c0406d9e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c240cd4b0 tx=0x7f1c10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.169+0000 7f1c23200640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f1c04073780 0x7f1c04075ba0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.170+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c14054e70 con 0x7f1c240c80f0 2024-03-04T10:46:20.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.170+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== osd.2 v2:172.21.15.46:6817/604231528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1c1400fe50 con 0x7f1c04073780 2024-03-04T10:46:20.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.201+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 --> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c24070740 con 0x7f1c04073780 2024-03-04T10:46:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.202+0000 7f1c1aa00640 1 -- 172.21.15.46:0/101636480 <== osd.2 v2:172.21.15.46:6817/604231528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1c24070740 con 0x7f1c04073780 2024-03-04T10:46:20.205 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:20.205 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:20.205 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.202+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f1c04073780 msgr2=0x7f1c04075ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.202+0000 7f1c28a00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.46:6817/604231528,v1:172.21.15.46:6819/604231528] conn(0x7f1c04073780 0x7f1c04075ba0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1c0406b520 msgr2=0x7f1c0406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f1c0406b520 0x7f1c0406d9e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c240cd4b0 tx=0x7f1c10009040 comp rx=0 tx=0).stop 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c80f0 msgr2=0x7f1c2413b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 --2- 172.21.15.46:0/101636480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c240c80f0 0x7f1c2413b470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e840 tx=0x7f1c1400ed00 comp rx=0 tx=0).stop 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c23200640 1 -- 172.21.15.46:0/101636480 reap_dead start 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 shutdown_connections 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 >> 172.21.15.46:0/101636480 conn(0x7f1c2406c100 msgr2=0x7f1c2406c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 shutdown_connections 2024-03-04T10:46:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.203+0000 7f1c28a00640 1 -- 172.21.15.46:0/101636480 wait complete. 2024-03-04T10:46:20.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-04T10:46:20.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.409+0000 7f4cf3e00640 1 Processor -- start 2024-03-04T10:46:20.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.410+0000 7f4cf3e00640 1 -- start start 2024-03-04T10:46:20.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.411+0000 7f4cf3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4cf415a3c0 0x7f4cf40cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.411+0000 7f4cf3e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.411+0000 7f4cf3e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf415a870 con 0x7f4cf4154600 2024-03-04T10:46:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.411+0000 7f4cf3e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40cb8f0 con 0x7f4cf415a3c0 2024-03-04T10:46:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.411+0000 7f4cf3e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40cb190 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.412+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.412+0000 7f4cf2000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4cf415a3c0 0x7f4cf40cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.412+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf406c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44904/0 (socket says 172.21.15.46:44904) 2024-03-04T10:46:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.412+0000 7f4cf3400640 1 -- 172.21.15.46:0/1075034200 learned_addr learned my addr 172.21.15.46:0/1075034200 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.415+0000 7f4cf3400640 1 -- 172.21.15.46:0/1075034200 >> v2:172.21.15.46:3300/0 conn(0x7f4cf415a3c0 msgr2=0x7f4cf40cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.415+0000 7f4cf3400640 1 --2- 172.21.15.46:0/1075034200 >> v2:172.21.15.46:3300/0 conn(0x7f4cf415a3c0 0x7f4cf40cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.415+0000 7f4cf3400640 1 -- 172.21.15.46:0/1075034200 >> v1:172.21.15.46:6789/0 conn(0x7f4cf4154600 legacy=0x7f4cf40cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.415+0000 7f4cf3400640 1 -- 172.21.15.46:0/1075034200 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf415ab50 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.417+0000 7f4cf3400640 1 --2- 172.21.15.46:0/1075034200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf406c130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009e50 tx=0x7f4cec02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cefa8c260a3a53d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.422+0000 7f4cf1600640 1 -- 172.21.15.46:0/1075034200 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec02cb00 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.422+0000 7f4cf1600640 1 -- 172.21.15.46:0/1075034200 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec02cca0 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.422+0000 7f4cf1600640 1 -- 172.21.15.46:0/1075034200 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec034610 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1075034200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 msgr2=0x7f4cf406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1075034200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf406c130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009e50 tx=0x7f4cec02bf60 comp rx=0 tx=0).stop 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1075034200 shutdown_connections 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1075034200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf406c130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1075034200 >> v2:172.21.15.46:3300/0 conn(0x7f4cf415a3c0 0x7f4cf40cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1075034200 >> 172.21.15.46:0/1075034200 conn(0x7f4cf40b17c0 msgr2=0x7f4cf40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1075034200 shutdown_connections 2024-03-04T10:46:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.423+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1075034200 wait complete. 2024-03-04T10:46:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.425+0000 7f4cf3e00640 1 Processor -- start 2024-03-04T10:46:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.425+0000 7f4cf3e00640 1 -- start start 2024-03-04T10:46:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.426+0000 7f4cf3e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf414ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.426+0000 7f4cf3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cf4154600 0x7f4cf40af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.426+0000 7f4cf3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cf415a3c0 0x7f4cf40afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.426+0000 7f4cf3e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40cd9d0 con 0x7f4cf415a3c0 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.426+0000 7f4cf3e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf415b110 con 0x7f4cf4154600 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.426+0000 7f4cf3e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41549e0 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.427+0000 7f4cf2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cf4154600 0x7f4cf40af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.427+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf414ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.427+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cf415a3c0 0x7f4cf40afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.427+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf414ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44916/0 (socket says 172.21.15.46:44916) 2024-03-04T10:46:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.427+0000 7f4cf2a00640 1 -- 172.21.15.46:0/1658807724 learned_addr learned my addr 172.21.15.46:0/1658807724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.431+0000 7f4cf2a00640 1 -- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cf4154600 msgr2=0x7f4cf40af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.431+0000 7f4cf2a00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cf4154600 0x7f4cf40af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.431+0000 7f4cf2a00640 1 -- 172.21.15.46:0/1658807724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cf415a3c0 msgr2=0x7f4cf40afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.431+0000 7f4cf2a00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cf415a3c0 0x7f4cf40afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.431+0000 7f4cf2a00640 1 -- 172.21.15.46:0/1658807724 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf414da40 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.433+0000 7f4cf2a00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf414ef10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c400 tx=0x7f4ce400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.438+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40052d0 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.438+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4005490 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.438+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4007260 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.438+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf414e9e0 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.438+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf41504c0 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.439+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf4150690 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.463+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ce4007400 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.465+0000 7f4ceaa00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4cd406b520 0x7f4cd406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:20.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.466+0000 7f4cf2000640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4cd406b520 0x7f4cd406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:20.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.466+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4ce4056450 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.466+0000 7f4cf2000640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4cd406b520 0x7f4cd406d9e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4cf414e260 tx=0x7f4ce0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:20.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.720+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4ce40583b0 con 0x7f4cf40cb3a0 2024-03-04T10:46:20.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.958+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf40cd200 con 0x7f4cd406b520 2024-03-04T10:46:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.958+0000 7f4ceaa00640 1 -- 172.21.15.46:0/1658807724 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4cf40cd200 con 0x7f4cd406b520 2024-03-04T10:46:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4cd406b520 msgr2=0x7f4cd406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4cd406b520 0x7f4cd406d9e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4cf414e260 tx=0x7f4ce0009190 comp rx=0 tx=0).stop 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 msgr2=0x7f4cf414ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf414ef10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c400 tx=0x7f4ce400c8c0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 shutdown_connections 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f4cd406b520 0x7f4cd406d9e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cf4154600 0x7f4cf40af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cf415a3c0 0x7f4cf40afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 --2- 172.21.15.46:0/1658807724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4cf40cb3a0 0x7f4cf414ef10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.962+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 >> 172.21.15.46:0/1658807724 conn(0x7f4cf40b17c0 msgr2=0x7f4cf406c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.963+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 shutdown_connections 2024-03-04T10:46:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:20.963+0000 7f4cf3e00640 1 -- 172.21.15.46:0/1658807724 wait complete. 2024-03-04T10:46:20.990 INFO:tasks.ceph:Scrubbing osd.3 2024-03-04T10:46:20.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:21.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.181+0000 7f34be000640 1 Processor -- start 2024-03-04T10:46:21.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.182+0000 7f34be000640 1 -- start start 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.183+0000 7f34be000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34b8152250 0x7f34b80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.183+0000 7f34be000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 0x7f34b80c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.183+0000 7f34be000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b815bab0 con 0x7f34b806f8a0 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.183+0000 7f34be000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b815bd90 con 0x7f34b8152250 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.183+0000 7f34be000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b815c070 con 0x7f34b80c5090 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.184+0000 7f34b7400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34b8152250 0x7f34b80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.184+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 0x7f34b80c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.184+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 0x7f34b80c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:44920/0 (socket says 172.21.15.46:44920) 2024-03-04T10:46:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.184+0000 7f34b7e00640 1 -- 172.21.15.46:0/2367168123 learned_addr learned my addr 172.21.15.46:0/2367168123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.187+0000 7f34b7e00640 1 -- 172.21.15.46:0/2367168123 >> v2:172.21.15.73:3300/0 conn(0x7f34b8152250 msgr2=0x7f34b80c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.187+0000 7f34b7e00640 1 --2- 172.21.15.46:0/2367168123 >> v2:172.21.15.73:3300/0 conn(0x7f34b8152250 0x7f34b80c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.187+0000 7f34b7e00640 1 -- 172.21.15.46:0/2367168123 >> v1:172.21.15.73:6789/0 conn(0x7f34b806f8a0 legacy=0x7f34b81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.187+0000 7f34b7e00640 1 -- 172.21.15.46:0/2367168123 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b815c350 con 0x7f34b80c5090 2024-03-04T10:46:21.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.189+0000 7f34b7e00640 1 --2- 172.21.15.46:0/2367168123 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 0x7f34b80c5500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009e50 tx=0x7f34b002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b752154f7ea4a0b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.194+0000 7f34b6000640 1 -- 172.21.15.46:0/2367168123 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b002cb90 con 0x7f34b80c5090 2024-03-04T10:46:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.194+0000 7f34b6000640 1 -- 172.21.15.46:0/2367168123 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b002cd30 con 0x7f34b80c5090 2024-03-04T10:46:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.194+0000 7f34b6000640 1 -- 172.21.15.46:0/2367168123 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0034610 con 0x7f34b80c5090 2024-03-04T10:46:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 -- 172.21.15.46:0/2367168123 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 msgr2=0x7f34b80c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 --2- 172.21.15.46:0/2367168123 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 0x7f34b80c5500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009e50 tx=0x7f34b002bff0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 -- 172.21.15.46:0/2367168123 shutdown_connections 2024-03-04T10:46:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 --2- 172.21.15.46:0/2367168123 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b80c5090 0x7f34b80c5500 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 --2- 172.21.15.46:0/2367168123 >> v2:172.21.15.73:3300/0 conn(0x7f34b8152250 0x7f34b80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 -- 172.21.15.46:0/2367168123 >> 172.21.15.46:0/2367168123 conn(0x7f34b806aff0 msgr2=0x7f34b806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 -- 172.21.15.46:0/2367168123 shutdown_connections 2024-03-04T10:46:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.195+0000 7f34be000640 1 -- 172.21.15.46:0/2367168123 wait complete. 2024-03-04T10:46:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.197+0000 7f34be000640 1 Processor -- start 2024-03-04T10:46:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.198+0000 7f34be000640 1 -- start start 2024-03-04T10:46:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.199+0000 7f34be000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34b806f8a0 0x7f34b81f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.199+0000 7f34be000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34b80c5090 0x7f34b81efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.199+0000 7f34be000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b8152250 0x7f34b814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.199+0000 7f34be000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b806fe70 con 0x7f34b80c5090 2024-03-04T10:46:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.199+0000 7f34be000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b806fcf0 con 0x7f34b806f8a0 2024-03-04T10:46:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.199+0000 7f34be000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8152630 con 0x7f34b8152250 2024-03-04T10:46:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.200+0000 7f34b7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34b806f8a0 0x7f34b81f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.200+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b8152250 0x7f34b814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.200+0000 7f34b7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34b806f8a0 0x7f34b81f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48094/0 (socket says 172.21.15.46:48094) 2024-03-04T10:46:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.200+0000 7f34b7400640 1 -- 172.21.15.46:0/2008213355 learned_addr learned my addr 172.21.15.46:0/2008213355 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.204+0000 7f34b7400640 1 -- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b8152250 msgr2=0x7f34b814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.204+0000 7f34b7400640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34b8152250 0x7f34b814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.204+0000 7f34b7400640 1 -- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34b80c5090 msgr2=0x7f34b81efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.204+0000 7f34b7400640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34b80c5090 0x7f34b81efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.204+0000 7f34b7400640 1 -- 172.21.15.46:0/2008213355 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b815b0e0 con 0x7f34b806f8a0 2024-03-04T10:46:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.206+0000 7f34b7400640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34b806f8a0 0x7f34b81f3c50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34a800e9b0 tx=0x7f34a800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.210+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8017070 con 0x7f34b806f8a0 2024-03-04T10:46:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.210+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800c9a0 con 0x7f34b806f8a0 2024-03-04T10:46:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.210+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800cd90 con 0x7f34b806f8a0 2024-03-04T10:46:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.210+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b81597a0 con 0x7f34b806f8a0 2024-03-04T10:46:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.210+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b8073030 con 0x7f34b806f8a0 2024-03-04T10:46:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.212+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34b80680b0 con 0x7f34b806f8a0 2024-03-04T10:46:21.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.230+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34a801a070 con 0x7f34b806f8a0 2024-03-04T10:46:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.231+0000 7f34af400640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f349806b550 0x7f349806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.232+0000 7f34b6a00640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f349806b550 0x7f349806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.233+0000 7f34b6a00640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f349806b550 0x7f349806da10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f34a4000f60 tx=0x7f34a40079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.235+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f34a8056d50 con 0x7f34b806f8a0 2024-03-04T10:46:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.235+0000 7f34af400640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7f34980737b0 0x7f3498075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.235+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 --> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34a8007e50 con 0x7f34980737b0 2024-03-04T10:46:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.235+0000 7f34b7e00640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7f34980737b0 0x7f3498075bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.236+0000 7f34b7e00640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7f34980737b0 0x7f3498075bd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.237+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== osd.3 v2:172.21.15.46:6816/3736261078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f34a8007e50 con 0x7f34980737b0 2024-03-04T10:46:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.267+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 --> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34b8155aa0 con 0x7f34980737b0 2024-03-04T10:46:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.268+0000 7f34af400640 1 -- 172.21.15.46:0/2008213355 <== osd.3 v2:172.21.15.46:6816/3736261078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f34b8155aa0 con 0x7f34980737b0 2024-03-04T10:46:21.272 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:21.272 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:21.272 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.268+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7f34980737b0 msgr2=0x7f3498075bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.268+0000 7f34be000640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.46:6816/3736261078,v1:172.21.15.46:6818/3736261078] conn(0x7f34980737b0 0x7f3498075bd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f349806b550 msgr2=0x7f349806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f349806b550 0x7f349806da10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f34a4000f60 tx=0x7f34a40079b0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34b806f8a0 msgr2=0x7f34b81f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 --2- 172.21.15.46:0/2008213355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34b806f8a0 0x7f34b81f3c50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34a800e9b0 tx=0x7f34a800ee70 comp rx=0 tx=0).stop 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34b7e00640 1 -- 172.21.15.46:0/2008213355 reap_dead start 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 shutdown_connections 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 >> 172.21.15.46:0/2008213355 conn(0x7f34b806aff0 msgr2=0x7f34b80716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 shutdown_connections 2024-03-04T10:46:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.269+0000 7f34be000640 1 -- 172.21.15.46:0/2008213355 wait complete. 2024-03-04T10:46:21.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-04T10:46:21.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.480+0000 7f4454a00640 1 Processor -- start 2024-03-04T10:46:21.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.480+0000 7f4454a00640 1 -- start start 2024-03-04T10:46:21.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.482+0000 7f4454a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4450154750 0x7f44500cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.482+0000 7f4454a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4450154b30 0x7f44500ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.482+0000 7f4454a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500ce650 0x7f44500cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.482+0000 7f4454a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500ca6d0 con 0x7f4450154b30 2024-03-04T10:46:21.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.482+0000 7f4454a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500ca990 con 0x7f4450154750 2024-03-04T10:46:21.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.482+0000 7f4454a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500cac70 con 0x7f44500ce650 2024-03-04T10:46:21.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.483+0000 7f444d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4450154b30 0x7f44500ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.483+0000 7f444e800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500ce650 0x7f44500cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.483+0000 7f444d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4450154b30 0x7f44500ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40040/0 (socket says 172.21.15.46:40040) 2024-03-04T10:46:21.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.483+0000 7f444d400640 1 -- 172.21.15.46:0/2868336569 learned_addr learned my addr 172.21.15.46:0/2868336569 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:21.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.483+0000 7f444de00640 1 --2- 172.21.15.46:0/2868336569 >> v2:172.21.15.73:3300/0 conn(0x7f4450154750 0x7f44500cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.486+0000 7f444d400640 1 -- 172.21.15.46:0/2868336569 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500ce650 msgr2=0x7f44500cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:21.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.486+0000 7f444d400640 1 --2- 172.21.15.46:0/2868336569 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500ce650 0x7f44500cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.486+0000 7f444d400640 1 -- 172.21.15.46:0/2868336569 >> v2:172.21.15.73:3300/0 conn(0x7f4450154750 msgr2=0x7f44500cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:21.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.486+0000 7f444d400640 1 --2- 172.21.15.46:0/2868336569 >> v2:172.21.15.73:3300/0 conn(0x7f4450154750 0x7f44500cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.486+0000 7f444d400640 1 -- 172.21.15.46:0/2868336569 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445015a900 con 0x7f4450154b30 2024-03-04T10:46:21.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.489+0000 7f444d400640 1 --2- 172.21.15.46:0/2868336569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154b30 0x7f44500ce110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f445008cf10 tx=0x7f443c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2193f3c16a80de87 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.493+0000 7f444ca00640 1 -- 172.21.15.46:0/2868336569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034070 con 0x7f4450154b30 2024-03-04T10:46:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.493+0000 7f444ca00640 1 -- 172.21.15.46:0/2868336569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c030860 con 0x7f4450154b30 2024-03-04T10:46:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.493+0000 7f444ca00640 1 -- 172.21.15.46:0/2868336569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c030c30 con 0x7f4450154b30 2024-03-04T10:46:21.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 -- 172.21.15.46:0/2868336569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154b30 msgr2=0x7f44500ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 --2- 172.21.15.46:0/2868336569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154b30 0x7f44500ce110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f445008cf10 tx=0x7f443c02b9a0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 -- 172.21.15.46:0/2868336569 shutdown_connections 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 --2- 172.21.15.46:0/2868336569 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500ce650 0x7f44500cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 --2- 172.21.15.46:0/2868336569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154b30 0x7f44500ce110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 --2- 172.21.15.46:0/2868336569 >> v2:172.21.15.73:3300/0 conn(0x7f4450154750 0x7f44500cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 -- 172.21.15.46:0/2868336569 >> 172.21.15.46:0/2868336569 conn(0x7f4450066c40 msgr2=0x7f4450067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 -- 172.21.15.46:0/2868336569 shutdown_connections 2024-03-04T10:46:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.494+0000 7f4454a00640 1 -- 172.21.15.46:0/2868336569 wait complete. 2024-03-04T10:46:21.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.496+0000 7f4454a00640 1 Processor -- start 2024-03-04T10:46:21.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.496+0000 7f4454a00640 1 -- start start 2024-03-04T10:46:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.497+0000 7f4454a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500ce650 0x7f44500c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.497+0000 7f4454a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 0x7f445014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.497+0000 7f4454a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500c9ad0 0x7f445014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.497+0000 7f4454a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445015a5b0 con 0x7f4450154750 2024-03-04T10:46:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.497+0000 7f4454a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445015aec0 con 0x7f44500ce650 2024-03-04T10:46:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.497+0000 7f4454a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445015b3e0 con 0x7f44500c9ad0 2024-03-04T10:46:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.498+0000 7f444d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 0x7f445014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.498+0000 7f444de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500ce650 0x7f44500c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.498+0000 7f444e800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500c9ad0 0x7f445014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.498+0000 7f444d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 0x7f445014df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40048/0 (socket says 172.21.15.46:40048) 2024-03-04T10:46:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.498+0000 7f444d400640 1 -- 172.21.15.46:0/153292996 learned_addr learned my addr 172.21.15.46:0/153292996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:21.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.502+0000 7f444d400640 1 -- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500c9ad0 msgr2=0x7f445014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.502+0000 7f444d400640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500c9ad0 0x7f445014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.502+0000 7f444d400640 1 -- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500ce650 msgr2=0x7f44500c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:21.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.502+0000 7f444d400640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500ce650 0x7f44500c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:21.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.502+0000 7f444d400640 1 -- 172.21.15.46:0/153292996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500c9400 con 0x7f4450154750 2024-03-04T10:46:21.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.505+0000 7f444d400640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 0x7f445014df10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f443c02b9e0 tx=0x7f443c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.508+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034040 con 0x7f4450154750 2024-03-04T10:46:21.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.508+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4450150e40 con 0x7f4450154750 2024-03-04T10:46:21.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.509+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500c7e80 con 0x7f4450154750 2024-03-04T10:46:21.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.509+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c030e00 con 0x7f4450154750 2024-03-04T10:46:21.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.509+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c030660 con 0x7f4450154750 2024-03-04T10:46:21.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.510+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4428005290 con 0x7f4450154750 2024-03-04T10:46:21.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.834+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f443c037070 con 0x7f4450154750 2024-03-04T10:46:21.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.836+0000 7f4446000640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f443006b4d0 0x7f443006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:21.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.837+0000 7f444de00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f443006b4d0 0x7f443006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:21.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.838+0000 7f444de00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f443006b4d0 0x7f443006d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4440009b40 tx=0x7f4440009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:21.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.873+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f443c030800 con 0x7f4450154750 2024-03-04T10:46:21.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:21.883+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f443c07b620 con 0x7f4450154750 2024-03-04T10:46:22.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.107+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4428000bc0 con 0x7f443006b4d0 2024-03-04T10:46:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.107+0000 7f4446000640 1 -- 172.21.15.46:0/153292996 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4428000bc0 con 0x7f443006b4d0 2024-03-04T10:46:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-03-04T10:46:22.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f443006b4d0 msgr2=0x7f443006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f443006b4d0 0x7f443006d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4440009b40 tx=0x7f4440009190 comp rx=0 tx=0).stop 2024-03-04T10:46:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 msgr2=0x7f445014df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 0x7f445014df10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f443c02b9e0 tx=0x7f443c0046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 shutdown_connections 2024-03-04T10:46:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f443006b4d0 0x7f443006d990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44500c9ad0 0x7f445014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4450154750 0x7f445014df10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 --2- 172.21.15.46:0/153292996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500ce650 0x7f44500c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 >> 172.21.15.46:0/153292996 conn(0x7f4450066c40 msgr2=0x7f4450151e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 shutdown_connections 2024-03-04T10:46:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.110+0000 7f4454a00640 1 -- 172.21.15.46:0/153292996 wait complete. 2024-03-04T10:46:22.135 INFO:tasks.ceph:Scrubbing osd.4 2024-03-04T10:46:22.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:22.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.331+0000 7f8d74e00640 1 Processor -- start 2024-03-04T10:46:22.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.332+0000 7f8d74e00640 1 -- start start 2024-03-04T10:46:22.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.333+0000 7f8d74e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d700cc780 0x7f8d700ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.334+0000 7f8d74e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700ca560 0x7f8d7015afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.334+0000 7f8d74e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700b2590 con 0x7f8d7015bfd0 2024-03-04T10:46:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.334+0000 7f8d74e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7015b510 con 0x7f8d700cc780 2024-03-04T10:46:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.334+0000 7f8d74e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700cae10 con 0x7f8d700ca560 2024-03-04T10:46:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.334+0000 7f8d6d400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700ca560 0x7f8d7015afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.334+0000 7f8d6e800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8d7015bfd0 0x7f8d7015c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:51804/0 (socket says 172.21.15.46:51804) 2024-03-04T10:46:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.335+0000 7f8d6e800640 1 -- 172.21.15.46:0/1455015240 learned_addr learned my addr 172.21.15.46:0/1455015240 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:22.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.335+0000 7f8d6de00640 1 --2- 172.21.15.46:0/1455015240 >> v2:172.21.15.46:3300/0 conn(0x7f8d700cc780 0x7f8d700ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.338+0000 7f8d6ca00640 1 -- 172.21.15.46:0/1455015240 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442406913 0 0) 0x7f8d700b2590 con 0x7f8d7015bfd0 2024-03-04T10:46:22.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.338+0000 7f8d6ca00640 1 -- 172.21.15.46:0/1455015240 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d54003520 con 0x7f8d7015bfd0 2024-03-04T10:46:22.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.338+0000 7f8d6d400640 1 -- 172.21.15.46:0/1455015240 >> v2:172.21.15.46:3300/0 conn(0x7f8d700cc780 msgr2=0x7f8d700ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:22.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.338+0000 7f8d6d400640 1 --2- 172.21.15.46:0/1455015240 >> v2:172.21.15.46:3300/0 conn(0x7f8d700cc780 0x7f8d700ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.338+0000 7f8d6d400640 1 -- 172.21.15.46:0/1455015240 >> v1:172.21.15.73:6789/0 conn(0x7f8d7015bfd0 legacy=0x7f8d7015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.338+0000 7f8d6d400640 1 -- 172.21.15.46:0/1455015240 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700b1a10 con 0x7f8d700ca560 2024-03-04T10:46:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.341+0000 7f8d6d400640 1 --2- 172.21.15.46:0/1455015240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700ca560 0x7f8d7015afd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0097a0 tx=0x7f8d5c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28567ff46c7bc6da server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.346+0000 7f8d6ca00640 1 -- 172.21.15.46:0/1455015240 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c035020 con 0x7f8d700ca560 2024-03-04T10:46:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.346+0000 7f8d6ca00640 1 -- 172.21.15.46:0/1455015240 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c031810 con 0x7f8d700ca560 2024-03-04T10:46:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.346+0000 7f8d6ca00640 1 -- 172.21.15.46:0/1455015240 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c031be0 con 0x7f8d700ca560 2024-03-04T10:46:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 -- 172.21.15.46:0/1455015240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700ca560 msgr2=0x7f8d7015afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 --2- 172.21.15.46:0/1455015240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700ca560 0x7f8d7015afd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0097a0 tx=0x7f8d5c02b8b0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 -- 172.21.15.46:0/1455015240 shutdown_connections 2024-03-04T10:46:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 --2- 172.21.15.46:0/1455015240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700ca560 0x7f8d7015afd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 --2- 172.21.15.46:0/1455015240 >> v2:172.21.15.46:3300/0 conn(0x7f8d700cc780 0x7f8d700ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 -- 172.21.15.46:0/1455015240 >> 172.21.15.46:0/1455015240 conn(0x7f8d70066c40 msgr2=0x7f8d70067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 -- 172.21.15.46:0/1455015240 shutdown_connections 2024-03-04T10:46:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.347+0000 7f8d74e00640 1 -- 172.21.15.46:0/1455015240 wait complete. 2024-03-04T10:46:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.350+0000 7f8d74e00640 1 Processor -- start 2024-03-04T10:46:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.350+0000 7f8d74e00640 1 -- start start 2024-03-04T10:46:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.351+0000 7f8d74e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d700ca560 0x7f8d700cf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.351+0000 7f8d74e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700cc780 0x7f8d70153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.351+0000 7f8d74e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d7015bfd0 0x7f8d701539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.351+0000 7f8d74e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700b22b0 con 0x7f8d700ca560 2024-03-04T10:46:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.351+0000 7f8d74e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700b1fd0 con 0x7f8d7015bfd0 2024-03-04T10:46:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.351+0000 7f8d74e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70154c60 con 0x7f8d700cc780 2024-03-04T10:46:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.352+0000 7f8d6e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d7015bfd0 0x7f8d701539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.352+0000 7f8d6d400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700cc780 0x7f8d70153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.352+0000 7f8d6de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d700ca560 0x7f8d700cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.353+0000 7f8d6e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d7015bfd0 0x7f8d701539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35832/0 (socket says 172.21.15.46:35832) 2024-03-04T10:46:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.353+0000 7f8d6e800640 1 -- 172.21.15.46:0/2044549679 learned_addr learned my addr 172.21.15.46:0/2044549679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.353+0000 7f8d6d400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700cc780 0x7f8d70153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47042/0 (socket says 172.21.15.46:47042) 2024-03-04T10:46:22.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.356+0000 7f8d6e800640 1 -- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700cc780 msgr2=0x7f8d70153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.356+0000 7f8d6e800640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d700cc780 0x7f8d70153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.356+0000 7f8d6e800640 1 -- 172.21.15.46:0/2044549679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d700ca560 msgr2=0x7f8d700cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.356+0000 7f8d6e800640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d700ca560 0x7f8d700cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.356+0000 7f8d6e800640 1 -- 172.21.15.46:0/2044549679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7014fe60 con 0x7f8d7015bfd0 2024-03-04T10:46:22.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.358+0000 7f8d6e800640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d7015bfd0 0x7f8d701539c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800caa0 tx=0x7f8d6800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.362+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68017070 con 0x7f8d7015bfd0 2024-03-04T10:46:22.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.363+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6800ac00 con 0x7f8d7015bfd0 2024-03-04T10:46:22.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.363+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68012400 con 0x7f8d7015bfd0 2024-03-04T10:46:22.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.363+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d700d0120 con 0x7f8d7015bfd0 2024-03-04T10:46:22.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.363+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d700cecb0 con 0x7f8d7015bfd0 2024-03-04T10:46:22.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.364+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d7015ba50 con 0x7f8d7015bfd0 2024-03-04T10:46:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.388+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d6801a070 con 0x7f8d7015bfd0 2024-03-04T10:46:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.389+0000 7f8d66000640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8d5006b520 0x7f8d5006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.390+0000 7f8d6de00640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8d5006b520 0x7f8d5006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.390+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8d68056f50 con 0x7f8d7015bfd0 2024-03-04T10:46:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.391+0000 7f8d66000640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f8d50073780 0x7f8d50075ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.391+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 --> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d68016ec0 con 0x7f8d50073780 2024-03-04T10:46:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.391+0000 7f8d6de00640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8d5006b520 0x7f8d5006d9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009aa0 tx=0x7f8d60009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.391+0000 7f8d6d400640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f8d50073780 0x7f8d50075ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.391+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d68055150 con 0x7f8d7015bfd0 2024-03-04T10:46:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.392+0000 7f8d6d400640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f8d50073780 0x7f8d50075ba0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.393+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== osd.4 v2:172.21.15.73:6818/2665089334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8d68016ec0 con 0x7f8d50073780 2024-03-04T10:46:22.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.409+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 --> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d7015d810 con 0x7f8d50073780 2024-03-04T10:46:22.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d66000640 1 -- 172.21.15.46:0/2044549679 <== osd.4 v2:172.21.15.73:6818/2665089334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8d7015d810 con 0x7f8d50073780 2024-03-04T10:46:22.413 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:22.414 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:22.414 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f8d50073780 msgr2=0x7f8d50075ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d74e00640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6818/2665089334,v1:172.21.15.73:6820/2665089334] conn(0x7f8d50073780 0x7f8d50075ba0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8d5006b520 msgr2=0x7f8d5006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d74e00640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f8d5006b520 0x7f8d5006d9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009aa0 tx=0x7f8d60009190 comp rx=0 tx=0).stop 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d7015bfd0 msgr2=0x7f8d701539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d74e00640 1 --2- 172.21.15.46:0/2044549679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d7015bfd0 0x7f8d701539c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800caa0 tx=0x7f8d6800cf60 comp rx=0 tx=0).stop 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.410+0000 7f8d6e800640 1 -- 172.21.15.46:0/2044549679 reap_dead start 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.411+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 shutdown_connections 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.411+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 >> 172.21.15.46:0/2044549679 conn(0x7f8d70066c40 msgr2=0x7f8d7015da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.411+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 shutdown_connections 2024-03-04T10:46:22.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.411+0000 7f8d74e00640 1 -- 172.21.15.46:0/2044549679 wait complete. 2024-03-04T10:46:22.433 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-04T10:46:22.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.622+0000 7fb9e5c00640 1 Processor -- start 2024-03-04T10:46:22.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.622+0000 7fb9e5c00640 1 -- start start 2024-03-04T10:46:22.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.624+0000 7fb9e5c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9e015add0 0x7fb9e015e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.624+0000 7fb9e5c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9e015a2d0 0x7fb9e00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.624+0000 7fb9e5c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e00cfe30 con 0x7fb9e00cedc0 2024-03-04T10:46:22.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.624+0000 7fb9e5c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e015de90 con 0x7fb9e015add0 2024-03-04T10:46:22.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.624+0000 7fb9e5c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e00d0110 con 0x7fb9e015a2d0 2024-03-04T10:46:22.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.625+0000 7fb9dfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9e015add0 0x7fb9e015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.625+0000 7fb9df400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9e015a2d0 0x7fb9e00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.625+0000 7fb9dfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9e015add0 0x7fb9e015e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40066/0 (socket says 172.21.15.46:40066) 2024-03-04T10:46:22.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.625+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2592389345 learned_addr learned my addr 172.21.15.46:0/2592389345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:22.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.627+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2592389345 >> v2:172.21.15.73:3300/0 conn(0x7fb9e015a2d0 msgr2=0x7fb9e00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:22.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.627+0000 7fb9dfe00640 1 --2- 172.21.15.46:0/2592389345 >> v2:172.21.15.73:3300/0 conn(0x7fb9e015a2d0 0x7fb9e00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.627+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2592389345 >> v1:172.21.15.73:6789/0 conn(0x7fb9e00cedc0 legacy=0x7fb9e00b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.627+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2592389345 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00d03f0 con 0x7fb9e015add0 2024-03-04T10:46:22.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.630+0000 7fb9dfe00640 1 --2- 172.21.15.46:0/2592389345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015add0 0x7fb9e015e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00cc7b0 tx=0x7fb9d002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece740d2d1087b22 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.634+0000 7fb9dea00640 1 -- 172.21.15.46:0/2592389345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d002f850 con 0x7fb9e015add0 2024-03-04T10:46:22.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.634+0000 7fb9dea00640 1 -- 172.21.15.46:0/2592389345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d002f9f0 con 0x7fb9e015add0 2024-03-04T10:46:22.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.634+0000 7fb9dea00640 1 -- 172.21.15.46:0/2592389345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d002fdc0 con 0x7fb9e015add0 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2592389345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015add0 msgr2=0x7fb9e015e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2592389345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015add0 0x7fb9e015e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00cc7b0 tx=0x7fb9d002ba30 comp rx=0 tx=0).stop 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2592389345 shutdown_connections 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2592389345 >> v2:172.21.15.73:3300/0 conn(0x7fb9e015a2d0 0x7fb9e00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2592389345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015add0 0x7fb9e015e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2592389345 >> 172.21.15.46:0/2592389345 conn(0x7fb9e0066c40 msgr2=0x7fb9e0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2592389345 shutdown_connections 2024-03-04T10:46:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.635+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2592389345 wait complete. 2024-03-04T10:46:22.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.637+0000 7fb9e5c00640 1 Processor -- start 2024-03-04T10:46:22.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.637+0000 7fb9e5c00640 1 -- start start 2024-03-04T10:46:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9e00cedc0 0x7fb9e00cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015a2d0 0x7fb9e01f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e015add0 0x7fb9e01f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e015a6f0 con 0x7fb9e015a2d0 2024-03-04T10:46:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e015db20 con 0x7fb9e015add0 2024-03-04T10:46:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e015b1b0 con 0x7fb9e00cedc0 2024-03-04T10:46:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9df400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015a2d0 0x7fb9e01f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9e5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e015add0 0x7fb9e01f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.639+0000 7fb9dfe00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9e00cedc0 0x7fb9e00cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.640+0000 7fb9df400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015a2d0 0x7fb9e01f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40072/0 (socket says 172.21.15.46:40072) 2024-03-04T10:46:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.640+0000 7fb9df400640 1 -- 172.21.15.46:0/2135584224 learned_addr learned my addr 172.21.15.46:0/2135584224 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.643+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e015add0 msgr2=0x7fb9e01f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.643+0000 7fb9dfe00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e015add0 0x7fb9e01f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.643+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2135584224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015a2d0 msgr2=0x7fb9e01f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.643+0000 7fb9dfe00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015a2d0 0x7fb9e01f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.643+0000 7fb9dfe00640 1 -- 172.21.15.46:0/2135584224 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00afcb0 con 0x7fb9e00cedc0 2024-03-04T10:46:22.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.646+0000 7fb9dfe00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9e00cedc0 0x7fb9e00cf480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0033000 tx=0x7fb9d0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.650+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0047070 con 0x7fb9e00cedc0 2024-03-04T10:46:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.650+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0037be0 con 0x7fb9e00cedc0 2024-03-04T10:46:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.650+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e0156a90 con 0x7fb9e00cedc0 2024-03-04T10:46:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.650+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0042480 con 0x7fb9e00cedc0 2024-03-04T10:46:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.650+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0157050 con 0x7fb9e00cedc0 2024-03-04T10:46:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.651+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00682c0 con 0x7fb9e00cedc0 2024-03-04T10:46:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.933+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9d004a070 con 0x7fb9e00cedc0 2024-03-04T10:46:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.934+0000 7fb9d7e00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9c006b520 0x7fb9c006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.934+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb9d00ac4c0 con 0x7fb9e00cedc0 2024-03-04T10:46:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.935+0000 7fb9df400640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9c006b520 0x7fb9c006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:22.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.935+0000 7fb9df400640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9c006b520 0x7fb9c006d9e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb9e01ea910 tx=0x7fb9cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:22.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:22.947+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb9d0033030 con 0x7fb9e00cedc0 2024-03-04T10:46:23.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.159+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9e00c3b30 con 0x7fb9c006b520 2024-03-04T10:46:23.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.160+0000 7fb9d7e00640 1 -- 172.21.15.46:0/2135584224 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb9cc011af0 con 0x7fb9c006b520 2024-03-04T10:46:23.164 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-03-04T10:46:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9c006b520 msgr2=0x7fb9c006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9c006b520 0x7fb9c006d9e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb9e01ea910 tx=0x7fb9cc009190 comp rx=0 tx=0).stop 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9e00cedc0 msgr2=0x7fb9e00cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9e00cedc0 0x7fb9e00cf480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0033000 tx=0x7fb9d0004730 comp rx=0 tx=0).stop 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 shutdown_connections 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fb9c006b520 0x7fb9c006d9e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e015add0 0x7fb9e01f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e015a2d0 0x7fb9e01f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 --2- 172.21.15.46:0/2135584224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9e00cedc0 0x7fb9e00cf480 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 >> 172.21.15.46:0/2135584224 conn(0x7fb9e0066c40 msgr2=0x7fb9e00c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 shutdown_connections 2024-03-04T10:46:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.164+0000 7fb9e5c00640 1 -- 172.21.15.46:0/2135584224 wait complete. 2024-03-04T10:46:23.188 INFO:tasks.ceph:Scrubbing osd.5 2024-03-04T10:46:23.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.382+0000 7fdd7b200640 1 Processor -- start 2024-03-04T10:46:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.382+0000 7fdd7b200640 1 -- start start 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.384+0000 7fdd7b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd7c0ca330 0x7fdd7c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.384+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 0x7fdd7c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.384+0000 7fdd7b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd7c15a710 0x7fdd7c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.384+0000 7fdd7b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7c15b0e0 con 0x7fdd7c15a710 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.384+0000 7fdd7b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7c0ccd50 con 0x7fdd7c0ca330 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.384+0000 7fdd7b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0cdd80 con 0x7fdd7c0cd7b0 2024-03-04T10:46:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.385+0000 7fdd79e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd7c0ca330 0x7fdd7c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.385+0000 7fdd79400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 0x7fdd7c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.386+0000 7fdd79400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 0x7fdd7c0ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47060/0 (socket says 172.21.15.46:47060) 2024-03-04T10:46:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.386+0000 7fdd79400640 1 -- 172.21.15.46:0/3799221903 learned_addr learned my addr 172.21.15.46:0/3799221903 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.389+0000 7fdd79e00640 1 -- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 msgr2=0x7fdd7c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.389+0000 7fdd79e00640 1 --2- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 0x7fdd7c0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.389+0000 7fdd79e00640 1 -- 172.21.15.46:0/3799221903 >> v2:172.21.15.46:3300/0 conn(0x7fdd7c15a710 msgr2=0x7fdd7c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.389+0000 7fdd79e00640 1 --2- 172.21.15.46:0/3799221903 >> v2:172.21.15.46:3300/0 conn(0x7fdd7c15a710 0x7fdd7c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.389+0000 7fdd79e00640 1 -- 172.21.15.46:0/3799221903 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c0cc4b0 con 0x7fdd7c0ca330 2024-03-04T10:46:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.389+0000 7fdd79400640 1 --2- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 0x7fdd7c0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:23.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.392+0000 7fdd79e00640 1 --2- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c0ca330 0x7fdd7c0ca710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0d0ab0 tx=0x7fdd6c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed2d26b329de8e29 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.396+0000 7fdd78a00640 1 -- 172.21.15.46:0/3799221903 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0315a0 con 0x7fdd7c0ca330 2024-03-04T10:46:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.396+0000 7fdd78a00640 1 -- 172.21.15.46:0/3799221903 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c037070 con 0x7fdd7c0ca330 2024-03-04T10:46:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.396+0000 7fdd78a00640 1 -- 172.21.15.46:0/3799221903 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c031960 con 0x7fdd7c0ca330 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 -- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c0ca330 msgr2=0x7fdd7c0ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 --2- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c0ca330 0x7fdd7c0ca710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0d0ab0 tx=0x7fdd6c02b840 comp rx=0 tx=0).stop 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 -- 172.21.15.46:0/3799221903 shutdown_connections 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 --2- 172.21.15.46:0/3799221903 >> v2:172.21.15.46:3300/0 conn(0x7fdd7c15a710 0x7fdd7c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 --2- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0cd7b0 0x7fdd7c0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 --2- 172.21.15.46:0/3799221903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c0ca330 0x7fdd7c0ca710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 -- 172.21.15.46:0/3799221903 >> 172.21.15.46:0/3799221903 conn(0x7fdd7c0cf9b0 msgr2=0x7fdd7c0cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.397+0000 7fdd7b200640 1 -- 172.21.15.46:0/3799221903 shutdown_connections 2024-03-04T10:46:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.398+0000 7fdd7b200640 1 -- 172.21.15.46:0/3799221903 wait complete. 2024-03-04T10:46:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.399+0000 7fdd7b200640 1 Processor -- start 2024-03-04T10:46:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.399+0000 7fdd7b200640 1 -- start start 2024-03-04T10:46:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.400+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0ca330 0x7fdd7c1f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.400+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0cd7b0 0x7fdd7c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.400+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c15a710 0x7fdd7c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.400+0000 7fdd7b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0ce6f0 con 0x7fdd7c0cd7b0 2024-03-04T10:46:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.400+0000 7fdd7b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0cca70 con 0x7fdd7c15a710 2024-03-04T10:46:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.400+0000 7fdd7b200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0cc180 con 0x7fdd7c0ca330 2024-03-04T10:46:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.401+0000 7fdd79e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0ca330 0x7fdd7c1f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.401+0000 7fdd7a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c15a710 0x7fdd7c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.401+0000 7fdd79e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0ca330 0x7fdd7c1f16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47070/0 (socket says 172.21.15.46:47070) 2024-03-04T10:46:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.401+0000 7fdd79e00640 1 -- 172.21.15.46:0/1803728018 learned_addr learned my addr 172.21.15.46:0/1803728018 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.406+0000 7fdd7a800640 1 -- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0ca330 msgr2=0x7fdd7c1f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.406+0000 7fdd7a800640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd7c0ca330 0x7fdd7c1f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.406+0000 7fdd7a800640 1 -- 172.21.15.46:0/1803728018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0cd7b0 msgr2=0x7fdd7c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.406+0000 7fdd7a800640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0cd7b0 0x7fdd7c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.406+0000 7fdd7a800640 1 -- 172.21.15.46:0/1803728018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c1e7390 con 0x7fdd7c15a710 2024-03-04T10:46:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.409+0000 7fdd7a800640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c15a710 0x7fdd7c154240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400be50 tx=0x7fdd7400bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.412+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74019070 con 0x7fdd7c15a710 2024-03-04T10:46:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.412+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c1f0e50 con 0x7fdd7c15a710 2024-03-04T10:46:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.413+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c1e7910 con 0x7fdd7c15a710 2024-03-04T10:46:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.413+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd7c0680b0 con 0x7fdd7c15a710 2024-03-04T10:46:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.415+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c0680b0 con 0x7fdd7c15a710 2024-03-04T10:46:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.415+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74023060 con 0x7fdd7c15a710 2024-03-04T10:46:23.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.445+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd7401c070 con 0x7fdd7c15a710 2024-03-04T10:46:23.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.447+0000 7fdd72000640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd5c06b4d0 0x7fdd5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.447+0000 7fdd79e00640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd5c06b4d0 0x7fdd5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.448+0000 7fdd79e00640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd5c06b4d0 0x7fdd5c06d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c02b880 tx=0x7fdd6c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.450+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdd74057340 con 0x7fdd7c15a710 2024-03-04T10:46:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.450+0000 7fdd72000640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7fdd5c073730 0x7fdd5c075b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.450+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 --> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd5c076220 con 0x7fdd5c073730 2024-03-04T10:46:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.450+0000 7fdd79400640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7fdd5c073730 0x7fdd5c075b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.451+0000 7fdd79400640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7fdd5c073730 0x7fdd5c075b50 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.452+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== osd.5 v2:172.21.15.73:6819/4224855400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdd5c076220 con 0x7fdd5c073730 2024-03-04T10:46:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.469+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 --> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd7c06de80 con 0x7fdd5c073730 2024-03-04T10:46:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.469+0000 7fdd72000640 1 -- 172.21.15.46:0/1803728018 <== osd.5 v2:172.21.15.73:6819/4224855400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdd7c06de80 con 0x7fdd5c073730 2024-03-04T10:46:23.473 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:23.473 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7fdd5c073730 msgr2=0x7fdd5c075b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6819/4224855400,v1:172.21.15.73:6821/4224855400] conn(0x7fdd5c073730 0x7fdd5c075b50 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd5c06b4d0 msgr2=0x7fdd5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fdd5c06b4d0 0x7fdd5c06d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c02b880 tx=0x7fdd6c03d040 comp rx=0 tx=0).stop 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c15a710 msgr2=0x7fdd7c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 --2- 172.21.15.46:0/1803728018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c15a710 0x7fdd7c154240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400be50 tx=0x7fdd7400bf40 comp rx=0 tx=0).stop 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7a800640 1 -- 172.21.15.46:0/1803728018 reap_dead start 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 shutdown_connections 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 >> 172.21.15.46:0/1803728018 conn(0x7fdd7c0cf9b0 msgr2=0x7fdd7c158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 shutdown_connections 2024-03-04T10:46:23.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.470+0000 7fdd7b200640 1 -- 172.21.15.46:0/1803728018 wait complete. 2024-03-04T10:46:23.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-04T10:46:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.690+0000 7f14aaa00640 1 Processor -- start 2024-03-04T10:46:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.691+0000 7f14aaa00640 1 -- start start 2024-03-04T10:46:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.692+0000 7f14aaa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14a40cc700 0x7f14a40ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.692+0000 7f14aaa00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40ca6d0 con 0x7f14a4154b30 2024-03-04T10:46:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.692+0000 7f14aaa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40ca990 con 0x7f14a4154750 2024-03-04T10:46:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.692+0000 7f14aaa00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a40cac70 con 0x7f14a40cc700 2024-03-04T10:46:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.693+0000 7f14a3e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f14a4154750 0x7f14a40cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:51812/0 (socket says 172.21.15.46:51812) 2024-03-04T10:46:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.693+0000 7f14a3e00640 1 -- 172.21.15.46:0/3422637534 learned_addr learned my addr 172.21.15.46:0/3422637534 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.693+0000 7f14a8a00640 1 --2- 172.21.15.46:0/3422637534 >> v2:172.21.15.46:3300/0 conn(0x7f14a40cc700 0x7f14a40ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.696+0000 7f14a2a00640 1 -- 172.21.15.46:0/3422637534 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107411333 0 0) 0x7f14a40ca990 con 0x7f14a4154750 2024-03-04T10:46:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.696+0000 7f14a2a00640 1 -- 172.21.15.46:0/3422637534 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1488003520 con 0x7f14a4154750 2024-03-04T10:46:23.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.699+0000 7f14a8a00640 1 -- 172.21.15.46:0/3422637534 >> v1:172.21.15.73:6789/0 conn(0x7f14a4154750 legacy=0x7f14a40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.699+0000 7f14a8a00640 1 -- 172.21.15.46:0/3422637534 >> v1:172.21.15.46:6789/0 conn(0x7f14a4154b30 legacy=0x7f14a40ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.699+0000 7f14a8a00640 1 -- 172.21.15.46:0/3422637534 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a415a900 con 0x7f14a40cc700 2024-03-04T10:46:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.704+0000 7f14a8a00640 1 --2- 172.21.15.46:0/3422637534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a40cc700 0x7f14a40ccb50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f149c0097a0 tx=0x7f149c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3816a9174f14a420 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.709+0000 7f14a2a00640 1 -- 172.21.15.46:0/3422637534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c02f810 con 0x7f14a40cc700 2024-03-04T10:46:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.709+0000 7f14a2a00640 1 -- 172.21.15.46:0/3422637534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c02f9b0 con 0x7f14a40cc700 2024-03-04T10:46:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.709+0000 7f14a2a00640 1 -- 172.21.15.46:0/3422637534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c02fd80 con 0x7f14a40cc700 2024-03-04T10:46:23.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 -- 172.21.15.46:0/3422637534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a40cc700 msgr2=0x7f14a40ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 --2- 172.21.15.46:0/3422637534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a40cc700 0x7f14a40ccb50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f149c0097a0 tx=0x7f149c02b9f0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 -- 172.21.15.46:0/3422637534 shutdown_connections 2024-03-04T10:46:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 --2- 172.21.15.46:0/3422637534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a40cc700 0x7f14a40ccb50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 -- 172.21.15.46:0/3422637534 >> 172.21.15.46:0/3422637534 conn(0x7f14a4066c40 msgr2=0x7f14a4067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 -- 172.21.15.46:0/3422637534 shutdown_connections 2024-03-04T10:46:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.710+0000 7f14aaa00640 1 -- 172.21.15.46:0/3422637534 wait complete. 2024-03-04T10:46:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.713+0000 7f14aaa00640 1 Processor -- start 2024-03-04T10:46:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.713+0000 7f14aaa00640 1 -- start start 2024-03-04T10:46:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14aaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 0x7f14a41452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14aaa00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f14a4154750 0x7f14a40b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14aaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a41e5f00 0x7f14a40b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14aaa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40ce820 con 0x7f14a41e5f00 2024-03-04T10:46:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14aaa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a415aec0 con 0x7f14a40cc700 2024-03-04T10:46:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14aaa00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a415a5b0 con 0x7f14a4154750 2024-03-04T10:46:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14a3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 0x7f14a41452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.715+0000 7f14a3400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f14a4154750 0x7f14a40b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.716+0000 7f14a8a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a41e5f00 0x7f14a40b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.716+0000 7f14a3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 0x7f14a41452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35872/0 (socket says 172.21.15.46:35872) 2024-03-04T10:46:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.716+0000 7f14a3e00640 1 -- 172.21.15.46:0/742270725 learned_addr learned my addr 172.21.15.46:0/742270725 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.721+0000 7f14a3e00640 1 -- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f14a4154750 msgr2=0x7f14a40b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.721+0000 7f14a3e00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f14a4154750 0x7f14a40b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.721+0000 7f14a3e00640 1 -- 172.21.15.46:0/742270725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a41e5f00 msgr2=0x7f14a40b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.721+0000 7f14a3e00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a41e5f00 0x7f14a40b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.721+0000 7f14a3e00640 1 -- 172.21.15.46:0/742270725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40b51a0 con 0x7f14a40cc700 2024-03-04T10:46:23.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.724+0000 7f14a3e00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 0x7f14a41452b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f149400cc20 tx=0x7f149400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.726+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494017070 con 0x7f14a40cc700 2024-03-04T10:46:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.726+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40b5480 con 0x7f14a40cc700 2024-03-04T10:46:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.726+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a41f0c30 con 0x7f14a40cc700 2024-03-04T10:46:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.727+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a41f0740 con 0x7f14a40cc700 2024-03-04T10:46:23.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.728+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149400ce30 con 0x7f14a40cc700 2024-03-04T10:46:23.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.728+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494021060 con 0x7f14a40cc700 2024-03-04T10:46:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.990+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f149401a070 con 0x7f14a40cc700 2024-03-04T10:46:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.993+0000 7f149be00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f148006b4d0 0x7f148006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.993+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f149408a540 con 0x7f14a40cc700 2024-03-04T10:46:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.994+0000 7f14a3400640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f148006b4d0 0x7f148006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:23.995+0000 7f14a3400640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f148006b4d0 0x7f148006d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f14a40c3220 tx=0x7f148c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.006+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1494058cc0 con 0x7f14a40cc700 2024-03-04T10:46:24.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.222+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f14a40680b0 con 0x7f148006b4d0 2024-03-04T10:46:24.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.223+0000 7f149be00640 1 -- 172.21.15.46:0/742270725 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f14a40680b0 con 0x7f148006b4d0 2024-03-04T10:46:24.226 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f148006b4d0 msgr2=0x7f148006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f148006b4d0 0x7f148006d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f14a40c3220 tx=0x7f148c009040 comp rx=0 tx=0).stop 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 msgr2=0x7f14a41452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 0x7f14a41452b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f149400cc20 tx=0x7f149400a430 comp rx=0 tx=0).stop 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 shutdown_connections 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f148006b4d0 0x7f148006d990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a41e5f00 0x7f14a40b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f14a4154750 0x7f14a40b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 --2- 172.21.15.46:0/742270725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a40cc700 0x7f14a41452b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 >> 172.21.15.46:0/742270725 conn(0x7f14a4066c40 msgr2=0x7f14a415d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 shutdown_connections 2024-03-04T10:46:24.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.225+0000 7f14aaa00640 1 -- 172.21.15.46:0/742270725 wait complete. 2024-03-04T10:46:24.246 INFO:tasks.ceph:Scrubbing osd.6 2024-03-04T10:46:24.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:24.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.438+0000 7ff1c5200640 1 Processor -- start 2024-03-04T10:46:24.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.438+0000 7ff1c5200640 1 -- start start 2024-03-04T10:46:24.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.440+0000 7ff1c5200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1c00ca560 0x7ff1c00ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.440+0000 7ff1c5200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c00b2590 con 0x7ff1c00cc780 2024-03-04T10:46:24.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.440+0000 7ff1c5200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c00cae10 con 0x7ff1c015c6e0 2024-03-04T10:46:24.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.440+0000 7ff1c5200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c00b1a10 con 0x7ff1c00ca560 2024-03-04T10:46:24.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.441+0000 7ff1be800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1c00ca560 0x7ff1c00ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.441+0000 7ff1bde00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff1c00cc780 0x7ff1c015bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56076/0 (socket says 172.21.15.46:56076) 2024-03-04T10:46:24.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.441+0000 7ff1bde00640 1 -- 172.21.15.46:0/2048329629 learned_addr learned my addr 172.21.15.46:0/2048329629 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:24.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.444+0000 7ff1be800640 1 -- 172.21.15.46:0/2048329629 >> v1:172.21.15.73:6789/0 conn(0x7ff1c015c6e0 legacy=0x7ff1c0162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.444+0000 7ff1be800640 1 -- 172.21.15.46:0/2048329629 >> v1:172.21.15.46:6789/0 conn(0x7ff1c00cc780 legacy=0x7ff1c015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.444+0000 7ff1be800640 1 -- 172.21.15.46:0/2048329629 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00b1cf0 con 0x7ff1c00ca560 2024-03-04T10:46:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.449+0000 7ff1be800640 1 --2- 172.21.15.46:0/2048329629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00ca560 0x7ff1c00ccb60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009d90 tx=0x7ff1b802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40998d6a3fc16780 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1bca00640 1 -- 172.21.15.46:0/2048329629 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8039070 con 0x7ff1c00ca560 2024-03-04T10:46:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1bca00640 1 -- 172.21.15.46:0/2048329629 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b802cd00 con 0x7ff1c00ca560 2024-03-04T10:46:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1bca00640 1 -- 172.21.15.46:0/2048329629 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8034660 con 0x7ff1c00ca560 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1c5200640 1 -- 172.21.15.46:0/2048329629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00ca560 msgr2=0x7ff1c00ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1c5200640 1 --2- 172.21.15.46:0/2048329629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00ca560 0x7ff1c00ccb60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009d90 tx=0x7ff1b802bf50 comp rx=0 tx=0).stop 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1c5200640 1 -- 172.21.15.46:0/2048329629 shutdown_connections 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1c5200640 1 --2- 172.21.15.46:0/2048329629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00ca560 0x7ff1c00ccb60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1c5200640 1 -- 172.21.15.46:0/2048329629 >> 172.21.15.46:0/2048329629 conn(0x7ff1c0066c40 msgr2=0x7ff1c0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.453+0000 7ff1c5200640 1 -- 172.21.15.46:0/2048329629 shutdown_connections 2024-03-04T10:46:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.454+0000 7ff1c5200640 1 -- 172.21.15.46:0/2048329629 wait complete. 2024-03-04T10:46:24.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.455+0000 7ff1c5200640 1 Processor -- start 2024-03-04T10:46:24.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.455+0000 7ff1c5200640 1 -- start start 2024-03-04T10:46:24.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.456+0000 7ff1c5200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1c00ca560 0x7ff1c00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.456+0000 7ff1c5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00cc780 0x7ff1c00c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.456+0000 7ff1c5200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c015c6e0 0x7ff1c01f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.456+0000 7ff1c5200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0154c60 con 0x7ff1c015c6e0 2024-03-04T10:46:24.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.456+0000 7ff1c5200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00b22b0 con 0x7ff1c00cc780 2024-03-04T10:46:24.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.456+0000 7ff1c5200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00b1660 con 0x7ff1c00ca560 2024-03-04T10:46:24.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.457+0000 7ff1bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00cc780 0x7ff1c00c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.457+0000 7ff1be800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c015c6e0 0x7ff1c01f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.457+0000 7ff1bde00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1c00ca560 0x7ff1c00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.457+0000 7ff1bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00cc780 0x7ff1c00c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35888/0 (socket says 172.21.15.46:35888) 2024-03-04T10:46:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.457+0000 7ff1bd400640 1 -- 172.21.15.46:0/470419750 learned_addr learned my addr 172.21.15.46:0/470419750 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.462+0000 7ff1bd400640 1 -- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1c00ca560 msgr2=0x7ff1c00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.462+0000 7ff1bd400640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1c00ca560 0x7ff1c00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.462+0000 7ff1bd400640 1 -- 172.21.15.46:0/470419750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c015c6e0 msgr2=0x7ff1c01f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.462+0000 7ff1bd400640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c015c6e0 0x7ff1c01f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.462+0000 7ff1bd400640 1 -- 172.21.15.46:0/470419750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c01e4bb0 con 0x7ff1c00cc780 2024-03-04T10:46:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.462+0000 7ff1bde00640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1c00ca560 0x7ff1c00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T10:46:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.465+0000 7ff1bd400640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00cc780 0x7ff1c00c82d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c3c0 tx=0x7ff1ac00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.469+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1c00cc780 2024-03-04T10:46:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.469+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0052f0 con 0x7ff1c00cc780 2024-03-04T10:46:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.469+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac003830 con 0x7ff1c00cc780 2024-03-04T10:46:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.469+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c01e4e50 con 0x7ff1c00cc780 2024-03-04T10:46:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.469+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c01e5410 con 0x7ff1c00cc780 2024-03-04T10:46:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.470+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1c00c3320 con 0x7ff1c00cc780 2024-03-04T10:46:24.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.492+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1ac01a070 con 0x7ff1c00cc780 2024-03-04T10:46:24.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.493+0000 7ff1b6000640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff1a006b520 0x7ff1a006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.494+0000 7ff1bde00640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff1a006b520 0x7ff1a006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.494+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff1ac056480 con 0x7ff1c00cc780 2024-03-04T10:46:24.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.494+0000 7ff1b6000640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7ff1a0073780 0x7ff1a0075ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.494+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 --> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1ac0054a0 con 0x7ff1a0073780 2024-03-04T10:46:24.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.494+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1ac054680 con 0x7ff1c00cc780 2024-03-04T10:46:24.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.495+0000 7ff1be800640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7ff1a0073780 0x7ff1a0075ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.495+0000 7ff1bde00640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff1a006b520 0x7ff1a006d9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0005880 tx=0x7ff1b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.495+0000 7ff1be800640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7ff1a0073780 0x7ff1a0075ba0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.496+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== osd.6 v2:172.21.15.73:6810/1918032406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff1ac0054a0 con 0x7ff1a0073780 2024-03-04T10:46:24.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.513+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 --> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1c00680b0 con 0x7ff1a0073780 2024-03-04T10:46:24.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.513+0000 7ff1b6000640 1 -- 172.21.15.46:0/470419750 <== osd.6 v2:172.21.15.73:6810/1918032406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff1c00680b0 con 0x7ff1a0073780 2024-03-04T10:46:24.517 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:24.517 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7ff1a0073780 msgr2=0x7ff1a0075ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6810/1918032406,v1:172.21.15.73:6811/1918032406] conn(0x7ff1a0073780 0x7ff1a0075ba0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff1a006b520 msgr2=0x7ff1a006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ff1a006b520 0x7ff1a006d9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0005880 tx=0x7ff1b0009040 comp rx=0 tx=0).stop 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00cc780 msgr2=0x7ff1c00c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 --2- 172.21.15.46:0/470419750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c00cc780 0x7ff1c00c82d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c3c0 tx=0x7ff1ac00c880 comp rx=0 tx=0).stop 2024-03-04T10:46:24.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1be800640 1 -- 172.21.15.46:0/470419750 reap_dead start 2024-03-04T10:46:24.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 shutdown_connections 2024-03-04T10:46:24.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 >> 172.21.15.46:0/470419750 conn(0x7ff1c0066c40 msgr2=0x7ff1c01583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:24.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.514+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 shutdown_connections 2024-03-04T10:46:24.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.515+0000 7ff1c5200640 1 -- 172.21.15.46:0/470419750 wait complete. 2024-03-04T10:46:24.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-04T10:46:24.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.713+0000 7f7b5b800640 1 Processor -- start 2024-03-04T10:46:24.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.713+0000 7f7b5b800640 1 -- start start 2024-03-04T10:46:24.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.714+0000 7f7b5b800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b54154750 0x7f7b540cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.714+0000 7f7b5b800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b54154b30 0x7f7b540ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.714+0000 7f7b5b800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540ca6d0 con 0x7f7b540ce650 2024-03-04T10:46:24.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.714+0000 7f7b5b800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540ca990 con 0x7f7b54154750 2024-03-04T10:46:24.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.714+0000 7f7b5b800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540cac70 con 0x7f7b54154b30 2024-03-04T10:46:24.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.715+0000 7f7b53e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b54154b30 0x7f7b540ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.715+0000 7f7b58e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b54154750 0x7f7b540cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.715+0000 7f7b59800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7b540ce650 0x7f7b540cc700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56088/0 (socket says 172.21.15.46:56088) 2024-03-04T10:46:24.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.715+0000 7f7b59800640 1 -- 172.21.15.46:0/1120265402 learned_addr learned my addr 172.21.15.46:0/1120265402 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:24.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.719+0000 7f7b53e00640 1 -- 172.21.15.46:0/1120265402 >> v2:172.21.15.46:3300/0 conn(0x7f7b54154750 msgr2=0x7f7b540cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:24.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.719+0000 7f7b53e00640 1 --2- 172.21.15.46:0/1120265402 >> v2:172.21.15.46:3300/0 conn(0x7f7b54154750 0x7f7b540cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.719+0000 7f7b53e00640 1 -- 172.21.15.46:0/1120265402 >> v1:172.21.15.46:6789/0 conn(0x7f7b540ce650 legacy=0x7f7b540cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.719+0000 7f7b53e00640 1 -- 172.21.15.46:0/1120265402 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5415a900 con 0x7f7b54154b30 2024-03-04T10:46:24.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.722+0000 7f7b53e00640 1 --2- 172.21.15.46:0/1120265402 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b54154b30 0x7f7b540ce110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097a0 tx=0x7f7b4002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693223a410bced8e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.726+0000 7f7b53400640 1 -- 172.21.15.46:0/1120265402 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40034070 con 0x7f7b54154b30 2024-03-04T10:46:24.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.726+0000 7f7b53400640 1 -- 172.21.15.46:0/1120265402 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40030800 con 0x7f7b54154b30 2024-03-04T10:46:24.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.726+0000 7f7b53400640 1 -- 172.21.15.46:0/1120265402 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40030bd0 con 0x7f7b54154b30 2024-03-04T10:46:24.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.726+0000 7f7b5b800640 1 -- 172.21.15.46:0/1120265402 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b54154b30 msgr2=0x7f7b540ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.726+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1120265402 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b54154b30 0x7f7b540ce110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097a0 tx=0x7f7b4002b940 comp rx=0 tx=0).stop 2024-03-04T10:46:24.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.727+0000 7f7b5b800640 1 -- 172.21.15.46:0/1120265402 shutdown_connections 2024-03-04T10:46:24.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.727+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1120265402 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b54154b30 0x7f7b540ce110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.727+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1120265402 >> v2:172.21.15.46:3300/0 conn(0x7f7b54154750 0x7f7b540cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.727+0000 7f7b5b800640 1 -- 172.21.15.46:0/1120265402 >> 172.21.15.46:0/1120265402 conn(0x7f7b54066c40 msgr2=0x7f7b54067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:24.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.727+0000 7f7b5b800640 1 -- 172.21.15.46:0/1120265402 shutdown_connections 2024-03-04T10:46:24.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.727+0000 7f7b5b800640 1 -- 172.21.15.46:0/1120265402 wait complete. 2024-03-04T10:46:24.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.729+0000 7f7b5b800640 1 Processor -- start 2024-03-04T10:46:24.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.729+0000 7f7b5b800640 1 -- start start 2024-03-04T10:46:24.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.730+0000 7f7b5b800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b540ce650 0x7f7b541e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.730+0000 7f7b5b800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b54154750 0x7f7b541e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.730+0000 7f7b5b800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b540c3e10 0x7f7b540c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.730+0000 7f7b5b800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415a5b0 con 0x7f7b54154750 2024-03-04T10:46:24.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.730+0000 7f7b5b800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415aec0 con 0x7f7b540ce650 2024-03-04T10:46:24.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.730+0000 7f7b5b800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415b3e0 con 0x7f7b540c3e10 2024-03-04T10:46:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.731+0000 7f7b59800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b540c3e10 0x7f7b540c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.731+0000 7f7b53e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b54154750 0x7f7b541e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.731+0000 7f7b58e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b540ce650 0x7f7b541e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.731+0000 7f7b59800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b540c3e10 0x7f7b540c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47094/0 (socket says 172.21.15.46:47094) 2024-03-04T10:46:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.731+0000 7f7b59800640 1 -- 172.21.15.46:0/1049102658 learned_addr learned my addr 172.21.15.46:0/1049102658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.735+0000 7f7b58e00640 1 -- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b540c3e10 msgr2=0x7f7b540c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.735+0000 7f7b58e00640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b540c3e10 0x7f7b540c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.735+0000 7f7b58e00640 1 -- 172.21.15.46:0/1049102658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b54154750 msgr2=0x7f7b541e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.735+0000 7f7b58e00640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b54154750 0x7f7b541e7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.735+0000 7f7b58e00640 1 -- 172.21.15.46:0/1049102658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b541f0ae0 con 0x7f7b540ce650 2024-03-04T10:46:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.738+0000 7f7b58e00640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b540ce650 0x7f7b541e6c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800e8b0 tx=0x7f7b4800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.741+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48017070 con 0x7f7b540ce650 2024-03-04T10:46:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.741+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800c940 con 0x7f7b540ce650 2024-03-04T10:46:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.741+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800cd30 con 0x7f7b540ce650 2024-03-04T10:46:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.742+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b541f0dc0 con 0x7f7b540ce650 2024-03-04T10:46:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.742+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b54152e10 con 0x7f7b540ce650 2024-03-04T10:46:24.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.743+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b540c36f0 con 0x7f7b540ce650 2024-03-04T10:46:24.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.763+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b4801a070 con 0x7f7b540ce650 2024-03-04T10:46:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.765+0000 7f7b50c00640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f7b3406b550 0x7f7b3406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.765+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7b48057100 con 0x7f7b540ce650 2024-03-04T10:46:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.765+0000 7f7b53e00640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f7b3406b550 0x7f7b3406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:24.766+0000 7f7b53e00640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f7b3406b550 0x7f7b3406da10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b40036000 tx=0x7f7b4003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:25.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.095+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7b48059060 con 0x7f7b540ce650 2024-03-04T10:46:25.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.424+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b540c2a70 con 0x7f7b3406b550 2024-03-04T10:46:25.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.425+0000 7f7b50c00640 1 -- 172.21.15.46:0/1049102658 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b540c2a70 con 0x7f7b3406b550 2024-03-04T10:46:25.429 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-03-04T10:46:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.428+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f7b3406b550 msgr2=0x7f7b3406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.428+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f7b3406b550 0x7f7b3406da10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b40036000 tx=0x7f7b4003b040 comp rx=0 tx=0).stop 2024-03-04T10:46:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.428+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b540ce650 msgr2=0x7f7b541e6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.428+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b540ce650 0x7f7b541e6c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800e8b0 tx=0x7f7b4800ed70 comp rx=0 tx=0).stop 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 shutdown_connections 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f7b3406b550 0x7f7b3406da10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b540c3e10 0x7f7b540c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b54154750 0x7f7b541e7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 --2- 172.21.15.46:0/1049102658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b540ce650 0x7f7b541e6c30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 >> 172.21.15.46:0/1049102658 conn(0x7f7b54066c40 msgr2=0x7f7b54159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 shutdown_connections 2024-03-04T10:46:25.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.429+0000 7f7b5b800640 1 -- 172.21.15.46:0/1049102658 wait complete. 2024-03-04T10:46:25.457 INFO:tasks.ceph:Scrubbing osd.7 2024-03-04T10:46:25.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-04T10:46:25.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.661+0000 7ffaad600640 1 Processor -- start 2024-03-04T10:46:25.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.661+0000 7ffaad600640 1 -- start start 2024-03-04T10:46:25.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.662+0000 7ffaad600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.662+0000 7ffaad600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa80ccd50 con 0x7ffaa815a710 2024-03-04T10:46:25.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.662+0000 7ffaad600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa80cdd80 con 0x7ffaa80cd7b0 2024-03-04T10:46:25.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.663+0000 7ffaad600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80cc4b0 con 0x7ffaa80ca330 2024-03-04T10:46:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.663+0000 7ffaa7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.663+0000 7ffaacc00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffaa815a710 0x7ffaa815aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56104/0 (socket says 172.21.15.46:56104) 2024-03-04T10:46:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.663+0000 7ffaacc00640 1 -- 172.21.15.46:0/3209231240 learned_addr learned my addr 172.21.15.46:0/3209231240 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.666+0000 7ffaa6a00640 1 -- 172.21.15.46:0/3209231240 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917552071 0 0) 0x7ffaa80ccd50 con 0x7ffaa815a710 2024-03-04T10:46:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.667+0000 7ffaa6a00640 1 -- 172.21.15.46:0/3209231240 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa8c003520 con 0x7ffaa815a710 2024-03-04T10:46:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.667+0000 7ffaa7e00640 1 -- 172.21.15.46:0/3209231240 >> v1:172.21.15.73:6789/0 conn(0x7ffaa80cd7b0 legacy=0x7ffaa80ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.667+0000 7ffaa7e00640 1 -- 172.21.15.46:0/3209231240 >> v1:172.21.15.46:6789/0 conn(0x7ffaa815a710 legacy=0x7ffaa815aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.667+0000 7ffaa7e00640 1 -- 172.21.15.46:0/3209231240 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80cc790 con 0x7ffaa80ca330 2024-03-04T10:46:25.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.669+0000 7ffaa7e00640 1 --2- 172.21.15.46:0/3209231240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa80ca710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097d0 tx=0x7ffa9802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ad37bd8f9a7e74 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.672+0000 7ffaa6a00640 1 -- 172.21.15.46:0/3209231240 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98035020 con 0x7ffaa80ca330 2024-03-04T10:46:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.672+0000 7ffaa6a00640 1 -- 172.21.15.46:0/3209231240 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98031890 con 0x7ffaa80ca330 2024-03-04T10:46:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.672+0000 7ffaa6a00640 1 -- 172.21.15.46:0/3209231240 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031c60 con 0x7ffaa80ca330 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 -- 172.21.15.46:0/3209231240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 msgr2=0x7ffaa80ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 --2- 172.21.15.46:0/3209231240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa80ca710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097d0 tx=0x7ffa9802b930 comp rx=0 tx=0).stop 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 -- 172.21.15.46:0/3209231240 shutdown_connections 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 --2- 172.21.15.46:0/3209231240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa80ca710 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 -- 172.21.15.46:0/3209231240 >> 172.21.15.46:0/3209231240 conn(0x7ffaa80cf9b0 msgr2=0x7ffaa80cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 -- 172.21.15.46:0/3209231240 shutdown_connections 2024-03-04T10:46:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.673+0000 7ffaad600640 1 -- 172.21.15.46:0/3209231240 wait complete. 2024-03-04T10:46:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.675+0000 7ffaad600640 1 Processor -- start 2024-03-04T10:46:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.675+0000 7ffaad600640 1 -- start start 2024-03-04T10:46:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.676+0000 7ffaad600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.676+0000 7ffaad600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaa80cd7b0 0x7ffaa815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.676+0000 7ffaad600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa815a710 0x7ffaa81f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.676+0000 7ffaad600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8154a30 con 0x7ffaa815a710 2024-03-04T10:46:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.676+0000 7ffaad600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80cc180 con 0x7ffaa80cd7b0 2024-03-04T10:46:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.676+0000 7ffaad600640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8154bb0 con 0x7ffaa80ca330 2024-03-04T10:46:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.677+0000 7ffaa7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.677+0000 7ffaacc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa815a710 0x7ffaa81f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.677+0000 7ffaa7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaa80cd7b0 0x7ffaa815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.677+0000 7ffaa7e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa8158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47116/0 (socket says 172.21.15.46:47116) 2024-03-04T10:46:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.677+0000 7ffaa7e00640 1 -- 172.21.15.46:0/2343313996 learned_addr learned my addr 172.21.15.46:0/2343313996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:25.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.681+0000 7ffaa7e00640 1 -- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaa80cd7b0 msgr2=0x7ffaa815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.681+0000 7ffaa7e00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaa80cd7b0 0x7ffaa815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.681+0000 7ffaa7e00640 1 -- 172.21.15.46:0/2343313996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa815a710 msgr2=0x7ffaa81f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.681+0000 7ffaa7e00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa815a710 0x7ffaa81f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.681+0000 7ffaa7e00640 1 -- 172.21.15.46:0/2343313996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80b2720 con 0x7ffaa80ca330 2024-03-04T10:46:25.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.683+0000 7ffaa7e00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa8158d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa9802bf40 tx=0x7ffa980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:25.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.687+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98035040 con 0x7ffaa80ca330 2024-03-04T10:46:25.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.687+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98030df0 con 0x7ffaa80ca330 2024-03-04T10:46:25.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.687+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980466c0 con 0x7ffaa80ca330 2024-03-04T10:46:25.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.687+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa80b2a00 con 0x7ffaa80ca330 2024-03-04T10:46:25.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.688+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa815dc90 con 0x7ffaa80ca330 2024-03-04T10:46:25.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.689+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffaa81f02c0 con 0x7ffaa80ca330 2024-03-04T10:46:25.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.714+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa98038020 con 0x7ffaa80ca330 2024-03-04T10:46:25.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.715+0000 7ffa9fe00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa8806b520 0x7ffa8806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.715+0000 7ffaa7400640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa8806b520 0x7ffa8806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.716+0000 7ffaa7400640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa8806b520 0x7ffa8806d9e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80c66d0 tx=0x7ffa94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.717+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffa980794c0 con 0x7ffaa80ca330 2024-03-04T10:46:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.718+0000 7ffa9fe00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7ffa88073720 0x7ffa88075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.718+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 --> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa98001d30 con 0x7ffa88073720 2024-03-04T10:46:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.718+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa980776c0 con 0x7ffaa80ca330 2024-03-04T10:46:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.718+0000 7ffaacc00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7ffa88073720 0x7ffa88075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.719+0000 7ffaacc00640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7ffa88073720 0x7ffa88075b40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:25.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.720+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== osd.7 v2:172.21.15.73:6802/2569604158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffa98001d30 con 0x7ffa88073720 2024-03-04T10:46:25.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.750+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 --> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffaa80751a0 con 0x7ffa88073720 2024-03-04T10:46:25.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.751+0000 7ffa9fe00640 1 -- 172.21.15.46:0/2343313996 <== osd.7 v2:172.21.15.73:6802/2569604158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffaa80751a0 con 0x7ffa88073720 2024-03-04T10:46:25.754 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-04T10:46:25.754 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T10:46:25.755 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.751+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7ffa88073720 msgr2=0x7ffa88075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6802/2569604158,v1:172.21.15.73:6803/2569604158] conn(0x7ffa88073720 0x7ffa88075b40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa8806b520 msgr2=0x7ffa8806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7ffa8806b520 0x7ffa8806d9e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80c66d0 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 msgr2=0x7ffaa8158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 --2- 172.21.15.46:0/2343313996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaa80ca330 0x7ffaa8158d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa9802bf40 tx=0x7ffa980046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaacc00640 1 -- 172.21.15.46:0/2343313996 reap_dead start 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 shutdown_connections 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 >> 172.21.15.46:0/2343313996 conn(0x7ffaa80cf9b0 msgr2=0x7ffaa80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 shutdown_connections 2024-03-04T10:46:25.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.752+0000 7ffaad600640 1 -- 172.21.15.46:0/2343313996 wait complete. 2024-03-04T10:46:25.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-04T10:46:25.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.966+0000 7fabac800640 1 Processor -- start 2024-03-04T10:46:25.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.966+0000 7fabac800640 1 -- start start 2024-03-04T10:46:25.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.967+0000 7fabac800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faba4151f70 0x7faba4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.967+0000 7fabac800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 0x7faba406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.968+0000 7fabac800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40c10b0 con 0x7faba4152350 2024-03-04T10:46:25.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.968+0000 7fabac800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40c0e80 con 0x7faba4151f70 2024-03-04T10:46:25.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.968+0000 7fabac800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40c1370 con 0x7faba415b700 2024-03-04T10:46:25.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.968+0000 7faba9400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 0x7faba406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.968+0000 7faba9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faba4151f70 0x7faba4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.969+0000 7faba9400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 0x7faba406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47130/0 (socket says 172.21.15.46:47130) 2024-03-04T10:46:25.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.969+0000 7faba9400640 1 -- 172.21.15.46:0/3996463241 learned_addr learned my addr 172.21.15.46:0/3996463241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.972+0000 7faba9400640 1 -- 172.21.15.46:0/3996463241 >> v2:172.21.15.73:3300/0 conn(0x7faba4151f70 msgr2=0x7faba4158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.972+0000 7faba9400640 1 --2- 172.21.15.46:0/3996463241 >> v2:172.21.15.73:3300/0 conn(0x7faba4151f70 0x7faba4158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.972+0000 7faba9400640 1 -- 172.21.15.46:0/3996463241 >> v1:172.21.15.73:6789/0 conn(0x7faba4152350 legacy=0x7faba40c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.972+0000 7faba9400640 1 -- 172.21.15.46:0/3996463241 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40c1650 con 0x7faba415b700 2024-03-04T10:46:25.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.974+0000 7faba9400640 1 --2- 172.21.15.46:0/3996463241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 0x7faba406f700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab94009870 tx=0x7fab9402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faa619b6f32fe723 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:25.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.977+0000 7faba8a00640 1 -- 172.21.15.46:0/3996463241 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9402f840 con 0x7faba415b700 2024-03-04T10:46:25.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.979+0000 7faba8a00640 1 -- 172.21.15.46:0/3996463241 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9402f9e0 con 0x7faba415b700 2024-03-04T10:46:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.979+0000 7faba8a00640 1 -- 172.21.15.46:0/3996463241 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9402fdb0 con 0x7faba415b700 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 -- 172.21.15.46:0/3996463241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 msgr2=0x7faba406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 --2- 172.21.15.46:0/3996463241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 0x7faba406f700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab94009870 tx=0x7fab9402ba20 comp rx=0 tx=0).stop 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 -- 172.21.15.46:0/3996463241 shutdown_connections 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 --2- 172.21.15.46:0/3996463241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba415b700 0x7faba406f700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 --2- 172.21.15.46:0/3996463241 >> v2:172.21.15.73:3300/0 conn(0x7faba4151f70 0x7faba4158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 -- 172.21.15.46:0/3996463241 >> 172.21.15.46:0/3996463241 conn(0x7faba406aff0 msgr2=0x7faba406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 -- 172.21.15.46:0/3996463241 shutdown_connections 2024-03-04T10:46:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.980+0000 7fabac800640 1 -- 172.21.15.46:0/3996463241 wait complete. 2024-03-04T10:46:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.983+0000 7fabac800640 1 Processor -- start 2024-03-04T10:46:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.983+0000 7fabac800640 1 -- start start 2024-03-04T10:46:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7fabac800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba4151f70 0x7faba40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7fabac800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 0x7faba41f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7fabac800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faba415b700 0x7faba40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7fabac800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4158600 con 0x7faba4151f70 2024-03-04T10:46:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7fabac800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4158320 con 0x7faba415b700 2024-03-04T10:46:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7fabac800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba4159060 con 0x7faba4152350 2024-03-04T10:46:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.985+0000 7faba9400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 0x7faba41f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.986+0000 7fabaa800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faba415b700 0x7faba40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.986+0000 7faba9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba4151f70 0x7faba40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.986+0000 7faba9400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 0x7faba41f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47146/0 (socket says 172.21.15.46:47146) 2024-03-04T10:46:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.986+0000 7faba9400640 1 -- 172.21.15.46:0/1564554684 learned_addr learned my addr 172.21.15.46:0/1564554684 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.991+0000 7faba9400640 1 -- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faba415b700 msgr2=0x7faba40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.991+0000 7faba9400640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faba415b700 0x7faba40cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.991+0000 7faba9400640 1 -- 172.21.15.46:0/1564554684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba4151f70 msgr2=0x7faba40ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.991+0000 7faba9400640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba4151f70 0x7faba40ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.991+0000 7faba9400640 1 -- 172.21.15.46:0/1564554684 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba41e2610 con 0x7faba4152350 2024-03-04T10:46:25.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.993+0000 7faba9400640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 0x7faba41f46b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab94004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:26.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.998+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94037bc0 con 0x7faba4152350 2024-03-04T10:46:26.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.998+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94046070 con 0x7faba4152350 2024-03-04T10:46:26.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.998+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94041400 con 0x7faba4152350 2024-03-04T10:46:26.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.998+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba41e28b0 con 0x7faba4152350 2024-03-04T10:46:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:25.998+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba41e2e50 con 0x7faba4152350 2024-03-04T10:46:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.000+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba415bdf0 con 0x7faba4152350 2024-03-04T10:46:26.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.020+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab94040070 con 0x7faba4152350 2024-03-04T10:46:26.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.021+0000 7fab9e000640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fab8806b520 0x7fab8806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.021+0000 7faba9e00640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fab8806b520 0x7fab8806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.022+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fab94079a60 con 0x7faba4152350 2024-03-04T10:46:26.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.022+0000 7faba9e00640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fab8806b520 0x7fab8806d9e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab98009aa0 tx=0x7fab98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:26.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.324+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faba415bdf0 con 0x7faba4152350 2024-03-04T10:46:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.548+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7faba40ca800 con 0x7fab8806b520 2024-03-04T10:46:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.549+0000 7fab9e000640 1 -- 172.21.15.46:0/1564554684 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faba40ca800 con 0x7fab8806b520 2024-03-04T10:46:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-03-04T10:46:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fab8806b520 msgr2=0x7fab8806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fab8806b520 0x7fab8806d9e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab98009aa0 tx=0x7fab98009190 comp rx=0 tx=0).stop 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 msgr2=0x7faba41f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 0x7faba41f46b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab94004730 comp rx=0 tx=0).stop 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 shutdown_connections 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fab8806b520 0x7fab8806d9e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faba415b700 0x7faba40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faba4152350 0x7faba41f46b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 --2- 172.21.15.46:0/1564554684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba4151f70 0x7faba40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 >> 172.21.15.46:0/1564554684 conn(0x7faba406aff0 msgr2=0x7faba4156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 shutdown_connections 2024-03-04T10:46:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.553+0000 7fabac800640 1 -- 172.21.15.46:0/1564554684 wait complete. 2024-03-04T10:46:26.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T10:46:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.765+0000 7fbf15c00640 1 Processor -- start 2024-03-04T10:46:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.766+0000 7fbf15c00640 1 -- start start 2024-03-04T10:46:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.768+0000 7fbf15c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbf1006d4e0 0x7fbf1006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.768+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10158750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.768+0000 7fbf15c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf100716f0 0x7fbf10158c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.768+0000 7fbf15c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1015b960 con 0x7fbf1006d4e0 2024-03-04T10:46:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.768+0000 7fbf15c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1015bc40 con 0x7fbf100716f0 2024-03-04T10:46:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.768+0000 7fbf15c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1015bf20 con 0x7fbf1006d8c0 2024-03-04T10:46:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.769+0000 7fbf0e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.769+0000 7fbf0f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf100716f0 0x7fbf10158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.769+0000 7fbf0ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbf1006d4e0 0x7fbf1006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.769+0000 7fbf0e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47158/0 (socket says 172.21.15.46:47158) 2024-03-04T10:46:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.769+0000 7fbf0e000640 1 -- 172.21.15.46:0/483366363 learned_addr learned my addr 172.21.15.46:0/483366363 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.772+0000 7fbf0e000640 1 -- 172.21.15.46:0/483366363 >> v2:172.21.15.73:3300/0 conn(0x7fbf100716f0 msgr2=0x7fbf10158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.772+0000 7fbf0e000640 1 --2- 172.21.15.46:0/483366363 >> v2:172.21.15.73:3300/0 conn(0x7fbf100716f0 0x7fbf10158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.772+0000 7fbf0e000640 1 -- 172.21.15.46:0/483366363 >> v2:172.21.15.46:3300/0 conn(0x7fbf1006d4e0 msgr2=0x7fbf1006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.772+0000 7fbf0e000640 1 --2- 172.21.15.46:0/483366363 >> v2:172.21.15.46:3300/0 conn(0x7fbf1006d4e0 0x7fbf1006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.772+0000 7fbf0e000640 1 -- 172.21.15.46:0/483366363 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1015c200 con 0x7fbf1006d8c0 2024-03-04T10:46:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.774+0000 7fbf0e000640 1 --2- 172.21.15.46:0/483366363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10158750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbf10067c90 tx=0x7fbefc02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38c1715864ebca99 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.777+0000 7fbf0d600640 1 -- 172.21.15.46:0/483366363 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc035020 con 0x7fbf1006d8c0 2024-03-04T10:46:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.779+0000 7fbf0d600640 1 -- 172.21.15.46:0/483366363 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc031870 con 0x7fbf1006d8c0 2024-03-04T10:46:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.779+0000 7fbf0d600640 1 -- 172.21.15.46:0/483366363 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc031c40 con 0x7fbf1006d8c0 2024-03-04T10:46:26.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.779+0000 7fbf15c00640 1 -- 172.21.15.46:0/483366363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 msgr2=0x7fbf10158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:26.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.779+0000 7fbf15c00640 1 --2- 172.21.15.46:0/483366363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10158750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbf10067c90 tx=0x7fbefc02b910 comp rx=0 tx=0).stop 2024-03-04T10:46:26.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 -- 172.21.15.46:0/483366363 shutdown_connections 2024-03-04T10:46:26.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 --2- 172.21.15.46:0/483366363 >> v2:172.21.15.73:3300/0 conn(0x7fbf100716f0 0x7fbf10158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 --2- 172.21.15.46:0/483366363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10158750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 --2- 172.21.15.46:0/483366363 >> v2:172.21.15.46:3300/0 conn(0x7fbf1006d4e0 0x7fbf1006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 -- 172.21.15.46:0/483366363 >> 172.21.15.46:0/483366363 conn(0x7fbf100c88d0 msgr2=0x7fbf100c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:26.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 -- 172.21.15.46:0/483366363 shutdown_connections 2024-03-04T10:46:26.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.780+0000 7fbf15c00640 1 -- 172.21.15.46:0/483366363 wait complete. 2024-03-04T10:46:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.782+0000 7fbf15c00640 1 Processor -- start 2024-03-04T10:46:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.782+0000 7fbf15c00640 1 -- start start 2024-03-04T10:46:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.783+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 0x7fbf101ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.783+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.783+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf100716f0 0x7fbf101476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.783+0000 7fbf15c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1006dfa0 con 0x7fbf100716f0 2024-03-04T10:46:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.784+0000 7fbf15c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1006de20 con 0x7fbf1006d4e0 2024-03-04T10:46:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.784+0000 7fbf15c00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1006e120 con 0x7fbf1006d8c0 2024-03-04T10:46:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.784+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 0x7fbf101ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.784+0000 7fbf0e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.785+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 0x7fbf101ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35936/0 (socket says 172.21.15.46:35936) 2024-03-04T10:46:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.785+0000 7fbf0ea00640 1 -- 172.21.15.46:0/1449185923 learned_addr learned my addr 172.21.15.46:0/1449185923 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.786+0000 7fbf0f400640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf100716f0 0x7fbf101476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.790+0000 7fbf0ea00640 1 -- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 msgr2=0x7fbf10156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.790+0000 7fbf0ea00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.790+0000 7fbf0ea00640 1 -- 172.21.15.46:0/1449185923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf100716f0 msgr2=0x7fbf101476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.790+0000 7fbf0ea00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf100716f0 0x7fbf101476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.790+0000 7fbf0ea00640 1 -- 172.21.15.46:0/1449185923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10157c90 con 0x7fbf1006d4e0 2024-03-04T10:46:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.793+0000 7fbf0ea00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 0x7fbf101ee0d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000e870 tx=0x7fbf0000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.798+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00017070 con 0x7fbf1006d4e0 2024-03-04T10:46:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.798+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000ee60 con 0x7fbf1006d4e0 2024-03-04T10:46:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.798+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf100c83f0 con 0x7fbf1006d4e0 2024-03-04T10:46:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.798+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000cb80 con 0x7fbf1006d4e0 2024-03-04T10:46:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.798+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1015a3c0 con 0x7fbf1006d4e0 2024-03-04T10:46:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.800+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf100680b0 con 0x7fbf1006d4e0 2024-03-04T10:46:26.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.829+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbf0001a070 con 0x7fbf1006d4e0 2024-03-04T10:46:26.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.830+0000 7fbf06a00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbef006b550 0x7fbef006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:26.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.831+0000 7fbf0e000640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbef006b550 0x7fbef006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:26.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:26.831+0000 7fbf0e000640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbef006b550 0x7fbef006da10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbefc036000 tx=0x7fbefc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:27.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.141+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbf00057010 con 0x7fbf1006d4e0 2024-03-04T10:46:27.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.152+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbf00058f70 con 0x7fbf1006d4e0 2024-03-04T10:46:27.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.377+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf10073470 con 0x7fbef006b550 2024-03-04T10:46:27.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.390+0000 7fbf06a00640 1 -- 172.21.15.46:0/1449185923 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252520 (secure 0 0 0) 0x7fbefc085a80 con 0x7fbef006b550 2024-03-04T10:46:27.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:27.398 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.394+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbef006b550 msgr2=0x7fbef006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.394+0000 7fbf15c00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbef006b550 0x7fbef006da10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbefc036000 tx=0x7fbefc03c040 comp rx=0 tx=0).stop 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.394+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 msgr2=0x7fbf101ee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.394+0000 7fbf15c00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 0x7fbf101ee0d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000e870 tx=0x7fbf0000ed30 comp rx=0 tx=0).stop 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 shutdown_connections 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbef006b550 0x7fbef006da10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf100716f0 0x7fbf101476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf1006d8c0 0x7fbf10156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 --2- 172.21.15.46:0/1449185923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf1006d4e0 0x7fbf101ee0d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 >> 172.21.15.46:0/1449185923 conn(0x7fbf100c88d0 msgr2=0x7fbf1006ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:27.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 shutdown_connections 2024-03-04T10:46:27.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:27.395+0000 7fbf15c00640 1 -- 172.21.15.46:0/1449185923 wait complete. 2024-03-04T10:46:27.418 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":3533,"stamp":"2024-03-04T10:46:26.848655+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216230073,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":2671,"num_read_kb":3493838,"num_write":53242,"num_write_kb":4570296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52076,"ondisk_log_size":52076,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":944712,"kb_used_data":424584,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754030008,"statfs":{"total":773094113280,"available":772126728192,"internally_reserved":0,"allocated":434774016,"data_stored":433223434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":532532785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":700,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002386"},"pg_stats":[{"pgid":"3.3f","version":"25'429","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.700274+0000","last_change":"2024-03-04T08:49:40.155624+0000","last_active":"2024-03-04T10:46:18.700274+0000","last_peered":"2024-03-04T10:46:18.700274+0000","last_clean":"2024-03-04T10:46:18.700274+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T10:46:18.700274+0000","last_undegraded":"2024-03-04T10:46:18.700274+0000","last_fullsized":"2024-03-04T10:46:18.700274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":56779,"num_write":405,"num_write_kb":75850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'417","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.610288+0000","last_change":"2024-03-04T08:49:40.156194+0000","last_active":"2024-03-04T10:46:12.610288+0000","last_peered":"2024-03-04T10:46:12.610288+0000","last_clean":"2024-03-04T10:46:12.610288+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T10:46:12.610288+0000","last_undegraded":"2024-03-04T10:46:12.610288+0000","last_fullsized":"2024-03-04T10:46:12.610288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:32:04.116252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68736,"num_write":382,"num_write_kb":71625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'378","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.616232+0000","last_change":"2024-03-04T08:49:40.160141+0000","last_active":"2024-03-04T10:46:12.616232+0000","last_peered":"2024-03-04T10:46:12.616232+0000","last_clean":"2024-03-04T10:46:12.616232+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T10:46:12.616232+0000","last_undegraded":"2024-03-04T10:46:12.616232+0000","last_fullsized":"2024-03-04T10:46:12.616232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:50.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24226,"num_write":349,"num_write_kb":62283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'365","reported_seq":456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.619322+0000","last_change":"2024-03-04T08:49:40.161701+0000","last_active":"2024-03-04T10:46:12.619322+0000","last_peered":"2024-03-04T10:46:12.619322+0000","last_clean":"2024-03-04T10:46:12.619322+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T10:46:12.619322+0000","last_undegraded":"2024-03-04T10:46:12.619322+0000","last_fullsized":"2024-03-04T10:46:12.619322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":47711,"num_write":338,"num_write_kb":33889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'444","reported_seq":557,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.751195+0000","last_change":"2024-03-04T08:49:40.144000+0000","last_active":"2024-03-04T10:46:12.751195+0000","last_peered":"2024-03-04T10:46:12.751195+0000","last_clean":"2024-03-04T10:46:12.751195+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T10:46:12.751195+0000","last_undegraded":"2024-03-04T10:46:12.751195+0000","last_fullsized":"2024-03-04T10:46:12.751195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":161798,"num_write":413,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'380","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.620139+0000","last_change":"2024-03-04T08:49:40.162702+0000","last_active":"2024-03-04T10:46:12.620139+0000","last_peered":"2024-03-04T10:46:12.620139+0000","last_clean":"2024-03-04T10:46:12.620139+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T10:46:12.620139+0000","last_undegraded":"2024-03-04T10:46:12.620139+0000","last_fullsized":"2024-03-04T10:46:12.620139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":34885,"num_write":352,"num_write_kb":34327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'382","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.752768+0000","last_change":"2024-03-04T08:49:40.165433+0000","last_active":"2024-03-04T10:46:12.752768+0000","last_peered":"2024-03-04T10:46:12.752768+0000","last_clean":"2024-03-04T10:46:12.752768+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T10:46:12.752768+0000","last_undegraded":"2024-03-04T10:46:12.752768+0000","last_fullsized":"2024-03-04T10:46:12.752768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":76194,"num_write":351,"num_write_kb":54499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'362","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.613961+0000","last_change":"2024-03-04T08:49:40.150399+0000","last_active":"2024-03-04T10:46:12.613961+0000","last_peered":"2024-03-04T10:46:12.613961+0000","last_clean":"2024-03-04T10:46:12.613961+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T10:46:12.613961+0000","last_undegraded":"2024-03-04T10:46:12.613961+0000","last_fullsized":"2024-03-04T10:46:12.613961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:51.549571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26383,"num_write":323,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'401","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.661796+0000","last_change":"2024-03-04T08:49:40.154148+0000","last_active":"2024-03-04T10:46:12.661796+0000","last_peered":"2024-03-04T10:46:12.661796+0000","last_clean":"2024-03-04T10:46:12.661796+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T10:46:12.661796+0000","last_undegraded":"2024-03-04T10:46:12.661796+0000","last_fullsized":"2024-03-04T10:46:12.661796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20946,"num_write":374,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'408","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.864469+0000","last_change":"2024-03-04T10:46:18.864513+0000","last_active":"2024-03-04T10:46:18.864469+0000","last_peered":"2024-03-04T10:46:18.864469+0000","last_clean":"2024-03-04T10:46:18.864469+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T10:46:18.864469+0000","last_undegraded":"2024-03-04T10:46:18.864469+0000","last_fullsized":"2024-03-04T10:46:18.864469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-03-04T10:46:18.864343+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-03-04T10:46:18.864343+0000","last_clean_scrub_stamp":"2024-03-04T10:46:18.864343+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:43.109471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":17641,"num_write":374,"num_write_kb":26355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'385","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.752645+0000","last_change":"2024-03-04T08:49:40.152402+0000","last_active":"2024-03-04T10:46:12.752645+0000","last_peered":"2024-03-04T10:46:12.752645+0000","last_clean":"2024-03-04T10:46:12.752645+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T10:46:12.752645+0000","last_undegraded":"2024-03-04T10:46:12.752645+0000","last_fullsized":"2024-03-04T10:46:12.752645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":63408,"num_write":367,"num_write_kb":59321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'360","reported_seq":442,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755283+0000","last_change":"2024-03-04T08:49:40.148714+0000","last_active":"2024-03-04T10:46:12.755283+0000","last_peered":"2024-03-04T10:46:12.755283+0000","last_clean":"2024-03-04T10:46:12.755283+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T10:46:12.755283+0000","last_undegraded":"2024-03-04T10:46:12.755283+0000","last_fullsized":"2024-03-04T10:46:12.755283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":49283,"num_write":340,"num_write_kb":63175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'409","reported_seq":492,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.751749+0000","last_change":"2024-03-04T08:49:40.167389+0000","last_active":"2024-03-04T10:46:12.751749+0000","last_peered":"2024-03-04T10:46:12.751749+0000","last_clean":"2024-03-04T10:46:12.751749+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T10:46:12.751749+0000","last_undegraded":"2024-03-04T10:46:12.751749+0000","last_fullsized":"2024-03-04T10:46:12.751749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:46.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":54416,"num_write":375,"num_write_kb":38585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'398","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.739621+0000","last_change":"2024-03-04T08:49:40.164113+0000","last_active":"2024-03-04T10:46:12.739621+0000","last_peered":"2024-03-04T10:46:12.739621+0000","last_clean":"2024-03-04T10:46:12.739621+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T10:46:12.739621+0000","last_undegraded":"2024-03-04T10:46:12.739621+0000","last_fullsized":"2024-03-04T10:46:12.739621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:28.326744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29624,"num_write":360,"num_write_kb":30114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'407","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.595990+0000","last_change":"2024-03-04T08:50:12.592750+0000","last_active":"2024-03-04T10:46:12.595990+0000","last_peered":"2024-03-04T10:46:12.595990+0000","last_clean":"2024-03-04T10:46:12.595990+0000","last_became_active":"2024-03-04T08:50:12.592374+0000","last_became_peered":"2024-03-04T08:50:12.592374+0000","last_unstale":"2024-03-04T10:46:12.595990+0000","last_undegraded":"2024-03-04T10:46:12.595990+0000","last_fullsized":"2024-03-04T10:46:12.595990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:28.147260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":71598,"num_write":369,"num_write_kb":67511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'422","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.109988+0000","last_change":"2024-03-04T08:49:40.154008+0000","last_active":"2024-03-04T10:46:22.109988+0000","last_peered":"2024-03-04T10:46:22.109988+0000","last_clean":"2024-03-04T10:46:22.109988+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T10:46:22.109988+0000","last_undegraded":"2024-03-04T10:46:22.109988+0000","last_fullsized":"2024-03-04T10:46:22.109988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":49152,"num_write":389,"num_write_kb":58855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'440","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.109930+0000","last_change":"2024-03-04T08:49:40.171497+0000","last_active":"2024-03-04T10:46:22.109930+0000","last_peered":"2024-03-04T10:46:22.109930+0000","last_clean":"2024-03-04T10:46:22.109930+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T10:46:22.109930+0000","last_undegraded":"2024-03-04T10:46:22.109930+0000","last_fullsized":"2024-03-04T10:46:22.109930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":66011,"num_write":406,"num_write_kb":96427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'413","reported_seq":494,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.633298+0000","last_change":"2024-03-04T08:49:40.171400+0000","last_active":"2024-03-04T10:46:12.633298+0000","last_peered":"2024-03-04T10:46:12.633298+0000","last_clean":"2024-03-04T10:46:12.633298+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T10:46:12.633298+0000","last_undegraded":"2024-03-04T10:46:12.633298+0000","last_fullsized":"2024-03-04T10:46:12.633298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:47.512564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":44968,"num_write":370,"num_write_kb":71715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'428","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.651573+0000","last_change":"2024-03-04T08:49:40.162275+0000","last_active":"2024-03-04T10:46:12.651573+0000","last_peered":"2024-03-04T10:46:12.651573+0000","last_clean":"2024-03-04T10:46:12.651573+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T10:46:12.651573+0000","last_undegraded":"2024-03-04T10:46:12.651573+0000","last_fullsized":"2024-03-04T10:46:12.651573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":73465,"num_write":395,"num_write_kb":100388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'437","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755668+0000","last_change":"2024-03-04T08:49:40.148423+0000","last_active":"2024-03-04T10:46:12.755668+0000","last_peered":"2024-03-04T10:46:12.755668+0000","last_clean":"2024-03-04T10:46:12.755668+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T10:46:12.755668+0000","last_undegraded":"2024-03-04T10:46:12.755668+0000","last_fullsized":"2024-03-04T10:46:12.755668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":62456,"num_write":411,"num_write_kb":51118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'420","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.645953+0000","last_change":"2024-03-04T08:49:40.163055+0000","last_active":"2024-03-04T10:46:12.645953+0000","last_peered":"2024-03-04T10:46:12.645953+0000","last_clean":"2024-03-04T10:46:12.645953+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T10:46:12.645953+0000","last_undegraded":"2024-03-04T10:46:12.645953+0000","last_fullsized":"2024-03-04T10:46:12.645953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:11:50.282915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":56958,"num_write":379,"num_write_kb":88435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'432","reported_seq":527,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.663042+0000","last_change":"2024-03-04T08:49:40.153611+0000","last_active":"2024-03-04T10:46:12.663042+0000","last_peered":"2024-03-04T10:46:12.663042+0000","last_clean":"2024-03-04T10:46:12.663042+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T10:46:12.663042+0000","last_undegraded":"2024-03-04T10:46:12.663042+0000","last_fullsized":"2024-03-04T10:46:12.663042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84454,"num_write":409,"num_write_kb":67704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'392","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.619693+0000","last_change":"2024-03-04T08:49:40.128140+0000","last_active":"2024-03-04T10:46:12.619693+0000","last_peered":"2024-03-04T10:46:12.619693+0000","last_clean":"2024-03-04T10:46:12.619693+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T10:46:12.619693+0000","last_undegraded":"2024-03-04T10:46:12.619693+0000","last_fullsized":"2024-03-04T10:46:12.619693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:13.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15942,"num_write":359,"num_write_kb":55013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'444","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.162421+0000","last_change":"2024-03-04T10:46:22.162491+0000","last_active":"2024-03-04T10:46:22.162421+0000","last_peered":"2024-03-04T10:46:22.162421+0000","last_clean":"2024-03-04T10:46:22.162421+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T10:46:22.162421+0000","last_undegraded":"2024-03-04T10:46:22.162421+0000","last_fullsized":"2024-03-04T10:46:22.162421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-03-04T10:46:22.162314+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-03-04T10:46:22.162314+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.162314+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:40.994846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47415,"num_write":405,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'419","reported_seq":508,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.615874+0000","last_change":"2024-03-04T08:49:40.155747+0000","last_active":"2024-03-04T10:46:12.615874+0000","last_peered":"2024-03-04T10:46:12.615874+0000","last_clean":"2024-03-04T10:46:12.615874+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T10:46:12.615874+0000","last_undegraded":"2024-03-04T10:46:12.615874+0000","last_fullsized":"2024-03-04T10:46:12.615874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:43.305755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49227,"num_write":397,"num_write_kb":80014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'505","reported_seq":604,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.650666+0000","last_change":"2024-03-04T08:49:40.148564+0000","last_active":"2024-03-04T10:46:12.650666+0000","last_peered":"2024-03-04T10:46:12.650666+0000","last_clean":"2024-03-04T10:46:12.650666+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T10:46:12.650666+0000","last_undegraded":"2024-03-04T10:46:12.650666+0000","last_fullsized":"2024-03-04T10:46:12.650666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":78376,"num_write":475,"num_write_kb":113705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'427","reported_seq":526,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.711933+0000","last_change":"2024-03-04T08:49:40.164049+0000","last_active":"2024-03-04T10:46:12.711933+0000","last_peered":"2024-03-04T10:46:12.711933+0000","last_clean":"2024-03-04T10:46:12.711933+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T10:46:12.711933+0000","last_undegraded":"2024-03-04T10:46:12.711933+0000","last_fullsized":"2024-03-04T10:46:12.711933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:27.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75663,"num_write":396,"num_write_kb":55800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'371","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.696927+0000","last_change":"2024-03-04T08:49:40.167743+0000","last_active":"2024-03-04T10:46:12.696927+0000","last_peered":"2024-03-04T10:46:12.696927+0000","last_clean":"2024-03-04T10:46:12.696927+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T10:46:12.696927+0000","last_undegraded":"2024-03-04T10:46:12.696927+0000","last_fullsized":"2024-03-04T10:46:12.696927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:49.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":29309,"num_write":341,"num_write_kb":42443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'381","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.600348+0000","last_change":"2024-03-04T08:49:40.161449+0000","last_active":"2024-03-04T10:46:12.600348+0000","last_peered":"2024-03-04T10:46:12.600348+0000","last_clean":"2024-03-04T10:46:12.600348+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T10:46:12.600348+0000","last_undegraded":"2024-03-04T10:46:12.600348+0000","last_fullsized":"2024-03-04T10:46:12.600348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:38.271047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44796,"num_write":353,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'484","reported_seq":592,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.109759+0000","last_change":"2024-03-04T08:49:40.149916+0000","last_active":"2024-03-04T10:46:22.109759+0000","last_peered":"2024-03-04T10:46:22.109759+0000","last_clean":"2024-03-04T10:46:22.109759+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T10:46:22.109759+0000","last_undegraded":"2024-03-04T10:46:22.109759+0000","last_fullsized":"2024-03-04T10:46:22.109759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":91221,"num_write":448,"num_write_kb":101088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'466","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.634945+0000","last_change":"2024-03-04T08:49:40.166470+0000","last_active":"2024-03-04T10:46:12.634945+0000","last_peered":"2024-03-04T10:46:12.634945+0000","last_clean":"2024-03-04T10:46:12.634945+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T10:46:12.634945+0000","last_undegraded":"2024-03-04T10:46:12.634945+0000","last_fullsized":"2024-03-04T10:46:12.634945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:40.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":144837,"num_write":435,"num_write_kb":130358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'449","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:20.960220+0000","last_change":"2024-03-04T08:49:40.156078+0000","last_active":"2024-03-04T10:46:20.960220+0000","last_peered":"2024-03-04T10:46:20.960220+0000","last_clean":"2024-03-04T10:46:20.960220+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T10:46:20.960220+0000","last_undegraded":"2024-03-04T10:46:20.960220+0000","last_fullsized":"2024-03-04T10:46:20.960220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23611,"num_write":420,"num_write_kb":59471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.041874+0000","last_change":"2024-03-04T10:46:22.041926+0000","last_active":"2024-03-04T10:46:22.041874+0000","last_peered":"2024-03-04T10:46:22.041874+0000","last_clean":"2024-03-04T10:46:22.041874+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T10:46:22.041874+0000","last_undegraded":"2024-03-04T10:46:22.041874+0000","last_fullsized":"2024-03-04T10:46:22.041874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-03-04T10:46:22.041753+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-03-04T10:46:22.041753+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.041753+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:48.268816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":42800,"num_write":385,"num_write_kb":71334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'238","reported_seq":305,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:25.853775+0000","last_change":"2024-03-04T08:49:38.994994+0000","last_active":"2024-03-04T10:44:25.853775+0000","last_peered":"2024-03-04T10:44:25.853775+0000","last_clean":"2024-03-04T10:44:25.853775+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T10:44:25.853775+0000","last_undegraded":"2024-03-04T10:44:25.853775+0000","last_fullsized":"2024-03-04T10:44:25.853775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'368","reported_seq":448,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.653223+0000","last_change":"2024-03-04T08:49:40.166758+0000","last_active":"2024-03-04T10:46:12.653223+0000","last_peered":"2024-03-04T10:46:12.653223+0000","last_clean":"2024-03-04T10:46:12.653223+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T10:46:12.653223+0000","last_undegraded":"2024-03-04T10:46:12.653223+0000","last_fullsized":"2024-03-04T10:46:12.653223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:34.632372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32809,"num_write":342,"num_write_kb":54741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1404","reported_seq":1472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.811589+0000","last_change":"2024-03-04T08:49:39.012564+0000","last_active":"2024-03-04T10:46:08.811589+0000","last_peered":"2024-03-04T10:46:08.811589+0000","last_clean":"2024-03-04T10:46:08.811589+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T10:46:08.811589+0000","last_undegraded":"2024-03-04T10:46:08.811589+0000","last_fullsized":"2024-03-04T10:46:08.811589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1404,"log_dups_size":0,"ondisk_log_size":1404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":17039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'794","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:07.213101+0000","last_change":"2024-03-04T08:49:38.998896+0000","last_active":"2024-03-04T10:46:07.213101+0000","last_peered":"2024-03-04T10:46:07.213101+0000","last_clean":"2024-03-04T10:46:07.213101+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T10:46:07.213101+0000","last_undegraded":"2024-03-04T10:46:07.213101+0000","last_fullsized":"2024-03-04T10:46:07.213101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:30.991593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'441","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.542322+0000","last_change":"2024-03-04T08:49:40.155520+0000","last_active":"2024-03-04T10:46:12.542322+0000","last_peered":"2024-03-04T10:46:12.542322+0000","last_clean":"2024-03-04T10:46:12.542322+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T10:46:12.542322+0000","last_undegraded":"2024-03-04T10:46:12.542322+0000","last_fullsized":"2024-03-04T10:46:12.542322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:13.733137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":27702,"num_write":417,"num_write_kb":42496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1108","reported_seq":1178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:38.763313+0000","last_change":"2024-03-04T08:49:39.013355+0000","last_active":"2024-03-04T10:45:38.763313+0000","last_peered":"2024-03-04T10:45:38.763313+0000","last_clean":"2024-03-04T10:45:38.763313+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T10:45:38.763313+0000","last_undegraded":"2024-03-04T10:45:38.763313+0000","last_fullsized":"2024-03-04T10:45:38.763313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":12803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'408","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.650127+0000","last_change":"2024-03-04T08:49:40.159261+0000","last_active":"2024-03-04T10:46:12.650127+0000","last_peered":"2024-03-04T10:46:12.650127+0000","last_clean":"2024-03-04T10:46:12.650127+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T10:46:12.650127+0000","last_undegraded":"2024-03-04T10:46:12.650127+0000","last_fullsized":"2024-03-04T10:46:12.650127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:50.922756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":31518,"num_write":380,"num_write_kb":54868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'70","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:21.047756+0000","last_change":"2024-03-04T10:46:21.047781+0000","last_active":"2024-03-04T10:46:21.047756+0000","last_peered":"2024-03-04T10:46:21.047756+0000","last_clean":"2024-03-04T10:46:21.047756+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T10:46:21.047756+0000","last_undegraded":"2024-03-04T10:46:21.047756+0000","last_fullsized":"2024-03-04T10:46:21.047756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-03-04T10:46:21.047692+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-03-04T10:46:21.047692+0000","last_clean_scrub_stamp":"2024-03-04T10:46:21.047692+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:57.931004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'455","reported_seq":555,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.891556+0000","last_change":"2024-03-04T10:46:22.891598+0000","last_active":"2024-03-04T10:46:22.891556+0000","last_peered":"2024-03-04T10:46:22.891556+0000","last_clean":"2024-03-04T10:46:22.891556+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T10:46:22.891556+0000","last_undegraded":"2024-03-04T10:46:22.891556+0000","last_fullsized":"2024-03-04T10:46:22.891556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'455","last_scrub_stamp":"2024-03-04T10:46:22.891454+0000","last_deep_scrub":"25'455","last_deep_scrub_stamp":"2024-03-04T10:46:22.891454+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.891454+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:26:42.196610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68599,"num_write":425,"num_write_kb":83547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1156","reported_seq":1226,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:17.145543+0000","last_change":"2024-03-04T08:49:39.011918+0000","last_active":"2024-03-04T10:46:17.145543+0000","last_peered":"2024-03-04T10:46:17.145543+0000","last_clean":"2024-03-04T10:46:17.145543+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T10:46:17.145543+0000","last_undegraded":"2024-03-04T10:46:17.145543+0000","last_fullsized":"2024-03-04T10:46:17.145543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12835661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":13085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'401","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.613532+0000","last_change":"2024-03-04T08:49:40.148115+0000","last_active":"2024-03-04T10:46:12.613532+0000","last_peered":"2024-03-04T10:46:12.613532+0000","last_clean":"2024-03-04T10:46:12.613532+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T10:46:12.613532+0000","last_undegraded":"2024-03-04T10:46:12.613532+0000","last_fullsized":"2024-03-04T10:46:12.613532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:08.855476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":69489,"num_write":372,"num_write_kb":99199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1618","reported_seq":1687,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.818071+0000","last_change":"2024-03-04T08:49:38.991363+0000","last_active":"2024-03-04T10:46:08.818071+0000","last_peered":"2024-03-04T10:46:08.818071+0000","last_clean":"2024-03-04T10:46:08.818071+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T10:46:08.818071+0000","last_undegraded":"2024-03-04T10:46:08.818071+0000","last_fullsized":"2024-03-04T10:46:08.818071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1618,"log_dups_size":0,"ondisk_log_size":1618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:33.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1561,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'404","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.169265+0000","last_change":"2024-03-04T10:46:23.169294+0000","last_active":"2024-03-04T10:46:23.169265+0000","last_peered":"2024-03-04T10:46:23.169265+0000","last_clean":"2024-03-04T10:46:23.169265+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T10:46:23.169265+0000","last_undegraded":"2024-03-04T10:46:23.169265+0000","last_fullsized":"2024-03-04T10:46:23.169265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'404","last_scrub_stamp":"2024-03-04T10:46:23.169152+0000","last_deep_scrub":"25'404","last_deep_scrub_stamp":"2024-03-04T10:46:23.169152+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.169152+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:40.041015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":58935,"num_write":368,"num_write_kb":66938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1677","reported_seq":1756,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:21.967440+0000","last_change":"2024-03-04T10:46:21.967510+0000","last_active":"2024-03-04T10:46:21.967440+0000","last_peered":"2024-03-04T10:46:21.967440+0000","last_clean":"2024-03-04T10:46:21.967440+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T10:46:21.967440+0000","last_undegraded":"2024-03-04T10:46:21.967440+0000","last_fullsized":"2024-03-04T10:46:21.967440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1677","last_scrub_stamp":"2024-03-04T10:46:21.967326+0000","last_deep_scrub":"25'1677","last_deep_scrub_stamp":"2024-03-04T10:46:21.967326+0000","last_clean_scrub_stamp":"2024-03-04T10:46:21.967326+0000","objects_scrubbed":8,"log_size":1677,"log_dups_size":0,"ondisk_log_size":1677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:11.705842+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'390","reported_seq":472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.752567+0000","last_change":"2024-03-04T08:49:40.158329+0000","last_active":"2024-03-04T10:46:12.752567+0000","last_peered":"2024-03-04T10:46:12.752567+0000","last_clean":"2024-03-04T10:46:12.752567+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T10:46:12.752567+0000","last_undegraded":"2024-03-04T10:46:12.752567+0000","last_fullsized":"2024-03-04T10:46:12.752567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":52325,"num_write":353,"num_write_kb":55067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'325","reported_seq":396,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:13.092643+0000","last_change":"2024-03-04T08:49:39.004334+0000","last_active":"2024-03-04T10:44:13.092643+0000","last_peered":"2024-03-04T10:44:13.092643+0000","last_clean":"2024-03-04T10:44:13.092643+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T10:44:13.092643+0000","last_undegraded":"2024-03-04T10:44:13.092643+0000","last_fullsized":"2024-03-04T10:44:13.092643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:03.531378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":8340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'416","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.744020+0000","last_change":"2024-03-04T08:49:40.169845+0000","last_active":"2024-03-04T10:46:12.744020+0000","last_peered":"2024-03-04T10:46:12.744020+0000","last_clean":"2024-03-04T10:46:12.744020+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T10:46:12.744020+0000","last_undegraded":"2024-03-04T10:46:12.744020+0000","last_fullsized":"2024-03-04T10:46:12.744020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":41706,"num_write":387,"num_write_kb":84154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'64","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.769241+0000","last_change":"2024-03-04T08:49:39.012827+0000","last_active":"2024-03-04T10:46:18.769241+0000","last_peered":"2024-03-04T10:46:18.769241+0000","last_clean":"2024-03-04T10:46:18.769241+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T10:46:18.769241+0000","last_undegraded":"2024-03-04T10:46:18.769241+0000","last_fullsized":"2024-03-04T10:46:18.769241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'410","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.109852+0000","last_change":"2024-03-04T08:49:40.170406+0000","last_active":"2024-03-04T10:46:22.109852+0000","last_peered":"2024-03-04T10:46:22.109852+0000","last_clean":"2024-03-04T10:46:22.109852+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T10:46:22.109852+0000","last_undegraded":"2024-03-04T10:46:22.109852+0000","last_fullsized":"2024-03-04T10:46:22.109852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71159,"num_write":383,"num_write_kb":34363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'67","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.699681+0000","last_change":"2024-03-04T08:49:39.010807+0000","last_active":"2024-03-04T10:46:18.699681+0000","last_peered":"2024-03-04T10:46:18.699681+0000","last_clean":"2024-03-04T10:46:18.699681+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T10:46:18.699681+0000","last_undegraded":"2024-03-04T10:46:18.699681+0000","last_fullsized":"2024-03-04T10:46:18.699681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'444","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.050820+0000","last_change":"2024-03-04T10:46:23.050820+0000","last_active":"2024-03-04T10:46:23.050820+0000","last_peered":"2024-03-04T10:46:23.050820+0000","last_clean":"2024-03-04T10:46:23.050820+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T10:46:23.050820+0000","last_undegraded":"2024-03-04T10:46:23.050820+0000","last_fullsized":"2024-03-04T10:46:23.050820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-03-04T10:46:23.050650+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-03-04T10:46:23.050650+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.050650+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:08.069198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":111394,"num_write":416,"num_write_kb":109040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'824","reported_seq":895,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.927195+0000","last_change":"2024-03-04T08:49:38.989999+0000","last_active":"2024-03-04T10:46:12.927195+0000","last_peered":"2024-03-04T10:46:12.927195+0000","last_clean":"2024-03-04T10:46:12.927195+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T10:46:12.927195+0000","last_undegraded":"2024-03-04T10:46:12.927195+0000","last_fullsized":"2024-03-04T10:46:12.927195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:45.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":8544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'477","reported_seq":570,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.109640+0000","last_change":"2024-03-04T08:49:40.158558+0000","last_active":"2024-03-04T10:46:22.109640+0000","last_peered":"2024-03-04T10:46:22.109640+0000","last_clean":"2024-03-04T10:46:22.109640+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T10:46:22.109640+0000","last_undegraded":"2024-03-04T10:46:22.109640+0000","last_fullsized":"2024-03-04T10:46:22.109640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":59537,"num_write":439,"num_write_kb":76319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'755","reported_seq":836,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.852960+0000","last_change":"2024-03-04T10:46:22.853006+0000","last_active":"2024-03-04T10:46:22.852960+0000","last_peered":"2024-03-04T10:46:22.852960+0000","last_clean":"2024-03-04T10:46:22.852960+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T10:46:22.852960+0000","last_undegraded":"2024-03-04T10:46:22.852960+0000","last_fullsized":"2024-03-04T10:46:22.852960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'755","last_scrub_stamp":"2024-03-04T10:46:22.852876+0000","last_deep_scrub":"25'755","last_deep_scrub_stamp":"2024-03-04T10:46:22.852876+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.852876+0000","objects_scrubbed":3,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:41.685408+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'373","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.634395+0000","last_change":"2024-03-04T08:49:40.151522+0000","last_active":"2024-03-04T10:46:12.634395+0000","last_peered":"2024-03-04T10:46:12.634395+0000","last_clean":"2024-03-04T10:46:12.634395+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T10:46:12.634395+0000","last_undegraded":"2024-03-04T10:46:12.634395+0000","last_fullsized":"2024-03-04T10:46:12.634395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":68174,"num_write":341,"num_write_kb":71100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'821","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.267058+0000","last_change":"2024-03-04T08:49:38.995711+0000","last_active":"2024-03-04T10:44:27.267058+0000","last_peered":"2024-03-04T10:44:27.267058+0000","last_clean":"2024-03-04T10:44:27.267058+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T10:44:27.267058+0000","last_undegraded":"2024-03-04T10:44:27.267058+0000","last_fullsized":"2024-03-04T10:44:27.267058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:26.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'386","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755982+0000","last_change":"2024-03-04T08:49:40.157614+0000","last_active":"2024-03-04T10:46:12.755982+0000","last_peered":"2024-03-04T10:46:12.755982+0000","last_clean":"2024-03-04T10:46:12.755982+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T10:46:12.755982+0000","last_undegraded":"2024-03-04T10:46:12.755982+0000","last_fullsized":"2024-03-04T10:46:12.755982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":53055,"num_write":347,"num_write_kb":59070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'206","reported_seq":278,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:46.179515+0000","last_change":"2024-03-04T08:49:39.008804+0000","last_active":"2024-03-04T10:43:46.179515+0000","last_peered":"2024-03-04T10:43:46.179515+0000","last_clean":"2024-03-04T10:43:46.179515+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T10:43:46.179515+0000","last_undegraded":"2024-03-04T10:43:46.179515+0000","last_fullsized":"2024-03-04T10:43:46.179515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'441","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.755742+0000","last_change":"2024-03-04T08:49:40.170734+0000","last_active":"2024-03-04T10:46:12.755742+0000","last_peered":"2024-03-04T10:46:12.755742+0000","last_clean":"2024-03-04T10:46:12.755742+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T10:46:12.755742+0000","last_undegraded":"2024-03-04T10:46:12.755742+0000","last_fullsized":"2024-03-04T10:46:12.755742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21944,"num_write":403,"num_write_kb":30840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'307","reported_seq":379,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:27.205109+0000","last_change":"2024-03-04T08:49:39.002985+0000","last_active":"2024-03-04T10:44:27.205109+0000","last_peered":"2024-03-04T10:44:27.205109+0000","last_clean":"2024-03-04T10:44:27.205109+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T10:44:27.205109+0000","last_undegraded":"2024-03-04T10:44:27.205109+0000","last_fullsized":"2024-03-04T10:44:27.205109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:19:54.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195474,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'401","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.655138+0000","last_change":"2024-03-04T08:49:40.161964+0000","last_active":"2024-03-04T10:46:12.655138+0000","last_peered":"2024-03-04T10:46:12.655138+0000","last_clean":"2024-03-04T10:46:12.655138+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T10:46:12.655138+0000","last_undegraded":"2024-03-04T10:46:12.655138+0000","last_fullsized":"2024-03-04T10:46:12.655138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10206,"num_write":377,"num_write_kb":38425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":245,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:20.082755+0000","last_change":"2024-03-04T10:46:20.082780+0000","last_active":"2024-03-04T10:46:20.082755+0000","last_peered":"2024-03-04T10:46:20.082755+0000","last_clean":"2024-03-04T10:46:20.082755+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T10:46:20.082755+0000","last_undegraded":"2024-03-04T10:46:20.082755+0000","last_fullsized":"2024-03-04T10:46:20.082755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-03-04T10:46:20.082688+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-03-04T10:46:20.082688+0000","last_clean_scrub_stamp":"2024-03-04T10:46:20.082688+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:09:31.855920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'313","reported_seq":391,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.769278+0000","last_change":"2024-03-04T08:49:39.014793+0000","last_active":"2024-03-04T10:46:18.769278+0000","last_peered":"2024-03-04T10:46:18.769278+0000","last_clean":"2024-03-04T10:46:18.769278+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T10:46:18.769278+0000","last_undegraded":"2024-03-04T10:46:18.769278+0000","last_fullsized":"2024-03-04T10:46:18.769278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'381","reported_seq":464,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.651645+0000","last_change":"2024-03-04T08:49:40.163305+0000","last_active":"2024-03-04T10:46:12.651645+0000","last_peered":"2024-03-04T10:46:12.651645+0000","last_clean":"2024-03-04T10:46:12.651645+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T10:46:12.651645+0000","last_undegraded":"2024-03-04T10:46:12.651645+0000","last_fullsized":"2024-03-04T10:46:12.651645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:18:43.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":349,"num_write_kb":66462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'645","reported_seq":725,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:03.969196+0000","last_change":"2024-03-04T08:49:39.002825+0000","last_active":"2024-03-04T10:46:03.969196+0000","last_peered":"2024-03-04T10:46:03.969196+0000","last_clean":"2024-03-04T10:46:03.969196+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T10:46:03.969196+0000","last_undegraded":"2024-03-04T10:46:03.969196+0000","last_fullsized":"2024-03-04T10:46:03.969196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":12616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'408","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.738162+0000","last_change":"2024-03-04T08:49:40.162764+0000","last_active":"2024-03-04T10:46:12.738162+0000","last_peered":"2024-03-04T10:46:12.738162+0000","last_clean":"2024-03-04T10:46:12.738162+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T10:46:12.738162+0000","last_undegraded":"2024-03-04T10:46:12.738162+0000","last_fullsized":"2024-03-04T10:46:12.738162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.218040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":90482,"num_write":377,"num_write_kb":105458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1490","reported_seq":2985,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.915368+0000","last_change":"2024-03-04T08:49:38.993426+0000","last_active":"2024-03-04T10:46:12.915368+0000","last_peered":"2024-03-04T10:46:12.915368+0000","last_clean":"2024-03-04T10:46:12.915368+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T10:46:12.915368+0000","last_undegraded":"2024-03-04T10:46:12.915368+0000","last_fullsized":"2024-03-04T10:46:12.915368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:36.136938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470470,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":2454,"num_write":1423,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.553382+0000","last_change":"2024-03-04T08:49:40.166794+0000","last_active":"2024-03-04T10:46:12.553382+0000","last_peered":"2024-03-04T10:46:12.553382+0000","last_clean":"2024-03-04T10:46:12.553382+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T10:46:12.553382+0000","last_undegraded":"2024-03-04T10:46:12.553382+0000","last_fullsized":"2024-03-04T10:46:12.553382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:16.314273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":48072,"num_write":378,"num_write_kb":95952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'419","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.769265+0000","last_change":"2024-03-04T08:49:39.015686+0000","last_active":"2024-03-04T10:46:18.769265+0000","last_peered":"2024-03-04T10:46:18.769265+0000","last_clean":"2024-03-04T10:46:18.769265+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T10:46:18.769265+0000","last_undegraded":"2024-03-04T10:46:18.769265+0000","last_fullsized":"2024-03-04T10:46:18.769265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":8389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'412","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.699961+0000","last_change":"2024-03-04T08:49:40.141225+0000","last_active":"2024-03-04T10:46:18.699961+0000","last_peered":"2024-03-04T10:46:18.699961+0000","last_clean":"2024-03-04T10:46:18.699961+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T10:46:18.699961+0000","last_undegraded":"2024-03-04T10:46:18.699961+0000","last_fullsized":"2024-03-04T10:46:18.699961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":26782,"num_write":371,"num_write_kb":63203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'369","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:17.341560+0000","last_change":"2024-03-04T08:49:38.995049+0000","last_active":"2024-03-04T10:44:17.341560+0000","last_peered":"2024-03-04T10:44:17.341560+0000","last_clean":"2024-03-04T10:44:17.341560+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T10:44:17.341560+0000","last_undegraded":"2024-03-04T10:44:17.341560+0000","last_fullsized":"2024-03-04T10:44:17.341560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:20.126791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'439","reported_seq":532,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.622883+0000","last_change":"2024-03-04T08:49:40.159893+0000","last_active":"2024-03-04T10:46:12.622883+0000","last_peered":"2024-03-04T10:46:12.622883+0000","last_clean":"2024-03-04T10:46:12.622883+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T10:46:12.622883+0000","last_undegraded":"2024-03-04T10:46:12.622883+0000","last_fullsized":"2024-03-04T10:46:12.622883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":67320,"num_write":391,"num_write_kb":100010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'445","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.446795+0000","last_change":"2024-03-04T08:49:39.003999+0000","last_active":"2024-03-04T10:45:48.446795+0000","last_peered":"2024-03-04T10:45:48.446795+0000","last_clean":"2024-03-04T10:45:48.446795+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T10:45:48.446795+0000","last_undegraded":"2024-03-04T10:45:48.446795+0000","last_fullsized":"2024-03-04T10:45:48.446795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'397","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.739239+0000","last_change":"2024-03-04T08:49:40.158929+0000","last_active":"2024-03-04T10:46:12.739239+0000","last_peered":"2024-03-04T10:46:12.739239+0000","last_clean":"2024-03-04T10:46:12.739239+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T10:46:12.739239+0000","last_undegraded":"2024-03-04T10:46:12.739239+0000","last_fullsized":"2024-03-04T10:46:12.739239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":38107,"num_write":361,"num_write_kb":51817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'4114","reported_seq":4188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.729103+0000","last_change":"2024-03-04T08:49:38.998558+0000","last_active":"2024-03-04T10:46:08.729103+0000","last_peered":"2024-03-04T10:46:08.729103+0000","last_clean":"2024-03-04T10:46:08.729103+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T10:46:08.729103+0000","last_undegraded":"2024-03-04T10:46:08.729103+0000","last_fullsized":"2024-03-04T10:46:08.729103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:45.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9078,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'349","reported_seq":427,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.624499+0000","last_change":"2024-03-04T08:49:40.164278+0000","last_active":"2024-03-04T10:46:12.624499+0000","last_peered":"2024-03-04T10:46:12.624499+0000","last_clean":"2024-03-04T10:46:12.624499+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T10:46:12.624499+0000","last_undegraded":"2024-03-04T10:46:12.624499+0000","last_fullsized":"2024-03-04T10:46:12.624499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:24.752254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":326,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'342","reported_seq":417,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:08.810583+0000","last_change":"2024-03-04T08:49:39.012780+0000","last_active":"2024-03-04T10:46:08.810583+0000","last_peered":"2024-03-04T10:46:08.810583+0000","last_clean":"2024-03-04T10:46:08.810583+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T10:46:08.810583+0000","last_undegraded":"2024-03-04T10:46:08.810583+0000","last_fullsized":"2024-03-04T10:46:08.810583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'442","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.641416+0000","last_change":"2024-03-04T08:49:40.161378+0000","last_active":"2024-03-04T10:46:12.641416+0000","last_peered":"2024-03-04T10:46:12.641416+0000","last_clean":"2024-03-04T10:46:12.641416+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T10:46:12.641416+0000","last_undegraded":"2024-03-04T10:46:12.641416+0000","last_fullsized":"2024-03-04T10:46:12.641416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:48.600601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":107561,"num_write":401,"num_write_kb":141953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'190","reported_seq":273,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:19.922918+0000","last_change":"2024-03-04T10:46:19.922968+0000","last_active":"2024-03-04T10:46:19.922918+0000","last_peered":"2024-03-04T10:46:19.922918+0000","last_clean":"2024-03-04T10:46:19.922918+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T10:46:19.922918+0000","last_undegraded":"2024-03-04T10:46:19.922918+0000","last_fullsized":"2024-03-04T10:46:19.922918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'190","last_scrub_stamp":"2024-03-04T10:46:19.922768+0000","last_deep_scrub":"25'190","last_deep_scrub_stamp":"2024-03-04T10:46:19.922768+0000","last_clean_scrub_stamp":"2024-03-04T10:46:19.922768+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:42.185416+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.655403+0000","last_change":"2024-03-04T08:49:40.158845+0000","last_active":"2024-03-04T10:46:12.655403+0000","last_peered":"2024-03-04T10:46:12.655403+0000","last_clean":"2024-03-04T10:46:12.655403+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T10:46:12.655403+0000","last_undegraded":"2024-03-04T10:46:12.655403+0000","last_fullsized":"2024-03-04T10:46:12.655403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":57584,"num_write":412,"num_write_kb":99809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'422","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:43:56.938699+0000","last_change":"2024-03-04T08:49:39.003216+0000","last_active":"2024-03-04T10:43:56.938699+0000","last_peered":"2024-03-04T10:43:56.938699+0000","last_clean":"2024-03-04T10:43:56.938699+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T10:43:56.938699+0000","last_undegraded":"2024-03-04T10:43:56.938699+0000","last_fullsized":"2024-03-04T10:43:56.938699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:16:33.639890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'399","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.648675+0000","last_change":"2024-03-04T08:49:40.161988+0000","last_active":"2024-03-04T10:46:12.648675+0000","last_peered":"2024-03-04T10:46:12.648675+0000","last_clean":"2024-03-04T10:46:12.648675+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T10:46:12.648675+0000","last_undegraded":"2024-03-04T10:46:12.648675+0000","last_fullsized":"2024-03-04T10:46:12.648675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:21.206425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":13099,"num_write":371,"num_write_kb":42170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1143","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:36.565710+0000","last_change":"2024-03-04T08:49:38.993404+0000","last_active":"2024-03-04T10:44:36.565710+0000","last_peered":"2024-03-04T10:44:36.565710+0000","last_clean":"2024-03-04T10:44:36.565710+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T10:44:36.565710+0000","last_undegraded":"2024-03-04T10:44:36.565710+0000","last_fullsized":"2024-03-04T10:44:36.565710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:32.975688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'421","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.633866+0000","last_change":"2024-03-04T08:49:40.167729+0000","last_active":"2024-03-04T10:46:12.633866+0000","last_peered":"2024-03-04T10:46:12.633866+0000","last_clean":"2024-03-04T10:46:12.633866+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T10:46:12.633866+0000","last_undegraded":"2024-03-04T10:46:12.633866+0000","last_fullsized":"2024-03-04T10:46:12.633866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:37.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8812,"num_write":384,"num_write_kb":25790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1101","reported_seq":1174,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:44:31.195686+0000","last_change":"2024-03-04T08:49:39.015101+0000","last_active":"2024-03-04T10:44:31.195686+0000","last_peered":"2024-03-04T10:44:31.195686+0000","last_clean":"2024-03-04T10:44:31.195686+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T10:44:31.195686+0000","last_undegraded":"2024-03-04T10:44:31.195686+0000","last_fullsized":"2024-03-04T10:44:31.195686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1045,"num_write_kb":12781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'434","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.654254+0000","last_change":"2024-03-04T08:49:40.163751+0000","last_active":"2024-03-04T10:46:12.654254+0000","last_peered":"2024-03-04T10:46:12.654254+0000","last_clean":"2024-03-04T10:46:12.654254+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T10:46:12.654254+0000","last_undegraded":"2024-03-04T10:46:12.654254+0000","last_fullsized":"2024-03-04T10:46:12.654254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":39178,"num_write":404,"num_write_kb":64477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'406","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.654931+0000","last_change":"2024-03-04T08:49:40.166333+0000","last_active":"2024-03-04T10:46:12.654931+0000","last_peered":"2024-03-04T10:46:12.654931+0000","last_clean":"2024-03-04T10:46:12.654931+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T10:46:12.654931+0000","last_undegraded":"2024-03-04T10:46:12.654931+0000","last_fullsized":"2024-03-04T10:46:12.654931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47257,"num_write":366,"num_write_kb":58992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'747","reported_seq":823,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:21.871140+0000","last_change":"2024-03-04T10:46:21.871200+0000","last_active":"2024-03-04T10:46:21.871140+0000","last_peered":"2024-03-04T10:46:21.871140+0000","last_clean":"2024-03-04T10:46:21.871140+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T10:46:21.871140+0000","last_undegraded":"2024-03-04T10:46:21.871140+0000","last_fullsized":"2024-03-04T10:46:21.871140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'747","last_scrub_stamp":"2024-03-04T10:46:21.871040+0000","last_deep_scrub":"25'747","last_deep_scrub_stamp":"2024-03-04T10:46:21.871040+0000","last_clean_scrub_stamp":"2024-03-04T10:46:21.871040+0000","objects_scrubbed":4,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:31.939306+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'402","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.662716+0000","last_change":"2024-03-04T08:49:40.150433+0000","last_active":"2024-03-04T10:46:12.662716+0000","last_peered":"2024-03-04T10:46:12.662716+0000","last_clean":"2024-03-04T10:46:12.662716+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T10:46:12.662716+0000","last_undegraded":"2024-03-04T10:46:12.662716+0000","last_fullsized":"2024-03-04T10:46:12.662716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":109003,"num_write":376,"num_write_kb":109132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1362","reported_seq":1438,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:20.922293+0000","last_change":"2024-03-04T10:46:20.922363+0000","last_active":"2024-03-04T10:46:20.922293+0000","last_peered":"2024-03-04T10:46:20.922293+0000","last_clean":"2024-03-04T10:46:20.922293+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T10:46:20.922293+0000","last_undegraded":"2024-03-04T10:46:20.922293+0000","last_fullsized":"2024-03-04T10:46:20.922293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1362","last_scrub_stamp":"2024-03-04T10:46:20.922214+0000","last_deep_scrub":"25'1362","last_deep_scrub_stamp":"2024-03-04T10:46:20.922214+0000","last_clean_scrub_stamp":"2024-03-04T10:46:20.922214+0000","objects_scrubbed":11,"log_size":1362,"log_dups_size":0,"ondisk_log_size":1362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:47.368537+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'371","reported_seq":472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.620325+0000","last_change":"2024-03-04T08:49:40.147020+0000","last_active":"2024-03-04T10:46:12.620325+0000","last_peered":"2024-03-04T10:46:12.620325+0000","last_clean":"2024-03-04T10:46:12.620325+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T10:46:12.620325+0000","last_undegraded":"2024-03-04T10:46:12.620325+0000","last_fullsized":"2024-03-04T10:46:12.620325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:56:05.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":85639,"num_write":344,"num_write_kb":59290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'544","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:48.343090+0000","last_change":"2024-03-04T08:49:38.995272+0000","last_active":"2024-03-04T10:45:48.343090+0000","last_peered":"2024-03-04T10:45:48.343090+0000","last_clean":"2024-03-04T10:45:48.343090+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T10:45:48.343090+0000","last_undegraded":"2024-03-04T10:45:48.343090+0000","last_fullsized":"2024-03-04T10:45:48.343090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:33.552738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'380","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:12.598959+0000","last_change":"2024-03-04T08:49:40.128143+0000","last_active":"2024-03-04T10:46:12.598959+0000","last_peered":"2024-03-04T10:46:12.598959+0000","last_clean":"2024-03-04T10:46:12.598959+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T10:46:12.598959+0000","last_undegraded":"2024-03-04T10:46:12.598959+0000","last_fullsized":"2024-03-04T10:46:12.598959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:38.765807+0000","last_clean_scrub_stamp":"2024-03-04T08:49:38.765807+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:09.874816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":32203,"num_write":336,"num_write_kb":38117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'500","reported_seq":577,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:45:59.952845+0000","last_change":"2024-03-04T08:49:39.011824+0000","last_active":"2024-03-04T10:45:59.952845+0000","last_peered":"2024-03-04T10:45:59.952845+0000","last_clean":"2024-03-04T10:45:59.952845+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T10:45:59.952845+0000","last_undegraded":"2024-03-04T10:45:59.952845+0000","last_fullsized":"2024-03-04T10:45:59.952845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:49:37.686173+0000","last_clean_scrub_stamp":"2024-03-04T08:49:37.686173+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:27.247110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1137,"num_read_kb":3491284,"num_write":24342,"num_write_kb":4342030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":215639705,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":1418,"num_read_kb":2454,"num_write":28741,"num_write_kb":225850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":431521792,"data_stored":431279410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25580,"ondisk_log_size":25580,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510849,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149424,"kb_used_data":86312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94222416,"statfs":{"total":96636764160,"available":96483753984,"internally_reserved":0,"allocated":88383488,"data_stored":88178517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510850,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82260,"kb_used_data":33036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94289580,"statfs":{"total":96636764160,"available":96552529920,"internally_reserved":0,"allocated":33828864,"data_stored":33650583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510849,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121684,"kb_used_data":50252,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250156,"statfs":{"total":96636764160,"available":96512159744,"internally_reserved":0,"allocated":51458048,"data_stored":51271590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510849,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171936,"kb_used_data":82456,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199904,"statfs":{"total":96636764160,"available":96460701696,"internally_reserved":0,"allocated":84434944,"data_stored":84236782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543553,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101764,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270076,"statfs":{"total":96636764160,"available":96532557824,"internally_reserved":0,"allocated":35319808,"data_stored":35121255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543553,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78104,"kb_used_data":33040,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293736,"statfs":{"total":96636764160,"available":96556785664,"internally_reserved":0,"allocated":33832960,"data_stored":33652223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543554,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114556,"kb_used_data":51444,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":52678656,"data_stored":52488611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543554,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124984,"kb_used_data":53552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94246856,"statfs":{"total":96636764160,"available":96508780544,"internally_reserved":0,"allocated":54837248,"data_stored":54623873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84176896,"data_stored":84141371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50606080,"data_stored":50585811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33570816,"data_stored":33555172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88125440,"data_stored":88083106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54579200,"data_stored":54528462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51826688,"data_stored":51802832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33574912,"data_stored":33556812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35061760,"data_stored":35025844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T10:46:27.425 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.425 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.425 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.425 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.425 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.425 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.426 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.427 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.428 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.429 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.430 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.431 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.432 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.433 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.434 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.434 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.434 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T08:49:38.765807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=38, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.434 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-04T08:49:37.686173+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=49, tm_sec=37, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=10, tm_min=46, tm_sec=16, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T10:46:27.434 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T10:46:41.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:46:41.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:46:42.312 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:57:53.176 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.313 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:57:53.178 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.344 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:57:53.145 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.360 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:57:53.160 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.392 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:57:53.256 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.415 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:57:53.279 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.418 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:57:53.283 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.470 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:57:53.334 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:42.487 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:57:53.287 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:46:47.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T10:46:47.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.639+0000 7f2323200640 1 Processor -- start 2024-03-04T10:46:47.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.639+0000 7f2323200640 1 -- start start 2024-03-04T10:46:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.641+0000 7f2323200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23240ca330 0x7f23240ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.641+0000 7f2323200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f23240cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.641+0000 7f2323200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240cce90 con 0x7f23240cc820 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.641+0000 7f2323200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232415a4c0 con 0x7f23240ca330 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.641+0000 7f2323200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232415a760 con 0x7f23240d00c0 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.642+0000 7f2321400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f23240cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.642+0000 7f2321e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23240ca330 0x7f23240ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.642+0000 7f2321400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f23240cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58752/0 (socket says 172.21.15.46:58752) 2024-03-04T10:46:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.642+0000 7f2321400640 1 -- 172.21.15.46:0/2116387741 learned_addr learned my addr 172.21.15.46:0/2116387741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:47.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.645+0000 7f2321400640 1 -- 172.21.15.46:0/2116387741 >> v2:172.21.15.73:3300/0 conn(0x7f23240ca330 msgr2=0x7f23240ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:47.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.645+0000 7f2321400640 1 --2- 172.21.15.46:0/2116387741 >> v2:172.21.15.73:3300/0 conn(0x7f23240ca330 0x7f23240ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:47.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.645+0000 7f2321400640 1 -- 172.21.15.46:0/2116387741 >> v1:172.21.15.46:6789/0 conn(0x7f23240cc820 legacy=0x7f232406d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:47.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.645+0000 7f2321400640 1 -- 172.21.15.46:0/2116387741 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232415aa40 con 0x7f23240d00c0 2024-03-04T10:46:47.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.649+0000 7f2321400640 1 --2- 172.21.15.46:0/2116387741 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f23240cc2e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2310009870 tx=0x7f231002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e594dc8a89e65d2a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:47.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.653+0000 7f2320a00640 1 -- 172.21.15.46:0/2116387741 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310035020 con 0x7f23240d00c0 2024-03-04T10:46:47.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.653+0000 7f2320a00640 1 -- 172.21.15.46:0/2116387741 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310031640 con 0x7f23240d00c0 2024-03-04T10:46:47.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.653+0000 7f2320a00640 1 -- 172.21.15.46:0/2116387741 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231002d040 con 0x7f23240d00c0 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 -- 172.21.15.46:0/2116387741 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 msgr2=0x7f23240cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 --2- 172.21.15.46:0/2116387741 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f23240cc2e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2310009870 tx=0x7f231002b8f0 comp rx=0 tx=0).stop 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 -- 172.21.15.46:0/2116387741 shutdown_connections 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 --2- 172.21.15.46:0/2116387741 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f23240cc2e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 --2- 172.21.15.46:0/2116387741 >> v2:172.21.15.73:3300/0 conn(0x7f23240ca330 0x7f23240ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 -- 172.21.15.46:0/2116387741 >> 172.21.15.46:0/2116387741 conn(0x7f2324067240 msgr2=0x7f23240cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 -- 172.21.15.46:0/2116387741 shutdown_connections 2024-03-04T10:46:47.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.654+0000 7f2323200640 1 -- 172.21.15.46:0/2116387741 wait complete. 2024-03-04T10:46:47.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.656+0000 7f2323200640 1 Processor -- start 2024-03-04T10:46:47.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.656+0000 7f2323200640 1 -- start start 2024-03-04T10:46:47.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.657+0000 7f2323200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23240ca330 0x7f23240afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:47.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.657+0000 7f2323200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 0x7f23241f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:47.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.657+0000 7f2323200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f232414afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:47.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.657+0000 7f2323200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324154a30 con 0x7f23240cc820 2024-03-04T10:46:47.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.657+0000 7f2323200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232415b000 con 0x7f23240ca330 2024-03-04T10:46:47.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.657+0000 7f2323200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232406d7e0 con 0x7f23240d00c0 2024-03-04T10:46:47.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.658+0000 7f2321400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 0x7f23241f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:47.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.658+0000 7f2322800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f232414afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:47.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.658+0000 7f2321e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23240ca330 0x7f23240afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:47.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.658+0000 7f2321400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 0x7f23241f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45850/0 (socket says 172.21.15.46:45850) 2024-03-04T10:46:47.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.658+0000 7f2321400640 1 -- 172.21.15.46:0/159006020 learned_addr learned my addr 172.21.15.46:0/159006020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.662+0000 7f2321400640 1 -- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 msgr2=0x7f232414afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.662+0000 7f2321400640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f232414afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.662+0000 7f2321400640 1 -- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23240ca330 msgr2=0x7f23240afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.662+0000 7f2321400640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23240ca330 0x7f23240afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.662+0000 7f2321400640 1 -- 172.21.15.46:0/159006020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23241e3af0 con 0x7f23240cc820 2024-03-04T10:46:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.664+0000 7f2321400640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 0x7f23241f3d50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2310000c00 tx=0x7f23100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.669+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310040070 con 0x7f23240cc820 2024-03-04T10:46:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.669+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100399f0 con 0x7f23240cc820 2024-03-04T10:46:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.669+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310035040 con 0x7f23240cc820 2024-03-04T10:46:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.669+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23241e3fd0 con 0x7f23240cc820 2024-03-04T10:46:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.669+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23241e4580 con 0x7f23240cc820 2024-03-04T10:46:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.670+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23241e3cc0 con 0x7f23240cc820 2024-03-04T10:46:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.696+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2310038020 con 0x7f23240cc820 2024-03-04T10:46:47.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.697+0000 7f231a000640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f230406b520 0x7f230406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:47.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.697+0000 7f2321e00640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f230406b520 0x7f230406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:47.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.698+0000 7f2321e00640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f230406b520 0x7f230406d9e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2314009b40 tx=0x7f2314009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.699+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2310078830 con 0x7f23240cc820 2024-03-04T10:46:48.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:47.997+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f231007a790 con 0x7f23240cc820 2024-03-04T10:46:48.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.219+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 --> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f232408cab0 con 0x7f230406b520 2024-03-04T10:46:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.232+0000 7f231a000640 1 -- 172.21.15.46:0/159006020 <== mgr.4103 v2:172.21.15.73:6800/3189456460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254552 (secure 0 0 0) 0x7f232408cab0 con 0x7f230406b520 2024-03-04T10:46:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.236+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f230406b520 msgr2=0x7f230406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.236+0000 7f2323200640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f230406b520 0x7f230406d9e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2314009b40 tx=0x7f2314009190 comp rx=0 tx=0).stop 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.236+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 msgr2=0x7f23241f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.236+0000 7f2323200640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 0x7f23241f3d50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2310000c00 tx=0x7f23100046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 shutdown_connections 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f230406b520 0x7f230406d9e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23240d00c0 0x7f232414afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23240cc820 0x7f23241f3d50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 --2- 172.21.15.46:0/159006020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23240ca330 0x7f23240afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 >> 172.21.15.46:0/159006020 conn(0x7f2324067240 msgr2=0x7f2324153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:48.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 shutdown_connections 2024-03-04T10:46:48.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.237+0000 7f2323200640 1 -- 172.21.15.46:0/159006020 wait complete. 2024-03-04T10:46:48.257 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":3543,"stamp":"2024-03-04T10:46:46.852783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216230073,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":2671,"num_read_kb":3493838,"num_write":53242,"num_write_kb":4570296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52190,"ondisk_log_size":52190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":948872,"kb_used_data":424584,"kb_used_omap":12,"kb_used_meta":524211,"kb_avail":754025848,"statfs":{"total":773094113280,"available":772122468352,"internally_reserved":0,"allocated":434774016,"data_stored":433223434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":536792625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002566"},"pg_stats":[{"pgid":"3.3f","version":"25'429","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:30.919230+0000","last_change":"2024-03-04T10:46:30.919352+0000","last_active":"2024-03-04T10:46:30.919230+0000","last_peered":"2024-03-04T10:46:30.919230+0000","last_clean":"2024-03-04T10:46:30.919230+0000","last_became_active":"2024-03-04T08:49:40.155310+0000","last_became_peered":"2024-03-04T08:49:40.155310+0000","last_unstale":"2024-03-04T10:46:30.919230+0000","last_undegraded":"2024-03-04T10:46:30.919230+0000","last_fullsized":"2024-03-04T10:46:30.919230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2024-03-04T10:46:30.918993+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2024-03-04T10:46:30.918993+0000","last_clean_scrub_stamp":"2024-03-04T10:46:30.918993+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:10.317457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":56779,"num_write":405,"num_write_kb":75850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'417","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:36.179184+0000","last_change":"2024-03-04T10:46:36.179224+0000","last_active":"2024-03-04T10:46:36.179184+0000","last_peered":"2024-03-04T10:46:36.179184+0000","last_clean":"2024-03-04T10:46:36.179184+0000","last_became_active":"2024-03-04T08:49:40.155942+0000","last_became_peered":"2024-03-04T08:49:40.155942+0000","last_unstale":"2024-03-04T10:46:36.179184+0000","last_undegraded":"2024-03-04T10:46:36.179184+0000","last_fullsized":"2024-03-04T10:46:36.179184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2024-03-04T10:46:36.179025+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2024-03-04T10:46:36.179025+0000","last_clean_scrub_stamp":"2024-03-04T10:46:36.179025+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:07:19.387948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68736,"num_write":382,"num_write_kb":71625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'378","reported_seq":468,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:37.131411+0000","last_change":"2024-03-04T10:46:37.131433+0000","last_active":"2024-03-04T10:46:37.131411+0000","last_peered":"2024-03-04T10:46:37.131411+0000","last_clean":"2024-03-04T10:46:37.131411+0000","last_became_active":"2024-03-04T08:49:40.159861+0000","last_became_peered":"2024-03-04T08:49:40.159861+0000","last_unstale":"2024-03-04T10:46:37.131411+0000","last_undegraded":"2024-03-04T10:46:37.131411+0000","last_fullsized":"2024-03-04T10:46:37.131411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'378","last_scrub_stamp":"2024-03-04T10:46:37.131317+0000","last_deep_scrub":"25'378","last_deep_scrub_stamp":"2024-03-04T10:46:37.131317+0000","last_clean_scrub_stamp":"2024-03-04T10:46:37.131317+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:00:58.815782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24226,"num_write":349,"num_write_kb":62283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'365","reported_seq":464,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.881536+0000","last_change":"2024-03-04T10:46:27.881576+0000","last_active":"2024-03-04T10:46:27.881536+0000","last_peered":"2024-03-04T10:46:27.881536+0000","last_clean":"2024-03-04T10:46:27.881536+0000","last_became_active":"2024-03-04T08:49:40.161398+0000","last_became_peered":"2024-03-04T08:49:40.161398+0000","last_unstale":"2024-03-04T10:46:27.881536+0000","last_undegraded":"2024-03-04T10:46:27.881536+0000","last_fullsized":"2024-03-04T10:46:27.881536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'365","last_scrub_stamp":"2024-03-04T10:46:27.881432+0000","last_deep_scrub":"25'365","last_deep_scrub_stamp":"2024-03-04T10:46:27.881432+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.881432+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:51.768192+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":47711,"num_write":338,"num_write_kb":33889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'444","reported_seq":565,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.846419+0000","last_change":"2024-03-04T10:46:26.846476+0000","last_active":"2024-03-04T10:46:26.846419+0000","last_peered":"2024-03-04T10:46:26.846419+0000","last_clean":"2024-03-04T10:46:26.846419+0000","last_became_active":"2024-03-04T08:49:40.140613+0000","last_became_peered":"2024-03-04T08:49:40.140613+0000","last_unstale":"2024-03-04T10:46:26.846419+0000","last_undegraded":"2024-03-04T10:46:26.846419+0000","last_fullsized":"2024-03-04T10:46:26.846419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-03-04T10:46:26.846211+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-03-04T10:46:26.846211+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.846211+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:46.201238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":161798,"num_write":413,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'380","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.925636+0000","last_change":"2024-03-04T10:46:28.925695+0000","last_active":"2024-03-04T10:46:28.925636+0000","last_peered":"2024-03-04T10:46:28.925636+0000","last_clean":"2024-03-04T10:46:28.925636+0000","last_became_active":"2024-03-04T08:49:40.162357+0000","last_became_peered":"2024-03-04T08:49:40.162357+0000","last_unstale":"2024-03-04T10:46:28.925636+0000","last_undegraded":"2024-03-04T10:46:28.925636+0000","last_fullsized":"2024-03-04T10:46:28.925636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'380","last_scrub_stamp":"2024-03-04T10:46:28.925438+0000","last_deep_scrub":"25'380","last_deep_scrub_stamp":"2024-03-04T10:46:28.925438+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.925438+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:31:11.216593+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":34885,"num_write":352,"num_write_kb":34327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'382","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:33.988461+0000","last_change":"2024-03-04T10:46:33.988500+0000","last_active":"2024-03-04T10:46:33.988461+0000","last_peered":"2024-03-04T10:46:33.988461+0000","last_clean":"2024-03-04T10:46:33.988461+0000","last_became_active":"2024-03-04T08:49:40.160200+0000","last_became_peered":"2024-03-04T08:49:40.160200+0000","last_unstale":"2024-03-04T10:46:33.988461+0000","last_undegraded":"2024-03-04T10:46:33.988461+0000","last_fullsized":"2024-03-04T10:46:33.988461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'382","last_scrub_stamp":"2024-03-04T10:46:33.988336+0000","last_deep_scrub":"25'382","last_deep_scrub_stamp":"2024-03-04T10:46:33.988336+0000","last_clean_scrub_stamp":"2024-03-04T10:46:33.988336+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:29.409276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":76194,"num_write":351,"num_write_kb":54499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'362","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:33.090920+0000","last_change":"2024-03-04T10:46:33.090962+0000","last_active":"2024-03-04T10:46:33.090920+0000","last_peered":"2024-03-04T10:46:33.090920+0000","last_clean":"2024-03-04T10:46:33.090920+0000","last_became_active":"2024-03-04T08:49:40.150137+0000","last_became_peered":"2024-03-04T08:49:40.150137+0000","last_unstale":"2024-03-04T10:46:33.090920+0000","last_undegraded":"2024-03-04T10:46:33.090920+0000","last_fullsized":"2024-03-04T10:46:33.090920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'362","last_scrub_stamp":"2024-03-04T10:46:33.090785+0000","last_deep_scrub":"25'362","last_deep_scrub_stamp":"2024-03-04T10:46:33.090785+0000","last_clean_scrub_stamp":"2024-03-04T10:46:33.090785+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:53:25.892449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26383,"num_write":323,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'401","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.128331+0000","last_change":"2024-03-04T10:46:26.128368+0000","last_active":"2024-03-04T10:46:26.128331+0000","last_peered":"2024-03-04T10:46:26.128331+0000","last_clean":"2024-03-04T10:46:26.128331+0000","last_became_active":"2024-03-04T08:49:40.151332+0000","last_became_peered":"2024-03-04T08:49:40.151332+0000","last_unstale":"2024-03-04T10:46:26.128331+0000","last_undegraded":"2024-03-04T10:46:26.128331+0000","last_fullsized":"2024-03-04T10:46:26.128331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'401","last_scrub_stamp":"2024-03-04T10:46:26.128231+0000","last_deep_scrub":"25'401","last_deep_scrub_stamp":"2024-03-04T10:46:26.128231+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.128231+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:21.966386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20946,"num_write":374,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'408","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:18.864469+0000","last_change":"2024-03-04T10:46:18.864513+0000","last_active":"2024-03-04T10:46:18.864469+0000","last_peered":"2024-03-04T10:46:18.864469+0000","last_clean":"2024-03-04T10:46:18.864469+0000","last_became_active":"2024-03-04T08:49:40.147344+0000","last_became_peered":"2024-03-04T08:49:40.147344+0000","last_unstale":"2024-03-04T10:46:18.864469+0000","last_undegraded":"2024-03-04T10:46:18.864469+0000","last_fullsized":"2024-03-04T10:46:18.864469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-03-04T10:46:18.864343+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-03-04T10:46:18.864343+0000","last_clean_scrub_stamp":"2024-03-04T10:46:18.864343+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:43.109471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":17641,"num_write":374,"num_write_kb":26355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'385","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:29.936128+0000","last_change":"2024-03-04T10:46:29.936167+0000","last_active":"2024-03-04T10:46:29.936128+0000","last_peered":"2024-03-04T10:46:29.936128+0000","last_clean":"2024-03-04T10:46:29.936128+0000","last_became_active":"2024-03-04T08:49:40.151037+0000","last_became_peered":"2024-03-04T08:49:40.151037+0000","last_unstale":"2024-03-04T10:46:29.936128+0000","last_undegraded":"2024-03-04T10:46:29.936128+0000","last_fullsized":"2024-03-04T10:46:29.936128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'385","last_scrub_stamp":"2024-03-04T10:46:29.936018+0000","last_deep_scrub":"25'385","last_deep_scrub_stamp":"2024-03-04T10:46:29.936018+0000","last_clean_scrub_stamp":"2024-03-04T10:46:29.936018+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:37.357231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":63408,"num_write":367,"num_write_kb":59321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'360","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.895486+0000","last_change":"2024-03-04T10:46:28.895527+0000","last_active":"2024-03-04T10:46:28.895486+0000","last_peered":"2024-03-04T10:46:28.895486+0000","last_clean":"2024-03-04T10:46:28.895486+0000","last_became_active":"2024-03-04T08:49:40.148120+0000","last_became_peered":"2024-03-04T08:49:40.148120+0000","last_unstale":"2024-03-04T10:46:28.895486+0000","last_undegraded":"2024-03-04T10:46:28.895486+0000","last_fullsized":"2024-03-04T10:46:28.895486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'360","last_scrub_stamp":"2024-03-04T10:46:28.895377+0000","last_deep_scrub":"25'360","last_deep_scrub_stamp":"2024-03-04T10:46:28.895377+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.895377+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:17.250115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":49283,"num_write":340,"num_write_kb":63175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'409","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:32.548486+0000","last_change":"2024-03-04T10:46:32.548528+0000","last_active":"2024-03-04T10:46:32.548486+0000","last_peered":"2024-03-04T10:46:32.548486+0000","last_clean":"2024-03-04T10:46:32.548486+0000","last_became_active":"2024-03-04T08:49:40.167123+0000","last_became_peered":"2024-03-04T08:49:40.167123+0000","last_unstale":"2024-03-04T10:46:32.548486+0000","last_undegraded":"2024-03-04T10:46:32.548486+0000","last_fullsized":"2024-03-04T10:46:32.548486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2024-03-04T10:46:32.548382+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2024-03-04T10:46:32.548382+0000","last_clean_scrub_stamp":"2024-03-04T10:46:32.548382+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:29.786244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":54416,"num_write":375,"num_write_kb":38585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'398","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:31.556943+0000","last_change":"2024-03-04T10:46:31.556983+0000","last_active":"2024-03-04T10:46:31.556943+0000","last_peered":"2024-03-04T10:46:31.556943+0000","last_clean":"2024-03-04T10:46:31.556943+0000","last_became_active":"2024-03-04T08:49:40.163845+0000","last_became_peered":"2024-03-04T08:49:40.163845+0000","last_unstale":"2024-03-04T10:46:31.556943+0000","last_undegraded":"2024-03-04T10:46:31.556943+0000","last_fullsized":"2024-03-04T10:46:31.556943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2024-03-04T10:46:31.556833+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2024-03-04T10:46:31.556833+0000","last_clean_scrub_stamp":"2024-03-04T10:46:31.556833+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:12:27.413923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29624,"num_write":360,"num_write_kb":30114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'407","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:40.087971+0000","last_change":"2024-03-04T10:46:40.088014+0000","last_active":"2024-03-04T10:46:40.087971+0000","last_peered":"2024-03-04T10:46:40.087971+0000","last_clean":"2024-03-04T10:46:40.087971+0000","last_became_active":"2024-03-04T08:50:12.592374+0000","last_became_peered":"2024-03-04T08:50:12.592374+0000","last_unstale":"2024-03-04T10:46:40.087971+0000","last_undegraded":"2024-03-04T10:46:40.087971+0000","last_fullsized":"2024-03-04T10:46:40.087971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'407","last_scrub_stamp":"2024-03-04T10:46:40.087842+0000","last_deep_scrub":"25'407","last_deep_scrub_stamp":"2024-03-04T10:46:40.087842+0000","last_clean_scrub_stamp":"2024-03-04T10:46:40.087842+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:32.076171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":71598,"num_write":369,"num_write_kb":67511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'422","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.110459+0000","last_change":"2024-03-04T10:46:25.110520+0000","last_active":"2024-03-04T10:46:25.110459+0000","last_peered":"2024-03-04T10:46:25.110459+0000","last_clean":"2024-03-04T10:46:25.110459+0000","last_became_active":"2024-03-04T08:49:40.153318+0000","last_became_peered":"2024-03-04T08:49:40.153318+0000","last_unstale":"2024-03-04T10:46:25.110459+0000","last_undegraded":"2024-03-04T10:46:25.110459+0000","last_fullsized":"2024-03-04T10:46:25.110459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'422","last_scrub_stamp":"2024-03-04T10:46:25.110260+0000","last_deep_scrub":"25'422","last_deep_scrub_stamp":"2024-03-04T10:46:25.110260+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.110260+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:12.972502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":49152,"num_write":389,"num_write_kb":58855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'440","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:42.081713+0000","last_change":"2024-03-04T10:46:42.081753+0000","last_active":"2024-03-04T10:46:42.081713+0000","last_peered":"2024-03-04T10:46:42.081713+0000","last_clean":"2024-03-04T10:46:42.081713+0000","last_became_active":"2024-03-04T08:49:40.171169+0000","last_became_peered":"2024-03-04T08:49:40.171169+0000","last_unstale":"2024-03-04T10:46:42.081713+0000","last_undegraded":"2024-03-04T10:46:42.081713+0000","last_fullsized":"2024-03-04T10:46:42.081713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'440","last_scrub_stamp":"2024-03-04T10:46:42.081513+0000","last_deep_scrub":"25'440","last_deep_scrub_stamp":"2024-03-04T10:46:42.081513+0000","last_clean_scrub_stamp":"2024-03-04T10:46:42.081513+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:34.513782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":66011,"num_write":406,"num_write_kb":96427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'413","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:32.203323+0000","last_change":"2024-03-04T10:46:32.203370+0000","last_active":"2024-03-04T10:46:32.203323+0000","last_peered":"2024-03-04T10:46:32.203323+0000","last_clean":"2024-03-04T10:46:32.203323+0000","last_became_active":"2024-03-04T08:49:40.171168+0000","last_became_peered":"2024-03-04T08:49:40.171168+0000","last_unstale":"2024-03-04T10:46:32.203323+0000","last_undegraded":"2024-03-04T10:46:32.203323+0000","last_fullsized":"2024-03-04T10:46:32.203323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'413","last_scrub_stamp":"2024-03-04T10:46:32.203202+0000","last_deep_scrub":"25'413","last_deep_scrub_stamp":"2024-03-04T10:46:32.203202+0000","last_clean_scrub_stamp":"2024-03-04T10:46:32.203202+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:20:22.981097+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":44968,"num_write":370,"num_write_kb":71715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'428","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:38.027672+0000","last_change":"2024-03-04T10:46:38.027711+0000","last_active":"2024-03-04T10:46:38.027672+0000","last_peered":"2024-03-04T10:46:38.027672+0000","last_clean":"2024-03-04T10:46:38.027672+0000","last_became_active":"2024-03-04T08:49:40.161689+0000","last_became_peered":"2024-03-04T08:49:40.161689+0000","last_unstale":"2024-03-04T10:46:38.027672+0000","last_undegraded":"2024-03-04T10:46:38.027672+0000","last_fullsized":"2024-03-04T10:46:38.027672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2024-03-04T10:46:38.027566+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2024-03-04T10:46:38.027566+0000","last_clean_scrub_stamp":"2024-03-04T10:46:38.027566+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:03.951868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":73465,"num_write":395,"num_write_kb":100388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'437","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.867217+0000","last_change":"2024-03-04T10:46:27.867217+0000","last_active":"2024-03-04T10:46:27.867217+0000","last_peered":"2024-03-04T10:46:27.867217+0000","last_clean":"2024-03-04T10:46:27.867217+0000","last_became_active":"2024-03-04T08:49:40.147738+0000","last_became_peered":"2024-03-04T08:49:40.147738+0000","last_unstale":"2024-03-04T10:46:27.867217+0000","last_undegraded":"2024-03-04T10:46:27.867217+0000","last_fullsized":"2024-03-04T10:46:27.867217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'437","last_scrub_stamp":"2024-03-04T10:46:27.866964+0000","last_deep_scrub":"25'437","last_deep_scrub_stamp":"2024-03-04T10:46:27.866964+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.866964+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:48.964192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":62456,"num_write":411,"num_write_kb":51118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'420","reported_seq":517,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:31.546762+0000","last_change":"2024-03-04T10:46:31.546762+0000","last_active":"2024-03-04T10:46:31.546762+0000","last_peered":"2024-03-04T10:46:31.546762+0000","last_clean":"2024-03-04T10:46:31.546762+0000","last_became_active":"2024-03-04T08:49:40.162795+0000","last_became_peered":"2024-03-04T08:49:40.162795+0000","last_unstale":"2024-03-04T10:46:31.546762+0000","last_undegraded":"2024-03-04T10:46:31.546762+0000","last_fullsized":"2024-03-04T10:46:31.546762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'420","last_scrub_stamp":"2024-03-04T10:46:31.546581+0000","last_deep_scrub":"25'420","last_deep_scrub_stamp":"2024-03-04T10:46:31.546581+0000","last_clean_scrub_stamp":"2024-03-04T10:46:31.546581+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:09.982486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":56958,"num_write":379,"num_write_kb":88435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'432","reported_seq":536,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.098281+0000","last_change":"2024-03-04T10:46:25.098281+0000","last_active":"2024-03-04T10:46:25.098281+0000","last_peered":"2024-03-04T10:46:25.098281+0000","last_clean":"2024-03-04T10:46:25.098281+0000","last_became_active":"2024-03-04T08:49:40.153297+0000","last_became_peered":"2024-03-04T08:49:40.153297+0000","last_unstale":"2024-03-04T10:46:25.098281+0000","last_undegraded":"2024-03-04T10:46:25.098281+0000","last_fullsized":"2024-03-04T10:46:25.098281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'432","last_scrub_stamp":"2024-03-04T10:46:25.098131+0000","last_deep_scrub":"25'432","last_deep_scrub_stamp":"2024-03-04T10:46:25.098131+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.098131+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:19.667669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84454,"num_write":409,"num_write_kb":67704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'392","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:30.080967+0000","last_change":"2024-03-04T10:46:30.080967+0000","last_active":"2024-03-04T10:46:30.080967+0000","last_peered":"2024-03-04T10:46:30.080967+0000","last_clean":"2024-03-04T10:46:30.080967+0000","last_became_active":"2024-03-04T08:49:40.127825+0000","last_became_peered":"2024-03-04T08:49:40.127825+0000","last_unstale":"2024-03-04T10:46:30.080967+0000","last_undegraded":"2024-03-04T10:46:30.080967+0000","last_fullsized":"2024-03-04T10:46:30.080967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2024-03-04T10:46:30.080868+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2024-03-04T10:46:30.080868+0000","last_clean_scrub_stamp":"2024-03-04T10:46:30.080868+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:03:05.972771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15942,"num_write":359,"num_write_kb":55013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'444","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.162421+0000","last_change":"2024-03-04T10:46:22.162491+0000","last_active":"2024-03-04T10:46:22.162421+0000","last_peered":"2024-03-04T10:46:22.162421+0000","last_clean":"2024-03-04T10:46:22.162421+0000","last_became_active":"2024-03-04T08:49:40.150779+0000","last_became_peered":"2024-03-04T08:49:40.150779+0000","last_unstale":"2024-03-04T10:46:22.162421+0000","last_undegraded":"2024-03-04T10:46:22.162421+0000","last_fullsized":"2024-03-04T10:46:22.162421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-03-04T10:46:22.162314+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-03-04T10:46:22.162314+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.162314+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:40.994846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47415,"num_write":405,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'419","reported_seq":518,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:35.144025+0000","last_change":"2024-03-04T10:46:35.144025+0000","last_active":"2024-03-04T10:46:35.144025+0000","last_peered":"2024-03-04T10:46:35.144025+0000","last_clean":"2024-03-04T10:46:35.144025+0000","last_became_active":"2024-03-04T08:49:40.155501+0000","last_became_peered":"2024-03-04T08:49:40.155501+0000","last_unstale":"2024-03-04T10:46:35.144025+0000","last_undegraded":"2024-03-04T10:46:35.144025+0000","last_fullsized":"2024-03-04T10:46:35.144025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'419","last_scrub_stamp":"2024-03-04T10:46:35.143851+0000","last_deep_scrub":"25'419","last_deep_scrub_stamp":"2024-03-04T10:46:35.143851+0000","last_clean_scrub_stamp":"2024-03-04T10:46:35.143851+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:16.379880+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49227,"num_write":397,"num_write_kb":80014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'505","reported_seq":613,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.897449+0000","last_change":"2024-03-04T10:46:23.897449+0000","last_active":"2024-03-04T10:46:23.897449+0000","last_peered":"2024-03-04T10:46:23.897449+0000","last_clean":"2024-03-04T10:46:23.897449+0000","last_became_active":"2024-03-04T08:49:40.146459+0000","last_became_peered":"2024-03-04T08:49:40.146459+0000","last_unstale":"2024-03-04T10:46:23.897449+0000","last_undegraded":"2024-03-04T10:46:23.897449+0000","last_fullsized":"2024-03-04T10:46:23.897449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'505","last_scrub_stamp":"2024-03-04T10:46:23.897279+0000","last_deep_scrub":"25'505","last_deep_scrub_stamp":"2024-03-04T10:46:23.897279+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.897279+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:03.991590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":78376,"num_write":475,"num_write_kb":113705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'427","reported_seq":536,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:30.587727+0000","last_change":"2024-03-04T10:46:30.587727+0000","last_active":"2024-03-04T10:46:30.587727+0000","last_peered":"2024-03-04T10:46:30.587727+0000","last_clean":"2024-03-04T10:46:30.587727+0000","last_became_active":"2024-03-04T08:49:40.163781+0000","last_became_peered":"2024-03-04T08:49:40.163781+0000","last_unstale":"2024-03-04T10:46:30.587727+0000","last_undegraded":"2024-03-04T10:46:30.587727+0000","last_fullsized":"2024-03-04T10:46:30.587727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2024-03-04T10:46:30.587550+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2024-03-04T10:46:30.587550+0000","last_clean_scrub_stamp":"2024-03-04T10:46:30.587550+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:49.166857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75663,"num_write":396,"num_write_kb":55800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'371","reported_seq":465,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:33.499581+0000","last_change":"2024-03-04T10:46:33.499581+0000","last_active":"2024-03-04T10:46:33.499581+0000","last_peered":"2024-03-04T10:46:33.499581+0000","last_clean":"2024-03-04T10:46:33.499581+0000","last_became_active":"2024-03-04T08:49:40.167106+0000","last_became_peered":"2024-03-04T08:49:40.167106+0000","last_unstale":"2024-03-04T10:46:33.499581+0000","last_undegraded":"2024-03-04T10:46:33.499581+0000","last_fullsized":"2024-03-04T10:46:33.499581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'371","last_scrub_stamp":"2024-03-04T10:46:33.499390+0000","last_deep_scrub":"25'371","last_deep_scrub_stamp":"2024-03-04T10:46:33.499390+0000","last_clean_scrub_stamp":"2024-03-04T10:46:33.499390+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:11.974952+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":29309,"num_write":341,"num_write_kb":42443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'381","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:38.135451+0000","last_change":"2024-03-04T10:46:38.135471+0000","last_active":"2024-03-04T10:46:38.135451+0000","last_peered":"2024-03-04T10:46:38.135451+0000","last_clean":"2024-03-04T10:46:38.135451+0000","last_became_active":"2024-03-04T08:49:40.161191+0000","last_became_peered":"2024-03-04T08:49:40.161191+0000","last_unstale":"2024-03-04T10:46:38.135451+0000","last_undegraded":"2024-03-04T10:46:38.135451+0000","last_fullsized":"2024-03-04T10:46:38.135451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'381","last_scrub_stamp":"2024-03-04T10:46:38.135372+0000","last_deep_scrub":"25'381","last_deep_scrub_stamp":"2024-03-04T10:46:38.135372+0000","last_clean_scrub_stamp":"2024-03-04T10:46:38.135372+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:15:20.802975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44796,"num_write":353,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'484","reported_seq":600,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:24.127589+0000","last_change":"2024-03-04T10:46:24.127631+0000","last_active":"2024-03-04T10:46:24.127589+0000","last_peered":"2024-03-04T10:46:24.127589+0000","last_clean":"2024-03-04T10:46:24.127589+0000","last_became_active":"2024-03-04T08:49:40.149303+0000","last_became_peered":"2024-03-04T08:49:40.149303+0000","last_unstale":"2024-03-04T10:46:24.127589+0000","last_undegraded":"2024-03-04T10:46:24.127589+0000","last_fullsized":"2024-03-04T10:46:24.127589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'484","last_scrub_stamp":"2024-03-04T10:46:24.127485+0000","last_deep_scrub":"25'484","last_deep_scrub_stamp":"2024-03-04T10:46:24.127485+0000","last_clean_scrub_stamp":"2024-03-04T10:46:24.127485+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:26.556585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":91221,"num_write":448,"num_write_kb":101088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'466","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:30.214736+0000","last_change":"2024-03-04T10:46:30.214757+0000","last_active":"2024-03-04T10:46:30.214736+0000","last_peered":"2024-03-04T10:46:30.214736+0000","last_clean":"2024-03-04T10:46:30.214736+0000","last_became_active":"2024-03-04T08:49:40.166200+0000","last_became_peered":"2024-03-04T08:49:40.166200+0000","last_unstale":"2024-03-04T10:46:30.214736+0000","last_undegraded":"2024-03-04T10:46:30.214736+0000","last_fullsized":"2024-03-04T10:46:30.214736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'466","last_scrub_stamp":"2024-03-04T10:46:30.214669+0000","last_deep_scrub":"25'466","last_deep_scrub_stamp":"2024-03-04T10:46:30.214669+0000","last_clean_scrub_stamp":"2024-03-04T10:46:30.214669+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:26:27.720805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":144837,"num_write":435,"num_write_kb":130358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'449","reported_seq":547,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.937065+0000","last_change":"2024-03-04T10:46:25.937104+0000","last_active":"2024-03-04T10:46:25.937065+0000","last_peered":"2024-03-04T10:46:25.937065+0000","last_clean":"2024-03-04T10:46:25.937065+0000","last_became_active":"2024-03-04T08:49:40.155787+0000","last_became_peered":"2024-03-04T08:49:40.155787+0000","last_unstale":"2024-03-04T10:46:25.937065+0000","last_undegraded":"2024-03-04T10:46:25.937065+0000","last_fullsized":"2024-03-04T10:46:25.937065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2024-03-04T10:46:25.936938+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2024-03-04T10:46:25.936938+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.936938+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:21.775093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23611,"num_write":420,"num_write_kb":59471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.041874+0000","last_change":"2024-03-04T10:46:22.041926+0000","last_active":"2024-03-04T10:46:22.041874+0000","last_peered":"2024-03-04T10:46:22.041874+0000","last_clean":"2024-03-04T10:46:22.041874+0000","last_became_active":"2024-03-04T08:49:40.138826+0000","last_became_peered":"2024-03-04T08:49:40.138826+0000","last_unstale":"2024-03-04T10:46:22.041874+0000","last_undegraded":"2024-03-04T10:46:22.041874+0000","last_fullsized":"2024-03-04T10:46:22.041874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-03-04T10:46:22.041753+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-03-04T10:46:22.041753+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.041753+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:48.268816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":42800,"num_write":385,"num_write_kb":71334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'241","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.067241+0000","last_change":"2024-03-04T10:46:25.067293+0000","last_active":"2024-03-04T10:46:25.067241+0000","last_peered":"2024-03-04T10:46:25.067241+0000","last_clean":"2024-03-04T10:46:25.067241+0000","last_became_active":"2024-03-04T08:49:38.994717+0000","last_became_peered":"2024-03-04T08:49:38.994717+0000","last_unstale":"2024-03-04T10:46:25.067241+0000","last_undegraded":"2024-03-04T10:46:25.067241+0000","last_fullsized":"2024-03-04T10:46:25.067241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'241","last_scrub_stamp":"2024-03-04T10:46:25.067125+0000","last_deep_scrub":"25'241","last_deep_scrub_stamp":"2024-03-04T10:46:25.067125+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.067125+0000","objects_scrubbed":3,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:03.503031+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'368","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:34.542136+0000","last_change":"2024-03-04T10:46:34.542177+0000","last_active":"2024-03-04T10:46:34.542136+0000","last_peered":"2024-03-04T10:46:34.542136+0000","last_clean":"2024-03-04T10:46:34.542136+0000","last_became_active":"2024-03-04T08:49:40.166486+0000","last_became_peered":"2024-03-04T08:49:40.166486+0000","last_unstale":"2024-03-04T10:46:34.542136+0000","last_undegraded":"2024-03-04T10:46:34.542136+0000","last_fullsized":"2024-03-04T10:46:34.542136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'368","last_scrub_stamp":"2024-03-04T10:46:34.542032+0000","last_deep_scrub":"25'368","last_deep_scrub_stamp":"2024-03-04T10:46:34.542032+0000","last_clean_scrub_stamp":"2024-03-04T10:46:34.542032+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:11.999336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32809,"num_write":342,"num_write_kb":54741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1411","reported_seq":1487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:29.084778+0000","last_change":"2024-03-04T10:46:29.084827+0000","last_active":"2024-03-04T10:46:29.084778+0000","last_peered":"2024-03-04T10:46:29.084778+0000","last_clean":"2024-03-04T10:46:29.084778+0000","last_became_active":"2024-03-04T08:49:39.011850+0000","last_became_peered":"2024-03-04T08:49:39.011850+0000","last_unstale":"2024-03-04T10:46:29.084778+0000","last_undegraded":"2024-03-04T10:46:29.084778+0000","last_fullsized":"2024-03-04T10:46:29.084778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1411","last_scrub_stamp":"2024-03-04T10:46:29.084683+0000","last_deep_scrub":"25'1411","last_deep_scrub_stamp":"2024-03-04T10:46:29.084683+0000","last_clean_scrub_stamp":"2024-03-04T10:46:29.084683+0000","objects_scrubbed":7,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:59:00.455556+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":17039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'797","reported_seq":875,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.642717+0000","last_change":"2024-03-04T10:46:26.642743+0000","last_active":"2024-03-04T10:46:26.642717+0000","last_peered":"2024-03-04T10:46:26.642717+0000","last_clean":"2024-03-04T10:46:26.642717+0000","last_became_active":"2024-03-04T08:49:38.998622+0000","last_became_peered":"2024-03-04T08:49:38.998622+0000","last_unstale":"2024-03-04T10:46:26.642717+0000","last_undegraded":"2024-03-04T10:46:26.642717+0000","last_fullsized":"2024-03-04T10:46:26.642717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'797","last_scrub_stamp":"2024-03-04T10:46:26.642646+0000","last_deep_scrub":"25'797","last_deep_scrub_stamp":"2024-03-04T10:46:26.642646+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.642646+0000","objects_scrubbed":3,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:07.092166+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'441","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:34.113404+0000","last_change":"2024-03-04T10:46:34.113445+0000","last_active":"2024-03-04T10:46:34.113404+0000","last_peered":"2024-03-04T10:46:34.113404+0000","last_clean":"2024-03-04T10:46:34.113404+0000","last_became_active":"2024-03-04T08:49:40.155244+0000","last_became_peered":"2024-03-04T08:49:40.155244+0000","last_unstale":"2024-03-04T10:46:34.113404+0000","last_undegraded":"2024-03-04T10:46:34.113404+0000","last_fullsized":"2024-03-04T10:46:34.113404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'441","last_scrub_stamp":"2024-03-04T10:46:34.113283+0000","last_deep_scrub":"25'441","last_deep_scrub_stamp":"2024-03-04T10:46:34.113283+0000","last_clean_scrub_stamp":"2024-03-04T10:46:34.113283+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:50:56.769984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":27702,"num_write":417,"num_write_kb":42496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1112","reported_seq":1190,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:32.079593+0000","last_change":"2024-03-04T10:46:32.079640+0000","last_active":"2024-03-04T10:46:32.079593+0000","last_peered":"2024-03-04T10:46:32.079593+0000","last_clean":"2024-03-04T10:46:32.079593+0000","last_became_active":"2024-03-04T08:49:39.013055+0000","last_became_peered":"2024-03-04T08:49:39.013055+0000","last_unstale":"2024-03-04T10:46:32.079593+0000","last_undegraded":"2024-03-04T10:46:32.079593+0000","last_fullsized":"2024-03-04T10:46:32.079593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1112","last_scrub_stamp":"2024-03-04T10:46:32.079514+0000","last_deep_scrub":"25'1112","last_deep_scrub_stamp":"2024-03-04T10:46:32.079514+0000","last_clean_scrub_stamp":"2024-03-04T10:46:32.079514+0000","objects_scrubbed":4,"log_size":1112,"log_dups_size":0,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:07.866657+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":12803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'408","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.536901+0000","last_change":"2024-03-04T10:46:28.536922+0000","last_active":"2024-03-04T10:46:28.536901+0000","last_peered":"2024-03-04T10:46:28.536901+0000","last_clean":"2024-03-04T10:46:28.536901+0000","last_became_active":"2024-03-04T08:49:40.158964+0000","last_became_peered":"2024-03-04T08:49:40.158964+0000","last_unstale":"2024-03-04T10:46:28.536901+0000","last_undegraded":"2024-03-04T10:46:28.536901+0000","last_fullsized":"2024-03-04T10:46:28.536901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-03-04T10:46:28.536829+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-03-04T10:46:28.536829+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.536829+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:25:30.509723+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":31518,"num_write":380,"num_write_kb":54868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'70","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:21.047756+0000","last_change":"2024-03-04T10:46:21.047781+0000","last_active":"2024-03-04T10:46:21.047756+0000","last_peered":"2024-03-04T10:46:21.047756+0000","last_clean":"2024-03-04T10:46:21.047756+0000","last_became_active":"2024-03-04T08:49:39.006563+0000","last_became_peered":"2024-03-04T08:49:39.006563+0000","last_unstale":"2024-03-04T10:46:21.047756+0000","last_undegraded":"2024-03-04T10:46:21.047756+0000","last_fullsized":"2024-03-04T10:46:21.047756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-03-04T10:46:21.047692+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-03-04T10:46:21.047692+0000","last_clean_scrub_stamp":"2024-03-04T10:46:21.047692+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:57.931004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'455","reported_seq":555,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.891556+0000","last_change":"2024-03-04T10:46:22.891598+0000","last_active":"2024-03-04T10:46:22.891556+0000","last_peered":"2024-03-04T10:46:22.891556+0000","last_clean":"2024-03-04T10:46:22.891556+0000","last_became_active":"2024-03-04T08:49:40.146127+0000","last_became_peered":"2024-03-04T08:49:40.146127+0000","last_unstale":"2024-03-04T10:46:22.891556+0000","last_undegraded":"2024-03-04T10:46:22.891556+0000","last_fullsized":"2024-03-04T10:46:22.891556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'455","last_scrub_stamp":"2024-03-04T10:46:22.891454+0000","last_deep_scrub":"25'455","last_deep_scrub_stamp":"2024-03-04T10:46:22.891454+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.891454+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:26:42.196610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":68599,"num_write":425,"num_write_kb":83547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1160","reported_seq":1238,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:24.904252+0000","last_change":"2024-03-04T10:46:24.904310+0000","last_active":"2024-03-04T10:46:24.904252+0000","last_peered":"2024-03-04T10:46:24.904252+0000","last_clean":"2024-03-04T10:46:24.904252+0000","last_became_active":"2024-03-04T08:49:39.011705+0000","last_became_peered":"2024-03-04T08:49:39.011705+0000","last_unstale":"2024-03-04T10:46:24.904252+0000","last_undegraded":"2024-03-04T10:46:24.904252+0000","last_fullsized":"2024-03-04T10:46:24.904252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1160","last_scrub_stamp":"2024-03-04T10:46:24.904148+0000","last_deep_scrub":"25'1160","last_deep_scrub_stamp":"2024-03-04T10:46:24.904148+0000","last_clean_scrub_stamp":"2024-03-04T10:46:24.904148+0000","objects_scrubbed":6,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:54:27.068944+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12835661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":13085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'401","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:32.109484+0000","last_change":"2024-03-04T10:46:32.109504+0000","last_active":"2024-03-04T10:46:32.109484+0000","last_peered":"2024-03-04T10:46:32.109484+0000","last_clean":"2024-03-04T10:46:32.109484+0000","last_became_active":"2024-03-04T08:49:40.147888+0000","last_became_peered":"2024-03-04T08:49:40.147888+0000","last_unstale":"2024-03-04T10:46:32.109484+0000","last_undegraded":"2024-03-04T10:46:32.109484+0000","last_fullsized":"2024-03-04T10:46:32.109484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'401","last_scrub_stamp":"2024-03-04T10:46:32.109413+0000","last_deep_scrub":"25'401","last_deep_scrub_stamp":"2024-03-04T10:46:32.109413+0000","last_clean_scrub_stamp":"2024-03-04T10:46:32.109413+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:02.109876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":69489,"num_write":372,"num_write_kb":99199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1623","reported_seq":1701,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.203599+0000","last_change":"2024-03-04T10:46:27.203657+0000","last_active":"2024-03-04T10:46:27.203599+0000","last_peered":"2024-03-04T10:46:27.203599+0000","last_clean":"2024-03-04T10:46:27.203599+0000","last_became_active":"2024-03-04T08:49:38.991089+0000","last_became_peered":"2024-03-04T08:49:38.991089+0000","last_unstale":"2024-03-04T10:46:27.203599+0000","last_undegraded":"2024-03-04T10:46:27.203599+0000","last_fullsized":"2024-03-04T10:46:27.203599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1623","last_scrub_stamp":"2024-03-04T10:46:27.203507+0000","last_deep_scrub":"25'1623","last_deep_scrub_stamp":"2024-03-04T10:46:27.203507+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.203507+0000","objects_scrubbed":6,"log_size":1623,"log_dups_size":0,"ondisk_log_size":1623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:59:02.271450+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1561,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'404","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.169294+0000","last_change":"2024-03-04T10:46:23.169294+0000","last_active":"2024-03-04T10:46:23.169294+0000","last_peered":"2024-03-04T10:46:23.169294+0000","last_clean":"2024-03-04T10:46:23.169294+0000","last_became_active":"2024-03-04T08:49:40.152809+0000","last_became_peered":"2024-03-04T08:49:40.152809+0000","last_unstale":"2024-03-04T10:46:23.169294+0000","last_undegraded":"2024-03-04T10:46:23.169294+0000","last_fullsized":"2024-03-04T10:46:23.169294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'404","last_scrub_stamp":"2024-03-04T10:46:23.169152+0000","last_deep_scrub":"25'404","last_deep_scrub_stamp":"2024-03-04T10:46:23.169152+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.169152+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:40.041015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":58935,"num_write":368,"num_write_kb":66938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1677","reported_seq":1757,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:21.967510+0000","last_change":"2024-03-04T10:46:21.967510+0000","last_active":"2024-03-04T10:46:21.967510+0000","last_peered":"2024-03-04T10:46:21.967510+0000","last_clean":"2024-03-04T10:46:21.967510+0000","last_became_active":"2024-03-04T08:49:38.999852+0000","last_became_peered":"2024-03-04T08:49:38.999852+0000","last_unstale":"2024-03-04T10:46:21.967510+0000","last_undegraded":"2024-03-04T10:46:21.967510+0000","last_fullsized":"2024-03-04T10:46:21.967510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1677","last_scrub_stamp":"2024-03-04T10:46:21.967326+0000","last_deep_scrub":"25'1677","last_deep_scrub_stamp":"2024-03-04T10:46:21.967326+0000","last_clean_scrub_stamp":"2024-03-04T10:46:21.967326+0000","objects_scrubbed":8,"log_size":1677,"log_dups_size":0,"ondisk_log_size":1677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:11.705842+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'390","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:32.996857+0000","last_change":"2024-03-04T10:46:32.996905+0000","last_active":"2024-03-04T10:46:32.996857+0000","last_peered":"2024-03-04T10:46:32.996857+0000","last_clean":"2024-03-04T10:46:32.996857+0000","last_became_active":"2024-03-04T08:49:40.157993+0000","last_became_peered":"2024-03-04T08:49:40.157993+0000","last_unstale":"2024-03-04T10:46:32.996857+0000","last_undegraded":"2024-03-04T10:46:32.996857+0000","last_fullsized":"2024-03-04T10:46:32.996857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'390","last_scrub_stamp":"2024-03-04T10:46:32.996739+0000","last_deep_scrub":"25'390","last_deep_scrub_stamp":"2024-03-04T10:46:32.996739+0000","last_clean_scrub_stamp":"2024-03-04T10:46:32.996739+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:08.783881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":52325,"num_write":353,"num_write_kb":55067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'333","reported_seq":413,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:29.241231+0000","last_change":"2024-03-04T10:46:29.241265+0000","last_active":"2024-03-04T10:46:29.241231+0000","last_peered":"2024-03-04T10:46:29.241231+0000","last_clean":"2024-03-04T10:46:29.241231+0000","last_became_active":"2024-03-04T08:49:39.004043+0000","last_became_peered":"2024-03-04T08:49:39.004043+0000","last_unstale":"2024-03-04T10:46:29.241231+0000","last_undegraded":"2024-03-04T10:46:29.241231+0000","last_fullsized":"2024-03-04T10:46:29.241231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'333","last_scrub_stamp":"2024-03-04T10:46:29.241165+0000","last_deep_scrub":"25'333","last_deep_scrub_stamp":"2024-03-04T10:46:29.241165+0000","last_clean_scrub_stamp":"2024-03-04T10:46:29.241165+0000","objects_scrubbed":8,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:08.759135+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":8340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'416","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:34.535162+0000","last_change":"2024-03-04T10:46:34.535202+0000","last_active":"2024-03-04T10:46:34.535162+0000","last_peered":"2024-03-04T10:46:34.535162+0000","last_clean":"2024-03-04T10:46:34.535162+0000","last_became_active":"2024-03-04T08:49:40.169549+0000","last_became_peered":"2024-03-04T08:49:40.169549+0000","last_unstale":"2024-03-04T10:46:34.535162+0000","last_undegraded":"2024-03-04T10:46:34.535162+0000","last_fullsized":"2024-03-04T10:46:34.535162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'416","last_scrub_stamp":"2024-03-04T10:46:34.535074+0000","last_deep_scrub":"25'416","last_deep_scrub_stamp":"2024-03-04T10:46:34.535074+0000","last_clean_scrub_stamp":"2024-03-04T10:46:34.535074+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:41:48.713881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":41706,"num_write":387,"num_write_kb":84154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'67","reported_seq":147,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:31.041712+0000","last_change":"2024-03-04T10:46:31.041757+0000","last_active":"2024-03-04T10:46:31.041712+0000","last_peered":"2024-03-04T10:46:31.041712+0000","last_clean":"2024-03-04T10:46:31.041712+0000","last_became_active":"2024-03-04T08:49:39.012259+0000","last_became_peered":"2024-03-04T08:49:39.012259+0000","last_unstale":"2024-03-04T10:46:31.041712+0000","last_undegraded":"2024-03-04T10:46:31.041712+0000","last_fullsized":"2024-03-04T10:46:31.041712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'67","last_scrub_stamp":"2024-03-04T10:46:31.041597+0000","last_deep_scrub":"25'67","last_deep_scrub_stamp":"2024-03-04T10:46:31.041597+0000","last_clean_scrub_stamp":"2024-03-04T10:46:31.041597+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:52.608398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'410","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:41.075990+0000","last_change":"2024-03-04T10:46:41.076030+0000","last_active":"2024-03-04T10:46:41.075990+0000","last_peered":"2024-03-04T10:46:41.075990+0000","last_clean":"2024-03-04T10:46:41.075990+0000","last_became_active":"2024-03-04T08:49:40.167127+0000","last_became_peered":"2024-03-04T08:49:40.167127+0000","last_unstale":"2024-03-04T10:46:41.075990+0000","last_undegraded":"2024-03-04T10:46:41.075990+0000","last_fullsized":"2024-03-04T10:46:41.075990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2024-03-04T10:46:41.075859+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2024-03-04T10:46:41.075859+0000","last_clean_scrub_stamp":"2024-03-04T10:46:41.075859+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:51.259493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71159,"num_write":383,"num_write_kb":34363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'70","reported_seq":150,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.807297+0000","last_change":"2024-03-04T10:46:23.807323+0000","last_active":"2024-03-04T10:46:23.807297+0000","last_peered":"2024-03-04T10:46:23.807297+0000","last_clean":"2024-03-04T10:46:23.807297+0000","last_became_active":"2024-03-04T08:49:39.010526+0000","last_became_peered":"2024-03-04T08:49:39.010526+0000","last_unstale":"2024-03-04T10:46:23.807297+0000","last_undegraded":"2024-03-04T10:46:23.807297+0000","last_fullsized":"2024-03-04T10:46:23.807297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-03-04T10:46:23.807223+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-03-04T10:46:23.807223+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.807223+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:14.364881+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'444","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.050820+0000","last_change":"2024-03-04T10:46:23.050820+0000","last_active":"2024-03-04T10:46:23.050820+0000","last_peered":"2024-03-04T10:46:23.050820+0000","last_clean":"2024-03-04T10:46:23.050820+0000","last_became_active":"2024-03-04T08:49:40.146600+0000","last_became_peered":"2024-03-04T08:49:40.146600+0000","last_unstale":"2024-03-04T10:46:23.050820+0000","last_undegraded":"2024-03-04T10:46:23.050820+0000","last_fullsized":"2024-03-04T10:46:23.050820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-03-04T10:46:23.050650+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-03-04T10:46:23.050650+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.050650+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:08.069198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":111394,"num_write":416,"num_write_kb":109040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'834","reported_seq":914,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:23.580725+0000","last_change":"2024-03-04T10:46:23.580765+0000","last_active":"2024-03-04T10:46:23.580725+0000","last_peered":"2024-03-04T10:46:23.580725+0000","last_clean":"2024-03-04T10:46:23.580725+0000","last_became_active":"2024-03-04T08:49:38.989733+0000","last_became_peered":"2024-03-04T08:49:38.989733+0000","last_unstale":"2024-03-04T10:46:23.580725+0000","last_undegraded":"2024-03-04T10:46:23.580725+0000","last_fullsized":"2024-03-04T10:46:23.580725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'834","last_scrub_stamp":"2024-03-04T10:46:23.580654+0000","last_deep_scrub":"25'834","last_deep_scrub_stamp":"2024-03-04T10:46:23.580654+0000","last_clean_scrub_stamp":"2024-03-04T10:46:23.580654+0000","objects_scrubbed":10,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:14:48.090420+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":8544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'477","reported_seq":578,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:35.049576+0000","last_change":"2024-03-04T10:46:35.049616+0000","last_active":"2024-03-04T10:46:35.049576+0000","last_peered":"2024-03-04T10:46:35.049576+0000","last_clean":"2024-03-04T10:46:35.049576+0000","last_became_active":"2024-03-04T08:49:40.157637+0000","last_became_peered":"2024-03-04T08:49:40.157637+0000","last_unstale":"2024-03-04T10:46:35.049576+0000","last_undegraded":"2024-03-04T10:46:35.049576+0000","last_fullsized":"2024-03-04T10:46:35.049576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'477","last_scrub_stamp":"2024-03-04T10:46:35.049464+0000","last_deep_scrub":"25'477","last_deep_scrub_stamp":"2024-03-04T10:46:35.049464+0000","last_clean_scrub_stamp":"2024-03-04T10:46:35.049464+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:38.935329+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":59537,"num_write":439,"num_write_kb":76319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'755","reported_seq":836,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:22.852960+0000","last_change":"2024-03-04T10:46:22.853006+0000","last_active":"2024-03-04T10:46:22.852960+0000","last_peered":"2024-03-04T10:46:22.852960+0000","last_clean":"2024-03-04T10:46:22.852960+0000","last_became_active":"2024-03-04T08:49:39.007290+0000","last_became_peered":"2024-03-04T08:49:39.007290+0000","last_unstale":"2024-03-04T10:46:22.852960+0000","last_undegraded":"2024-03-04T10:46:22.852960+0000","last_fullsized":"2024-03-04T10:46:22.852960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'755","last_scrub_stamp":"2024-03-04T10:46:22.852876+0000","last_deep_scrub":"25'755","last_deep_scrub_stamp":"2024-03-04T10:46:22.852876+0000","last_clean_scrub_stamp":"2024-03-04T10:46:22.852876+0000","objects_scrubbed":3,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:41.685408+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'373","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:24.911638+0000","last_change":"2024-03-04T10:46:24.911638+0000","last_active":"2024-03-04T10:46:24.911638+0000","last_peered":"2024-03-04T10:46:24.911638+0000","last_clean":"2024-03-04T10:46:24.911638+0000","last_became_active":"2024-03-04T08:49:40.151239+0000","last_became_peered":"2024-03-04T08:49:40.151239+0000","last_unstale":"2024-03-04T10:46:24.911638+0000","last_undegraded":"2024-03-04T10:46:24.911638+0000","last_fullsized":"2024-03-04T10:46:24.911638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'373","last_scrub_stamp":"2024-03-04T10:46:24.911482+0000","last_deep_scrub":"25'373","last_deep_scrub_stamp":"2024-03-04T10:46:24.911482+0000","last_clean_scrub_stamp":"2024-03-04T10:46:24.911482+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:25.924344+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":68174,"num_write":341,"num_write_kb":71100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'824","reported_seq":906,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:24.564771+0000","last_change":"2024-03-04T10:46:24.564771+0000","last_active":"2024-03-04T10:46:24.564771+0000","last_peered":"2024-03-04T10:46:24.564771+0000","last_clean":"2024-03-04T10:46:24.564771+0000","last_became_active":"2024-03-04T08:49:38.995436+0000","last_became_peered":"2024-03-04T08:49:38.995436+0000","last_unstale":"2024-03-04T10:46:24.564771+0000","last_undegraded":"2024-03-04T10:46:24.564771+0000","last_fullsized":"2024-03-04T10:46:24.564771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'824","last_scrub_stamp":"2024-03-04T10:46:24.564612+0000","last_deep_scrub":"25'824","last_deep_scrub_stamp":"2024-03-04T10:46:24.564612+0000","last_clean_scrub_stamp":"2024-03-04T10:46:24.564612+0000","objects_scrubbed":3,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:43:21.188404+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'386","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:31.949762+0000","last_change":"2024-03-04T10:46:31.949800+0000","last_active":"2024-03-04T10:46:31.949762+0000","last_peered":"2024-03-04T10:46:31.949762+0000","last_clean":"2024-03-04T10:46:31.949762+0000","last_became_active":"2024-03-04T08:49:40.157349+0000","last_became_peered":"2024-03-04T08:49:40.157349+0000","last_unstale":"2024-03-04T10:46:31.949762+0000","last_undegraded":"2024-03-04T10:46:31.949762+0000","last_fullsized":"2024-03-04T10:46:31.949762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'386","last_scrub_stamp":"2024-03-04T10:46:31.949652+0000","last_deep_scrub":"25'386","last_deep_scrub_stamp":"2024-03-04T10:46:31.949652+0000","last_clean_scrub_stamp":"2024-03-04T10:46:31.949652+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:53.516454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":53055,"num_write":347,"num_write_kb":59070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'208","reported_seq":290,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.071236+0000","last_change":"2024-03-04T10:46:28.071236+0000","last_active":"2024-03-04T10:46:28.071236+0000","last_peered":"2024-03-04T10:46:28.071236+0000","last_clean":"2024-03-04T10:46:28.071236+0000","last_became_active":"2024-03-04T08:49:39.008538+0000","last_became_peered":"2024-03-04T08:49:39.008538+0000","last_unstale":"2024-03-04T10:46:28.071236+0000","last_undegraded":"2024-03-04T10:46:28.071236+0000","last_fullsized":"2024-03-04T10:46:28.071236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'208","last_scrub_stamp":"2024-03-04T10:46:28.071109+0000","last_deep_scrub":"25'208","last_deep_scrub_stamp":"2024-03-04T10:46:28.071109+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.071109+0000","objects_scrubbed":2,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:16.467081+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'441","reported_seq":532,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:34.964113+0000","last_change":"2024-03-04T10:46:34.964113+0000","last_active":"2024-03-04T10:46:34.964113+0000","last_peered":"2024-03-04T10:46:34.964113+0000","last_clean":"2024-03-04T10:46:34.964113+0000","last_became_active":"2024-03-04T08:49:40.170380+0000","last_became_peered":"2024-03-04T08:49:40.170380+0000","last_unstale":"2024-03-04T10:46:34.964113+0000","last_undegraded":"2024-03-04T10:46:34.964113+0000","last_fullsized":"2024-03-04T10:46:34.964113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'441","last_scrub_stamp":"2024-03-04T10:46:34.963969+0000","last_deep_scrub":"25'441","last_deep_scrub_stamp":"2024-03-04T10:46:34.963969+0000","last_clean_scrub_stamp":"2024-03-04T10:46:34.963969+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:17:45.037692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21944,"num_write":403,"num_write_kb":30840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'311","reported_seq":393,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.637755+0000","last_change":"2024-03-04T10:46:27.637755+0000","last_active":"2024-03-04T10:46:27.637755+0000","last_peered":"2024-03-04T10:46:27.637755+0000","last_clean":"2024-03-04T10:46:27.637755+0000","last_became_active":"2024-03-04T08:49:39.002676+0000","last_became_peered":"2024-03-04T08:49:39.002676+0000","last_unstale":"2024-03-04T10:46:27.637755+0000","last_undegraded":"2024-03-04T10:46:27.637755+0000","last_fullsized":"2024-03-04T10:46:27.637755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'311","last_scrub_stamp":"2024-03-04T10:46:27.637600+0000","last_deep_scrub":"25'311","last_deep_scrub_stamp":"2024-03-04T10:46:27.637600+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.637600+0000","objects_scrubbed":4,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:43.621365+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195474,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'401","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:37.054094+0000","last_change":"2024-03-04T10:46:37.054094+0000","last_active":"2024-03-04T10:46:37.054094+0000","last_peered":"2024-03-04T10:46:37.054094+0000","last_clean":"2024-03-04T10:46:37.054094+0000","last_became_active":"2024-03-04T08:49:40.161309+0000","last_became_peered":"2024-03-04T08:49:40.161309+0000","last_unstale":"2024-03-04T10:46:37.054094+0000","last_undegraded":"2024-03-04T10:46:37.054094+0000","last_fullsized":"2024-03-04T10:46:37.054094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'401","last_scrub_stamp":"2024-03-04T10:46:37.053936+0000","last_deep_scrub":"25'401","last_deep_scrub_stamp":"2024-03-04T10:46:37.053936+0000","last_clean_scrub_stamp":"2024-03-04T10:46:37.053936+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:04.356215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10206,"num_write":377,"num_write_kb":38425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":245,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:20.082755+0000","last_change":"2024-03-04T10:46:20.082780+0000","last_active":"2024-03-04T10:46:20.082755+0000","last_peered":"2024-03-04T10:46:20.082755+0000","last_clean":"2024-03-04T10:46:20.082755+0000","last_became_active":"2024-03-04T08:49:25.375055+0000","last_became_peered":"2024-03-04T08:49:25.375055+0000","last_unstale":"2024-03-04T10:46:20.082755+0000","last_undegraded":"2024-03-04T10:46:20.082755+0000","last_fullsized":"2024-03-04T10:46:20.082755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-03-04T10:46:20.082688+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-03-04T10:46:20.082688+0000","last_clean_scrub_stamp":"2024-03-04T10:46:20.082688+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:09:31.855920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'319","reported_seq":405,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:33.096442+0000","last_change":"2024-03-04T10:46:33.096511+0000","last_active":"2024-03-04T10:46:33.096442+0000","last_peered":"2024-03-04T10:46:33.096442+0000","last_clean":"2024-03-04T10:46:33.096442+0000","last_became_active":"2024-03-04T08:49:39.014022+0000","last_became_peered":"2024-03-04T08:49:39.014022+0000","last_unstale":"2024-03-04T10:46:33.096442+0000","last_undegraded":"2024-03-04T10:46:33.096442+0000","last_fullsized":"2024-03-04T10:46:33.096442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'319","last_scrub_stamp":"2024-03-04T10:46:33.096285+0000","last_deep_scrub":"25'319","last_deep_scrub_stamp":"2024-03-04T10:46:33.096285+0000","last_clean_scrub_stamp":"2024-03-04T10:46:33.096285+0000","objects_scrubbed":6,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:28.517226+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'381","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:32.524130+0000","last_change":"2024-03-04T10:46:32.524171+0000","last_active":"2024-03-04T10:46:32.524130+0000","last_peered":"2024-03-04T10:46:32.524130+0000","last_clean":"2024-03-04T10:46:32.524130+0000","last_became_active":"2024-03-04T08:49:40.162804+0000","last_became_peered":"2024-03-04T08:49:40.162804+0000","last_unstale":"2024-03-04T10:46:32.524130+0000","last_undegraded":"2024-03-04T10:46:32.524130+0000","last_fullsized":"2024-03-04T10:46:32.524130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'381","last_scrub_stamp":"2024-03-04T10:46:32.524015+0000","last_deep_scrub":"25'381","last_deep_scrub_stamp":"2024-03-04T10:46:32.524015+0000","last_clean_scrub_stamp":"2024-03-04T10:46:32.524015+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:21.553695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":349,"num_write_kb":66462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'649","reported_seq":737,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.064926+0000","last_change":"2024-03-04T10:46:27.064973+0000","last_active":"2024-03-04T10:46:27.064926+0000","last_peered":"2024-03-04T10:46:27.064926+0000","last_clean":"2024-03-04T10:46:27.064926+0000","last_became_active":"2024-03-04T08:49:39.002439+0000","last_became_peered":"2024-03-04T08:49:39.002439+0000","last_unstale":"2024-03-04T10:46:27.064926+0000","last_undegraded":"2024-03-04T10:46:27.064926+0000","last_fullsized":"2024-03-04T10:46:27.064926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'649","last_scrub_stamp":"2024-03-04T10:46:27.064818+0000","last_deep_scrub":"25'649","last_deep_scrub_stamp":"2024-03-04T10:46:27.064818+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.064818+0000","objects_scrubbed":4,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:48.162047+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":12616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'408","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:29.547865+0000","last_change":"2024-03-04T10:46:29.547886+0000","last_active":"2024-03-04T10:46:29.547865+0000","last_peered":"2024-03-04T10:46:29.547865+0000","last_clean":"2024-03-04T10:46:29.547865+0000","last_became_active":"2024-03-04T08:49:40.162503+0000","last_became_peered":"2024-03-04T08:49:40.162503+0000","last_unstale":"2024-03-04T10:46:29.547865+0000","last_undegraded":"2024-03-04T10:46:29.547865+0000","last_fullsized":"2024-03-04T10:46:29.547865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-03-04T10:46:29.547791+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-03-04T10:46:29.547791+0000","last_clean_scrub_stamp":"2024-03-04T10:46:29.547791+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:39.239277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":90482,"num_write":377,"num_write_kb":105458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1493","reported_seq":2997,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.201341+0000","last_change":"2024-03-04T10:46:28.201388+0000","last_active":"2024-03-04T10:46:28.201341+0000","last_peered":"2024-03-04T10:46:28.201341+0000","last_clean":"2024-03-04T10:46:28.201341+0000","last_became_active":"2024-03-04T08:49:38.993138+0000","last_became_peered":"2024-03-04T08:49:38.993138+0000","last_unstale":"2024-03-04T10:46:28.201341+0000","last_undegraded":"2024-03-04T10:46:28.201341+0000","last_fullsized":"2024-03-04T10:46:28.201341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1493","last_scrub_stamp":"2024-03-04T10:46:28.201246+0000","last_deep_scrub":"25'1493","last_deep_scrub_stamp":"2024-03-04T10:46:28.201246+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.201246+0000","objects_scrubbed":4,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:28.161609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470470,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":2454,"num_write":1423,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:39.136578+0000","last_change":"2024-03-04T10:46:39.136598+0000","last_active":"2024-03-04T10:46:39.136578+0000","last_peered":"2024-03-04T10:46:39.136578+0000","last_clean":"2024-03-04T10:46:39.136578+0000","last_became_active":"2024-03-04T08:49:40.166529+0000","last_became_peered":"2024-03-04T08:49:40.166529+0000","last_unstale":"2024-03-04T10:46:39.136578+0000","last_undegraded":"2024-03-04T10:46:39.136578+0000","last_fullsized":"2024-03-04T10:46:39.136578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-03-04T10:46:39.136508+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-03-04T10:46:39.136508+0000","last_clean_scrub_stamp":"2024-03-04T10:46:39.136508+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:15.500888+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":48072,"num_write":378,"num_write_kb":95952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'423","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.098477+0000","last_change":"2024-03-04T10:46:26.098524+0000","last_active":"2024-03-04T10:46:26.098477+0000","last_peered":"2024-03-04T10:46:26.098477+0000","last_clean":"2024-03-04T10:46:26.098477+0000","last_became_active":"2024-03-04T08:49:39.014792+0000","last_became_peered":"2024-03-04T08:49:39.014792+0000","last_unstale":"2024-03-04T10:46:26.098477+0000","last_undegraded":"2024-03-04T10:46:26.098477+0000","last_fullsized":"2024-03-04T10:46:26.098477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2024-03-04T10:46:26.098383+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2024-03-04T10:46:26.098383+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.098383+0000","objects_scrubbed":4,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:32:26.386574+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":8389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'412","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.832542+0000","last_change":"2024-03-04T10:46:25.832563+0000","last_active":"2024-03-04T10:46:25.832542+0000","last_peered":"2024-03-04T10:46:25.832542+0000","last_clean":"2024-03-04T10:46:25.832542+0000","last_became_active":"2024-03-04T08:49:40.141000+0000","last_became_peered":"2024-03-04T08:49:40.141000+0000","last_unstale":"2024-03-04T10:46:25.832542+0000","last_undegraded":"2024-03-04T10:46:25.832542+0000","last_fullsized":"2024-03-04T10:46:25.832542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2024-03-04T10:46:25.832472+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2024-03-04T10:46:25.832472+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.832472+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:34.406425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":26782,"num_write":371,"num_write_kb":63203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'370","reported_seq":456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.042747+0000","last_change":"2024-03-04T10:46:26.042771+0000","last_active":"2024-03-04T10:46:26.042747+0000","last_peered":"2024-03-04T10:46:26.042747+0000","last_clean":"2024-03-04T10:46:26.042747+0000","last_became_active":"2024-03-04T08:49:38.994785+0000","last_became_peered":"2024-03-04T08:49:38.994785+0000","last_unstale":"2024-03-04T10:46:26.042747+0000","last_undegraded":"2024-03-04T10:46:26.042747+0000","last_fullsized":"2024-03-04T10:46:26.042747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'370","last_scrub_stamp":"2024-03-04T10:46:26.042679+0000","last_deep_scrub":"25'370","last_deep_scrub_stamp":"2024-03-04T10:46:26.042679+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.042679+0000","objects_scrubbed":1,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:13:19.739456+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'439","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.905567+0000","last_change":"2024-03-04T10:46:26.905567+0000","last_active":"2024-03-04T10:46:26.905567+0000","last_peered":"2024-03-04T10:46:26.905567+0000","last_clean":"2024-03-04T10:46:26.905567+0000","last_became_active":"2024-03-04T08:49:40.159583+0000","last_became_peered":"2024-03-04T08:49:40.159583+0000","last_unstale":"2024-03-04T10:46:26.905567+0000","last_undegraded":"2024-03-04T10:46:26.905567+0000","last_fullsized":"2024-03-04T10:46:26.905567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'439","last_scrub_stamp":"2024-03-04T10:46:26.905413+0000","last_deep_scrub":"25'439","last_deep_scrub_stamp":"2024-03-04T10:46:26.905413+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.905413+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:06:54.069223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":67320,"num_write":391,"num_write_kb":100010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'450","reported_seq":536,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.065829+0000","last_change":"2024-03-04T10:46:28.065829+0000","last_active":"2024-03-04T10:46:28.065829+0000","last_peered":"2024-03-04T10:46:28.065829+0000","last_clean":"2024-03-04T10:46:28.065829+0000","last_became_active":"2024-03-04T08:49:39.003672+0000","last_became_peered":"2024-03-04T08:49:39.003672+0000","last_unstale":"2024-03-04T10:46:28.065829+0000","last_undegraded":"2024-03-04T10:46:28.065829+0000","last_fullsized":"2024-03-04T10:46:28.065829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'450","last_scrub_stamp":"2024-03-04T10:46:28.065562+0000","last_deep_scrub":"25'450","last_deep_scrub_stamp":"2024-03-04T10:46:28.065562+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.065562+0000","objects_scrubbed":5,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:16.420300+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'397","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:28.597404+0000","last_change":"2024-03-04T10:46:28.597446+0000","last_active":"2024-03-04T10:46:28.597404+0000","last_peered":"2024-03-04T10:46:28.597404+0000","last_clean":"2024-03-04T10:46:28.597404+0000","last_became_active":"2024-03-04T08:49:40.158677+0000","last_became_peered":"2024-03-04T08:49:40.158677+0000","last_unstale":"2024-03-04T10:46:28.597404+0000","last_undegraded":"2024-03-04T10:46:28.597404+0000","last_fullsized":"2024-03-04T10:46:28.597404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'397","last_scrub_stamp":"2024-03-04T10:46:28.597281+0000","last_deep_scrub":"25'397","last_deep_scrub_stamp":"2024-03-04T10:46:28.597281+0000","last_clean_scrub_stamp":"2024-03-04T10:46:28.597281+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:08.959111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":38107,"num_write":361,"num_write_kb":51817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'4117","reported_seq":4201,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.529586+0000","last_change":"2024-03-04T10:46:25.529586+0000","last_active":"2024-03-04T10:46:25.529586+0000","last_peered":"2024-03-04T10:46:25.529586+0000","last_clean":"2024-03-04T10:46:25.529586+0000","last_became_active":"2024-03-04T08:49:38.998273+0000","last_became_peered":"2024-03-04T08:49:38.998273+0000","last_unstale":"2024-03-04T10:46:25.529586+0000","last_undegraded":"2024-03-04T10:46:25.529586+0000","last_fullsized":"2024-03-04T10:46:25.529586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4117","last_scrub_stamp":"2024-03-04T10:46:25.529406+0000","last_deep_scrub":"25'4117","last_deep_scrub_stamp":"2024-03-04T10:46:25.529406+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.529406+0000","objects_scrubbed":4,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:51:15.483931+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9078,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'349","reported_seq":437,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:33.554733+0000","last_change":"2024-03-04T10:46:33.554733+0000","last_active":"2024-03-04T10:46:33.554733+0000","last_peered":"2024-03-04T10:46:33.554733+0000","last_clean":"2024-03-04T10:46:33.554733+0000","last_became_active":"2024-03-04T08:49:40.163990+0000","last_became_peered":"2024-03-04T08:49:40.163990+0000","last_unstale":"2024-03-04T10:46:33.554733+0000","last_undegraded":"2024-03-04T10:46:33.554733+0000","last_fullsized":"2024-03-04T10:46:33.554733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'349","last_scrub_stamp":"2024-03-04T10:46:33.554581+0000","last_deep_scrub":"25'349","last_deep_scrub_stamp":"2024-03-04T10:46:33.554581+0000","last_clean_scrub_stamp":"2024-03-04T10:46:33.554581+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:09:05.858150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":326,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'347","reported_seq":431,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:30.101981+0000","last_change":"2024-03-04T10:46:30.101981+0000","last_active":"2024-03-04T10:46:30.101981+0000","last_peered":"2024-03-04T10:46:30.101981+0000","last_clean":"2024-03-04T10:46:30.101981+0000","last_became_active":"2024-03-04T08:49:39.012357+0000","last_became_peered":"2024-03-04T08:49:39.012357+0000","last_unstale":"2024-03-04T10:46:30.101981+0000","last_undegraded":"2024-03-04T10:46:30.101981+0000","last_fullsized":"2024-03-04T10:46:30.101981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'347","last_scrub_stamp":"2024-03-04T10:46:30.101662+0000","last_deep_scrub":"25'347","last_deep_scrub_stamp":"2024-03-04T10:46:30.101662+0000","last_clean_scrub_stamp":"2024-03-04T10:46:30.101662+0000","objects_scrubbed":5,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:35:42.462847+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'442","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:29.491786+0000","last_change":"2024-03-04T10:46:29.491786+0000","last_active":"2024-03-04T10:46:29.491786+0000","last_peered":"2024-03-04T10:46:29.491786+0000","last_clean":"2024-03-04T10:46:29.491786+0000","last_became_active":"2024-03-04T08:49:40.161135+0000","last_became_peered":"2024-03-04T08:49:40.161135+0000","last_unstale":"2024-03-04T10:46:29.491786+0000","last_undegraded":"2024-03-04T10:46:29.491786+0000","last_fullsized":"2024-03-04T10:46:29.491786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'442","last_scrub_stamp":"2024-03-04T10:46:29.491638+0000","last_deep_scrub":"25'442","last_deep_scrub_stamp":"2024-03-04T10:46:29.491638+0000","last_clean_scrub_stamp":"2024-03-04T10:46:29.491638+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:58:05.466349+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":107561,"num_write":401,"num_write_kb":141953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'190","reported_seq":274,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:19.922968+0000","last_change":"2024-03-04T10:46:19.922968+0000","last_active":"2024-03-04T10:46:19.922968+0000","last_peered":"2024-03-04T10:46:19.922968+0000","last_clean":"2024-03-04T10:46:19.922968+0000","last_became_active":"2024-03-04T08:49:39.003946+0000","last_became_peered":"2024-03-04T08:49:39.003946+0000","last_unstale":"2024-03-04T10:46:19.922968+0000","last_undegraded":"2024-03-04T10:46:19.922968+0000","last_fullsized":"2024-03-04T10:46:19.922968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'190","last_scrub_stamp":"2024-03-04T10:46:19.922768+0000","last_deep_scrub":"25'190","last_deep_scrub_stamp":"2024-03-04T10:46:19.922768+0000","last_clean_scrub_stamp":"2024-03-04T10:46:19.922768+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:42.185416+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":548,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:36.072659+0000","last_change":"2024-03-04T10:46:36.072659+0000","last_active":"2024-03-04T10:46:36.072659+0000","last_peered":"2024-03-04T10:46:36.072659+0000","last_clean":"2024-03-04T10:46:36.072659+0000","last_became_active":"2024-03-04T08:49:40.158094+0000","last_became_peered":"2024-03-04T08:49:40.158094+0000","last_unstale":"2024-03-04T10:46:36.072659+0000","last_undegraded":"2024-03-04T10:46:36.072659+0000","last_fullsized":"2024-03-04T10:46:36.072659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-03-04T10:46:36.072512+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-03-04T10:46:36.072512+0000","last_clean_scrub_stamp":"2024-03-04T10:46:36.072512+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:50:13.434893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":57584,"num_write":412,"num_write_kb":99809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'427","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:26.485834+0000","last_change":"2024-03-04T10:46:26.485834+0000","last_active":"2024-03-04T10:46:26.485834+0000","last_peered":"2024-03-04T10:46:26.485834+0000","last_clean":"2024-03-04T10:46:26.485834+0000","last_became_active":"2024-03-04T08:49:39.002914+0000","last_became_peered":"2024-03-04T08:49:39.002914+0000","last_unstale":"2024-03-04T10:46:26.485834+0000","last_undegraded":"2024-03-04T10:46:26.485834+0000","last_fullsized":"2024-03-04T10:46:26.485834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2024-03-04T10:46:26.485651+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2024-03-04T10:46:26.485651+0000","last_clean_scrub_stamp":"2024-03-04T10:46:26.485651+0000","objects_scrubbed":5,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:03.187700+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'399","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:30.518280+0000","last_change":"2024-03-04T10:46:30.518280+0000","last_active":"2024-03-04T10:46:30.518280+0000","last_peered":"2024-03-04T10:46:30.518280+0000","last_clean":"2024-03-04T10:46:30.518280+0000","last_became_active":"2024-03-04T08:49:40.161228+0000","last_became_peered":"2024-03-04T08:49:40.161228+0000","last_unstale":"2024-03-04T10:46:30.518280+0000","last_undegraded":"2024-03-04T10:46:30.518280+0000","last_fullsized":"2024-03-04T10:46:30.518280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'399","last_scrub_stamp":"2024-03-04T10:46:30.518189+0000","last_deep_scrub":"25'399","last_deep_scrub_stamp":"2024-03-04T10:46:30.518189+0000","last_clean_scrub_stamp":"2024-03-04T10:46:30.518189+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:07:02.823992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":13099,"num_write":371,"num_write_kb":42170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1147","reported_seq":1230,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:25.634679+0000","last_change":"2024-03-04T10:46:25.634709+0000","last_active":"2024-03-04T10:46:25.634679+0000","last_peered":"2024-03-04T10:46:25.634679+0000","last_clean":"2024-03-04T10:46:25.634679+0000","last_became_active":"2024-03-04T08:49:38.993134+0000","last_became_peered":"2024-03-04T08:49:38.993134+0000","last_unstale":"2024-03-04T10:46:25.634679+0000","last_undegraded":"2024-03-04T10:46:25.634679+0000","last_fullsized":"2024-03-04T10:46:25.634679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1147","last_scrub_stamp":"2024-03-04T10:46:25.634611+0000","last_deep_scrub":"25'1147","last_deep_scrub_stamp":"2024-03-04T10:46:25.634611+0000","last_clean_scrub_stamp":"2024-03-04T10:46:25.634611+0000","objects_scrubbed":4,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:01:36.107395+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'421","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:31.171921+0000","last_change":"2024-03-04T10:46:31.171921+0000","last_active":"2024-03-04T10:46:31.171921+0000","last_peered":"2024-03-04T10:46:31.171921+0000","last_clean":"2024-03-04T10:46:31.171921+0000","last_became_active":"2024-03-04T08:49:40.167446+0000","last_became_peered":"2024-03-04T08:49:40.167446+0000","last_unstale":"2024-03-04T10:46:31.171921+0000","last_undegraded":"2024-03-04T10:46:31.171921+0000","last_fullsized":"2024-03-04T10:46:31.171921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2024-03-04T10:46:31.171758+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2024-03-04T10:46:31.171758+0000","last_clean_scrub_stamp":"2024-03-04T10:46:31.171758+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:58.362069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8812,"num_write":384,"num_write_kb":25790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1106","reported_seq":1188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:34.084291+0000","last_change":"2024-03-04T10:46:34.084291+0000","last_active":"2024-03-04T10:46:34.084291+0000","last_peered":"2024-03-04T10:46:34.084291+0000","last_clean":"2024-03-04T10:46:34.084291+0000","last_became_active":"2024-03-04T08:49:39.014462+0000","last_became_peered":"2024-03-04T08:49:39.014462+0000","last_unstale":"2024-03-04T10:46:34.084291+0000","last_undegraded":"2024-03-04T10:46:34.084291+0000","last_fullsized":"2024-03-04T10:46:34.084291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1106","last_scrub_stamp":"2024-03-04T10:46:34.084186+0000","last_deep_scrub":"25'1106","last_deep_scrub_stamp":"2024-03-04T10:46:34.084186+0000","last_clean_scrub_stamp":"2024-03-04T10:46:34.084186+0000","objects_scrubbed":5,"log_size":1106,"log_dups_size":0,"ondisk_log_size":1106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:17:44.157908+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1045,"num_write_kb":12781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'434","reported_seq":527,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:39.058541+0000","last_change":"2024-03-04T10:46:39.058563+0000","last_active":"2024-03-04T10:46:39.058541+0000","last_peered":"2024-03-04T10:46:39.058541+0000","last_clean":"2024-03-04T10:46:39.058541+0000","last_became_active":"2024-03-04T08:49:40.163429+0000","last_became_peered":"2024-03-04T08:49:40.163429+0000","last_unstale":"2024-03-04T10:46:39.058541+0000","last_undegraded":"2024-03-04T10:46:39.058541+0000","last_fullsized":"2024-03-04T10:46:39.058541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'434","last_scrub_stamp":"2024-03-04T10:46:39.058471+0000","last_deep_scrub":"25'434","last_deep_scrub_stamp":"2024-03-04T10:46:39.058471+0000","last_clean_scrub_stamp":"2024-03-04T10:46:39.058471+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:38:41.866649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":39178,"num_write":404,"num_write_kb":64477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'406","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:40.096606+0000","last_change":"2024-03-04T10:46:40.096644+0000","last_active":"2024-03-04T10:46:40.096606+0000","last_peered":"2024-03-04T10:46:40.096606+0000","last_clean":"2024-03-04T10:46:40.096606+0000","last_became_active":"2024-03-04T08:49:40.165974+0000","last_became_peered":"2024-03-04T08:49:40.165974+0000","last_unstale":"2024-03-04T10:46:40.096606+0000","last_undegraded":"2024-03-04T10:46:40.096606+0000","last_fullsized":"2024-03-04T10:46:40.096606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2024-03-04T10:46:40.096496+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2024-03-04T10:46:40.096496+0000","last_clean_scrub_stamp":"2024-03-04T10:46:40.096496+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:24:43.192844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":47257,"num_write":366,"num_write_kb":58992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'747","reported_seq":823,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:21.871140+0000","last_change":"2024-03-04T10:46:21.871200+0000","last_active":"2024-03-04T10:46:21.871140+0000","last_peered":"2024-03-04T10:46:21.871140+0000","last_clean":"2024-03-04T10:46:21.871140+0000","last_became_active":"2024-03-04T08:49:39.004530+0000","last_became_peered":"2024-03-04T08:49:39.004530+0000","last_unstale":"2024-03-04T10:46:21.871140+0000","last_undegraded":"2024-03-04T10:46:21.871140+0000","last_fullsized":"2024-03-04T10:46:21.871140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'747","last_scrub_stamp":"2024-03-04T10:46:21.871040+0000","last_deep_scrub":"25'747","last_deep_scrub_stamp":"2024-03-04T10:46:21.871040+0000","last_clean_scrub_stamp":"2024-03-04T10:46:21.871040+0000","objects_scrubbed":4,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:31.939306+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'402","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:24.063301+0000","last_change":"2024-03-04T10:46:24.063543+0000","last_active":"2024-03-04T10:46:24.063301+0000","last_peered":"2024-03-04T10:46:24.063301+0000","last_clean":"2024-03-04T10:46:24.063301+0000","last_became_active":"2024-03-04T08:49:40.150157+0000","last_became_peered":"2024-03-04T08:49:40.150157+0000","last_unstale":"2024-03-04T10:46:24.063301+0000","last_undegraded":"2024-03-04T10:46:24.063301+0000","last_fullsized":"2024-03-04T10:46:24.063301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2024-03-04T10:46:24.063066+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2024-03-04T10:46:24.063066+0000","last_clean_scrub_stamp":"2024-03-04T10:46:24.063066+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:22.970013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":109003,"num_write":376,"num_write_kb":109132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1362","reported_seq":1438,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:20.922293+0000","last_change":"2024-03-04T10:46:20.922363+0000","last_active":"2024-03-04T10:46:20.922293+0000","last_peered":"2024-03-04T10:46:20.922293+0000","last_clean":"2024-03-04T10:46:20.922293+0000","last_became_active":"2024-03-04T08:49:39.004972+0000","last_became_peered":"2024-03-04T08:49:39.004972+0000","last_unstale":"2024-03-04T10:46:20.922293+0000","last_undegraded":"2024-03-04T10:46:20.922293+0000","last_fullsized":"2024-03-04T10:46:20.922293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1362","last_scrub_stamp":"2024-03-04T10:46:20.922214+0000","last_deep_scrub":"25'1362","last_deep_scrub_stamp":"2024-03-04T10:46:20.922214+0000","last_clean_scrub_stamp":"2024-03-04T10:46:20.922214+0000","objects_scrubbed":11,"log_size":1362,"log_dups_size":0,"ondisk_log_size":1362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:47.368537+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'371","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:31.079237+0000","last_change":"2024-03-04T10:46:31.079280+0000","last_active":"2024-03-04T10:46:31.079237+0000","last_peered":"2024-03-04T10:46:31.079237+0000","last_clean":"2024-03-04T10:46:31.079237+0000","last_became_active":"2024-03-04T08:49:40.146756+0000","last_became_peered":"2024-03-04T08:49:40.146756+0000","last_unstale":"2024-03-04T10:46:31.079237+0000","last_undegraded":"2024-03-04T10:46:31.079237+0000","last_fullsized":"2024-03-04T10:46:31.079237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'371","last_scrub_stamp":"2024-03-04T10:46:31.079114+0000","last_deep_scrub":"25'371","last_deep_scrub_stamp":"2024-03-04T10:46:31.079114+0000","last_clean_scrub_stamp":"2024-03-04T10:46:31.079114+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:47.420558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":85639,"num_write":344,"num_write_kb":59290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'546","reported_seq":634,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.058373+0000","last_change":"2024-03-04T10:46:27.058430+0000","last_active":"2024-03-04T10:46:27.058373+0000","last_peered":"2024-03-04T10:46:27.058373+0000","last_clean":"2024-03-04T10:46:27.058373+0000","last_became_active":"2024-03-04T08:49:38.994916+0000","last_became_peered":"2024-03-04T08:49:38.994916+0000","last_unstale":"2024-03-04T10:46:27.058373+0000","last_undegraded":"2024-03-04T10:46:27.058373+0000","last_fullsized":"2024-03-04T10:46:27.058373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'546","last_scrub_stamp":"2024-03-04T10:46:27.058294+0000","last_deep_scrub":"25'546","last_deep_scrub_stamp":"2024-03-04T10:46:27.058294+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.058294+0000","objects_scrubbed":2,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:34.752790+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'380","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:29.041197+0000","last_change":"2024-03-04T10:46:29.041237+0000","last_active":"2024-03-04T10:46:29.041197+0000","last_peered":"2024-03-04T10:46:29.041197+0000","last_clean":"2024-03-04T10:46:29.041197+0000","last_became_active":"2024-03-04T08:49:40.127821+0000","last_became_peered":"2024-03-04T08:49:40.127821+0000","last_unstale":"2024-03-04T10:46:29.041197+0000","last_undegraded":"2024-03-04T10:46:29.041197+0000","last_fullsized":"2024-03-04T10:46:29.041197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'380","last_scrub_stamp":"2024-03-04T10:46:29.041089+0000","last_deep_scrub":"25'380","last_deep_scrub_stamp":"2024-03-04T10:46:29.041089+0000","last_clean_scrub_stamp":"2024-03-04T10:46:29.041089+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:06.498393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":32203,"num_write":336,"num_write_kb":38117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'508","reported_seq":594,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-04T10:46:27.514214+0000","last_change":"2024-03-04T10:46:27.514273+0000","last_active":"2024-03-04T10:46:27.514214+0000","last_peered":"2024-03-04T10:46:27.514214+0000","last_clean":"2024-03-04T10:46:27.514214+0000","last_became_active":"2024-03-04T08:49:39.011661+0000","last_became_peered":"2024-03-04T08:49:39.011661+0000","last_unstale":"2024-03-04T10:46:27.514214+0000","last_undegraded":"2024-03-04T10:46:27.514214+0000","last_fullsized":"2024-03-04T10:46:27.514214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'508","last_scrub_stamp":"2024-03-04T10:46:27.514098+0000","last_deep_scrub":"25'508","last_deep_scrub_stamp":"2024-03-04T10:46:27.514098+0000","last_clean_scrub_stamp":"2024-03-04T10:46:27.514098+0000","objects_scrubbed":8,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:09:30.618221+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1137,"num_read_kb":3491284,"num_write":24342,"num_write_kb":4342030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":215639705,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":1418,"num_read_kb":2454,"num_write":28741,"num_write_kb":225850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":431521792,"data_stored":431279410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25694,"ondisk_log_size":25694,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149424,"kb_used_data":86312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94222416,"statfs":{"total":96636764160,"available":96483753984,"internally_reserved":0,"allocated":88383488,"data_stored":88178517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82260,"kb_used_data":33036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94289580,"statfs":{"total":96636764160,"available":96552529920,"internally_reserved":0,"allocated":33828864,"data_stored":33650583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121684,"kb_used_data":50252,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250156,"statfs":{"total":96636764160,"available":96512159744,"internally_reserved":0,"allocated":51458048,"data_stored":51271590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171936,"kb_used_data":82456,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199904,"statfs":{"total":96636764160,"available":96460701696,"internally_reserved":0,"allocated":84434944,"data_stored":84236782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543557,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101764,"kb_used_data":34492,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270076,"statfs":{"total":96636764160,"available":96532557824,"internally_reserved":0,"allocated":35319808,"data_stored":35121255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543557,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78104,"kb_used_data":33040,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293736,"statfs":{"total":96636764160,"available":96556785664,"internally_reserved":0,"allocated":33832960,"data_stored":33652223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543558,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114556,"kb_used_data":51444,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":52678656,"data_stored":52488611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543558,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129144,"kb_used_data":53552,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94242696,"statfs":{"total":96636764160,"available":96504520704,"internally_reserved":0,"allocated":54837248,"data_stored":54623873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84176896,"data_stored":84141371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50606080,"data_stored":50585811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33570816,"data_stored":33555172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88125440,"data_stored":88083106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54579200,"data_stored":54528462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51826688,"data_stored":51802832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33574912,"data_stored":33556812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35061760,"data_stored":35025844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T10:46:48.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-04T10:46:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.472+0000 7fa04cc00640 1 Processor -- start 2024-03-04T10:46:48.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.472+0000 7fa04cc00640 1 -- start start 2024-03-04T10:46:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.473+0000 7fa04cc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa048154b30 0x7fa0480ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.473+0000 7fa04cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa0480ce650 0x7fa0480cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.473+0000 7fa04cc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480ca6d0 con 0x7fa048154750 2024-03-04T10:46:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.473+0000 7fa04cc00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480ca990 con 0x7fa0480ce650 2024-03-04T10:46:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.473+0000 7fa04cc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480cac70 con 0x7fa048154b30 2024-03-04T10:46:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.474+0000 7fa046800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa0480ce650 0x7fa0480cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.474+0000 7fa045400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa048154b30 0x7fa0480ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.474+0000 7fa046800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa0480ce650 0x7fa0480cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45860/0 (socket says 172.21.15.46:45860) 2024-03-04T10:46:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.474+0000 7fa046800640 1 -- 172.21.15.46:0/1117560381 learned_addr learned my addr 172.21.15.46:0/1117560381 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.477+0000 7fa046800640 1 -- 172.21.15.46:0/1117560381 >> v2:172.21.15.73:3300/0 conn(0x7fa048154b30 msgr2=0x7fa0480ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.477+0000 7fa046800640 1 --2- 172.21.15.46:0/1117560381 >> v2:172.21.15.73:3300/0 conn(0x7fa048154b30 0x7fa0480ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.477+0000 7fa046800640 1 -- 172.21.15.46:0/1117560381 >> v1:172.21.15.73:6789/0 conn(0x7fa048154750 legacy=0x7fa0480cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.477+0000 7fa046800640 1 -- 172.21.15.46:0/1117560381 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04815a900 con 0x7fa0480ce650 2024-03-04T10:46:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.479+0000 7fa046800640 1 --2- 172.21.15.46:0/1117560381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa0480cc700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa04808d890 tx=0x7fa04002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b437944208f16720 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:48.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa044a00640 1 -- 172.21.15.46:0/1117560381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04002cbb0 con 0x7fa0480ce650 2024-03-04T10:46:48.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa044a00640 1 -- 172.21.15.46:0/1117560381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04002cd50 con 0x7fa0480ce650 2024-03-04T10:46:48.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa044a00640 1 -- 172.21.15.46:0/1117560381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040034610 con 0x7fa0480ce650 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa04cc00640 1 -- 172.21.15.46:0/1117560381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 msgr2=0x7fa0480cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa04cc00640 1 --2- 172.21.15.46:0/1117560381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa0480cc700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa04808d890 tx=0x7fa04002c010 comp rx=0 tx=0).stop 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa04cc00640 1 -- 172.21.15.46:0/1117560381 shutdown_connections 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa04cc00640 1 --2- 172.21.15.46:0/1117560381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa0480cc700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa04cc00640 1 --2- 172.21.15.46:0/1117560381 >> v2:172.21.15.73:3300/0 conn(0x7fa048154b30 0x7fa0480ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.484+0000 7fa04cc00640 1 -- 172.21.15.46:0/1117560381 >> 172.21.15.46:0/1117560381 conn(0x7fa048066c40 msgr2=0x7fa048067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.485+0000 7fa04cc00640 1 -- 172.21.15.46:0/1117560381 shutdown_connections 2024-03-04T10:46:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.485+0000 7fa04cc00640 1 -- 172.21.15.46:0/1117560381 wait complete. 2024-03-04T10:46:48.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.486+0000 7fa04cc00640 1 Processor -- start 2024-03-04T10:46:48.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.486+0000 7fa04cc00640 1 -- start start 2024-03-04T10:46:48.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.487+0000 7fa04cc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa048150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:48.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.487+0000 7fa04cc00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa048154750 0x7fa04815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:48.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.487+0000 7fa04cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0480c7960 0x7fa0480c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:48.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.487+0000 7fa04cc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04815a5b0 con 0x7fa0480ce650 2024-03-04T10:46:48.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.487+0000 7fa04cc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04815aec0 con 0x7fa0480c7960 2024-03-04T10:46:48.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.487+0000 7fa04cc00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04815b3e0 con 0x7fa048154750 2024-03-04T10:46:48.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.488+0000 7fa045e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa048150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:48.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.488+0000 7fa046800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0480c7960 0x7fa0480c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:48.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.488+0000 7fa045400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa048154750 0x7fa04815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:48.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.488+0000 7fa045e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa048150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45874/0 (socket says 172.21.15.46:45874) 2024-03-04T10:46:48.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.488+0000 7fa045e00640 1 -- 172.21.15.46:0/3057650059 learned_addr learned my addr 172.21.15.46:0/3057650059 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:48.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.492+0000 7fa045e00640 1 -- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa048154750 msgr2=0x7fa04815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:48.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.492+0000 7fa045e00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa048154750 0x7fa04815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.492+0000 7fa045e00640 1 -- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0480c7960 msgr2=0x7fa0480c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:48.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.492+0000 7fa045e00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0480c7960 0x7fa0480c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:48.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.492+0000 7fa045e00640 1 -- 172.21.15.46:0/3057650059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480c8330 con 0x7fa0480ce650 2024-03-04T10:46:48.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.495+0000 7fa045e00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa048150050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c430 tx=0x7fa03800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:48.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.499+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380052d0 con 0x7fa0480ce650 2024-03-04T10:46:48.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.499+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038005490 con 0x7fa0480ce650 2024-03-04T10:46:48.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.499+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038007260 con 0x7fa0480ce650 2024-03-04T10:46:48.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.499+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04815c2c0 con 0x7fa0480ce650 2024-03-04T10:46:48.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.499+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04815c880 con 0x7fa0480ce650 2024-03-04T10:46:48.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.500+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0480680b0 con 0x7fa0480ce650 2024-03-04T10:46:48.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.522+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa038007400 con 0x7fa0480ce650 2024-03-04T10:46:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.524+0000 7fa03e000640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa02806b550 0x7fa02806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.524+0000 7fa045400640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa02806b550 0x7fa02806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:48.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.525+0000 7fa045400640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa02806b550 0x7fa02806da10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa048153b80 tx=0x7fa034009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:48.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.526+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa038056450 con 0x7fa0480ce650 2024-03-04T10:46:48.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:48.797+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa0380583b0 con 0x7fa0480ce650 2024-03-04T10:46:49.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.013+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fa0480cd260 con 0x7fa0480ce650 2024-03-04T10:46:49.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.216+0000 7fa03e000640 1 -- 172.21.15.46:0/3057650059 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa03805c450 con 0x7fa0480ce650 2024-03-04T10:46:49.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.219+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa02806b550 msgr2=0x7fa02806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:49.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.219+0000 7fa04cc00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa02806b550 0x7fa02806da10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa048153b80 tx=0x7fa034009190 comp rx=0 tx=0).stop 2024-03-04T10:46:49.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.219+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 msgr2=0x7fa048150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:49.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.219+0000 7fa04cc00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa048150050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c430 tx=0x7fa03800c8f0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 shutdown_connections 2024-03-04T10:46:49.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fa02806b550 0x7fa02806da10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0480c7960 0x7fa0480c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa048154750 0x7fa04815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 --2- 172.21.15.46:0/3057650059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0480ce650 0x7fa048150050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 >> 172.21.15.46:0/3057650059 conn(0x7fa048066c40 msgr2=0x7fa0480d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 shutdown_connections 2024-03-04T10:46:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.220+0000 7fa04cc00640 1 -- 172.21.15.46:0/3057650059 wait complete. 2024-03-04T10:46:49.249 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T10:46:49.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T10:46:49.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.430+0000 7f093a800640 1 Processor -- start 2024-03-04T10:46:49.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.430+0000 7f093a800640 1 -- start start 2024-03-04T10:46:49.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.431+0000 7f093a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09340c5dd0 0x7f0934158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.431+0000 7f093a800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c61b0 0x7f0934066c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.431+0000 7f093a800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09340c2720 0x7f09340c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.431+0000 7f093a800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093415b650 con 0x7f09340c5dd0 2024-03-04T10:46:49.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.431+0000 7f093a800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093415b880 con 0x7f09340c2720 2024-03-04T10:46:49.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.431+0000 7f093a800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093415bb20 con 0x7f09340c61b0 2024-03-04T10:46:49.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.432+0000 7f0932a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c61b0 0x7f0934066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.432+0000 7f0933e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09340c2720 0x7f09340c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.432+0000 7f0933400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09340c5dd0 0x7f0934158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.433+0000 7f0933400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09340c5dd0 0x7f0934158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45880/0 (socket says 172.21.15.46:45880) 2024-03-04T10:46:49.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.433+0000 7f0933400640 1 -- 172.21.15.46:0/1174944513 learned_addr learned my addr 172.21.15.46:0/1174944513 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:49.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.435+0000 7f0933e00640 1 -- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c61b0 msgr2=0x7f0934066c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.435+0000 7f0933e00640 1 --2- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c61b0 0x7f0934066c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.435+0000 7f0933e00640 1 -- 172.21.15.46:0/1174944513 >> v2:172.21.15.46:3300/0 conn(0x7f09340c5dd0 msgr2=0x7f0934158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.435+0000 7f0933e00640 1 --2- 172.21.15.46:0/1174944513 >> v2:172.21.15.46:3300/0 conn(0x7f09340c5dd0 0x7f0934158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.435+0000 7f0933e00640 1 -- 172.21.15.46:0/1174944513 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093415bdc0 con 0x7f09340c2720 2024-03-04T10:46:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.437+0000 7f0933e00640 1 --2- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c2720 0x7f09340c2bb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0934067d40 tx=0x7f092c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7965af73202e96a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.441+0000 7f0932000640 1 -- 172.21.15.46:0/1174944513 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c039070 con 0x7f09340c2720 2024-03-04T10:46:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.441+0000 7f0932000640 1 -- 172.21.15.46:0/1174944513 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f092c02cc60 con 0x7f09340c2720 2024-03-04T10:46:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.441+0000 7f0932000640 1 -- 172.21.15.46:0/1174944513 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c034680 con 0x7f09340c2720 2024-03-04T10:46:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 -- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c2720 msgr2=0x7f09340c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 --2- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c2720 0x7f09340c2bb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0934067d40 tx=0x7f092c02beb0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 -- 172.21.15.46:0/1174944513 shutdown_connections 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 --2- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c2720 0x7f09340c2bb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 --2- 172.21.15.46:0/1174944513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c61b0 0x7f0934066c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 --2- 172.21.15.46:0/1174944513 >> v2:172.21.15.46:3300/0 conn(0x7f09340c5dd0 0x7f0934158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 -- 172.21.15.46:0/1174944513 >> 172.21.15.46:0/1174944513 conn(0x7f09340c8f50 msgr2=0x7f09340c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 -- 172.21.15.46:0/1174944513 shutdown_connections 2024-03-04T10:46:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.442+0000 7f093a800640 1 -- 172.21.15.46:0/1174944513 wait complete. 2024-03-04T10:46:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.444+0000 7f093a800640 1 Processor -- start 2024-03-04T10:46:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.444+0000 7f093a800640 1 -- start start 2024-03-04T10:46:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f093a800640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c2720 0x7f093413ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f093a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 0x7f09340720a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f093a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c61b0 0x7f09341f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f093a800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934067180 con 0x7f09340c5dd0 2024-03-04T10:46:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f093a800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093415c360 con 0x7f09340c61b0 2024-03-04T10:46:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f093a800640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093406f8b0 con 0x7f09340c2720 2024-03-04T10:46:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f0932a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 0x7f09340720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f0933400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c2720 0x7f093413ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.445+0000 7f0933e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c61b0 0x7f09341f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.446+0000 7f0932a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 0x7f09340720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45888/0 (socket says 172.21.15.46:45888) 2024-03-04T10:46:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.446+0000 7f0932a00640 1 -- 172.21.15.46:0/3186398052 learned_addr learned my addr 172.21.15.46:0/3186398052 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.449+0000 7f0932a00640 1 -- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c2720 msgr2=0x7f093413ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.449+0000 7f0932a00640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c2720 0x7f093413ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.449+0000 7f0932a00640 1 -- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c61b0 msgr2=0x7f09341f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.449+0000 7f0932a00640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c61b0 0x7f09341f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.449+0000 7f0932a00640 1 -- 172.21.15.46:0/3186398052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093413d380 con 0x7f09340c5dd0 2024-03-04T10:46:49.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.452+0000 7f0932a00640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 0x7f09340720a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f092000e8a0 tx=0x7f092000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.457+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920017070 con 0x7f09340c5dd0 2024-03-04T10:46:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.457+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f092000c940 con 0x7f09340c5dd0 2024-03-04T10:46:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.457+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000cd50 con 0x7f09340c5dd0 2024-03-04T10:46:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.458+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09340c4e70 con 0x7f09340c5dd0 2024-03-04T10:46:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.458+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09340c5430 con 0x7f09340c5dd0 2024-03-04T10:46:49.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.459+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934074df0 con 0x7f09340c5dd0 2024-03-04T10:46:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.480+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f092001a070 con 0x7f09340c5dd0 2024-03-04T10:46:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.481+0000 7f092b400640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f091406b520 0x7f091406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:49.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.482+0000 7f0933400640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f091406b520 0x7f091406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:49.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.482+0000 7f0933400640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f091406b520 0x7f091406d9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0924006cc0 tx=0x7f0924009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:49.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.484+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0920057080 con 0x7f09340c5dd0 2024-03-04T10:46:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:49.808+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0920058fe0 con 0x7f09340c5dd0 2024-03-04T10:46:50.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.055+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09340c9d50 con 0x7f09340c5dd0 2024-03-04T10:46:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.081+0000 7f092b400640 1 -- 172.21.15.46:0/3186398052 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6632 (secure 0 0 0) 0x7f092005d080 con 0x7f09340c5dd0 2024-03-04T10:46:50.085 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:50.085 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:49:40.471641+0000","modified":"2024-03-04T09:51:23.522459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4267,"mds_2":4262,"mds_3":4259,"mds_4":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4259":{"gid":4259,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4262":{"gid":4262,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":919,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273,4267,4262,4259,4252]},"id":1}]} 2024-03-04T10:46:50.085 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-03-04T10:46:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f091406b520 msgr2=0x7f091406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f091406b520 0x7f091406d9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0924006cc0 tx=0x7f0924009240 comp rx=0 tx=0).stop 2024-03-04T10:46:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 msgr2=0x7f09340720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 0x7f09340720a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f092000e8a0 tx=0x7f092000ed60 comp rx=0 tx=0).stop 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 shutdown_connections 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f091406b520 0x7f091406d9e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09340c61b0 0x7f09341f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340c5dd0 0x7f09340720a0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f092000e8a0 tx=0x7f092000ed60 comp rx=0 tx=0).stop 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 --2- 172.21.15.46:0/3186398052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09340c2720 0x7f093413ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.083+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 >> 172.21.15.46:0/3186398052 conn(0x7f09340c8f50 msgr2=0x7f09340cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.084+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 shutdown_connections 2024-03-04T10:46:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.084+0000 7f093a800640 1 -- 172.21.15.46:0/3186398052 wait complete. 2024-03-04T10:46:50.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T10:46:50.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.300+0000 7f5b15200640 1 Processor -- start 2024-03-04T10:46:50.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.300+0000 7f5b15200640 1 -- start start 2024-03-04T10:46:50.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.302+0000 7f5b15200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 0x7f5b100c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.302+0000 7f5b15200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b101546f0 0x7f5b100c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.302+0000 7f5b15200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b100cbce0 0x7f5b100d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.302+0000 7f5b15200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1015a400 con 0x7f5b100cbce0 2024-03-04T10:46:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.302+0000 7f5b15200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1015a6e0 con 0x7f5b101546f0 2024-03-04T10:46:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.302+0000 7f5b15200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015a9c0 con 0x7f5b10154310 2024-03-04T10:46:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.303+0000 7f5b0de00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 0x7f5b100c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.303+0000 7f5b0e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b100cbce0 0x7f5b100d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.303+0000 7f5b0d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b101546f0 0x7f5b100c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.303+0000 7f5b0de00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 0x7f5b100c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58782/0 (socket says 172.21.15.46:58782) 2024-03-04T10:46:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.303+0000 7f5b0de00640 1 -- 172.21.15.46:0/737533220 learned_addr learned my addr 172.21.15.46:0/737533220 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.305+0000 7f5b0de00640 1 -- 172.21.15.46:0/737533220 >> v2:172.21.15.73:3300/0 conn(0x7f5b101546f0 msgr2=0x7f5b100c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.305+0000 7f5b0de00640 1 --2- 172.21.15.46:0/737533220 >> v2:172.21.15.73:3300/0 conn(0x7f5b101546f0 0x7f5b100c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.305+0000 7f5b0de00640 1 -- 172.21.15.46:0/737533220 >> v2:172.21.15.46:3300/0 conn(0x7f5b100cbce0 msgr2=0x7f5b100d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.305+0000 7f5b0de00640 1 --2- 172.21.15.46:0/737533220 >> v2:172.21.15.46:3300/0 conn(0x7f5b100cbce0 0x7f5b100d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.305+0000 7f5b0de00640 1 -- 172.21.15.46:0/737533220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1015aca0 con 0x7f5b10154310 2024-03-04T10:46:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.308+0000 7f5b0de00640 1 --2- 172.21.15.46:0/737533220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 0x7f5b100c5ff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5b10067bb0 tx=0x7f5b0002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9cf229554959d90 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.310+0000 7f5b0ca00640 1 -- 172.21.15.46:0/737533220 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00034070 con 0x7f5b10154310 2024-03-04T10:46:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.313+0000 7f5b0ca00640 1 -- 172.21.15.46:0/737533220 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5b00030860 con 0x7f5b10154310 2024-03-04T10:46:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.313+0000 7f5b0ca00640 1 -- 172.21.15.46:0/737533220 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00030c50 con 0x7f5b10154310 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 -- 172.21.15.46:0/737533220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 msgr2=0x7f5b100c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 --2- 172.21.15.46:0/737533220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 0x7f5b100c5ff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5b10067bb0 tx=0x7f5b0002b9a0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 -- 172.21.15.46:0/737533220 shutdown_connections 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 --2- 172.21.15.46:0/737533220 >> v2:172.21.15.46:3300/0 conn(0x7f5b100cbce0 0x7f5b100d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 --2- 172.21.15.46:0/737533220 >> v2:172.21.15.73:3300/0 conn(0x7f5b101546f0 0x7f5b100c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 --2- 172.21.15.46:0/737533220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b10154310 0x7f5b100c5ff0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 -- 172.21.15.46:0/737533220 >> 172.21.15.46:0/737533220 conn(0x7f5b10067060 msgr2=0x7f5b10067470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 -- 172.21.15.46:0/737533220 shutdown_connections 2024-03-04T10:46:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.314+0000 7f5b15200640 1 -- 172.21.15.46:0/737533220 wait complete. 2024-03-04T10:46:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.316+0000 7f5b15200640 1 Processor -- start 2024-03-04T10:46:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.316+0000 7f5b15200640 1 -- start start 2024-03-04T10:46:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b15200640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 0x7f5b100c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b15200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b10154310 0x7f5b101e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b15200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b101546f0 0x7f5b10146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b15200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100d0840 con 0x7f5b10154310 2024-03-04T10:46:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b15200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100d06c0 con 0x7f5b101546f0 2024-03-04T10:46:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b15200640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100d09c0 con 0x7f5b100cbce0 2024-03-04T10:46:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.317+0000 7f5b0de00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 0x7f5b100c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.318+0000 7f5b0e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b101546f0 0x7f5b10146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.318+0000 7f5b0d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b10154310 0x7f5b101e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.318+0000 7f5b0de00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 0x7f5b100c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:58790/0 (socket says 172.21.15.46:58790) 2024-03-04T10:46:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.318+0000 7f5b0de00640 1 -- 172.21.15.46:0/1083987762 learned_addr learned my addr 172.21.15.46:0/1083987762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.323+0000 7f5b0de00640 1 -- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b101546f0 msgr2=0x7f5b10146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.323+0000 7f5b0de00640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b101546f0 0x7f5b10146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.323+0000 7f5b0de00640 1 -- 172.21.15.46:0/1083987762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b10154310 msgr2=0x7f5b101e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.323+0000 7f5b0de00640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b10154310 0x7f5b101e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.323+0000 7f5b0de00640 1 -- 172.21.15.46:0/1083987762 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100c8ed0 con 0x7f5b100cbce0 2024-03-04T10:46:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.326+0000 7f5b0de00640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 0x7f5b100c8690 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000c00 tx=0x7f5b000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.331+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00034040 con 0x7f5b100cbce0 2024-03-04T10:46:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.331+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5b00039d90 con 0x7f5b100cbce0 2024-03-04T10:46:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.331+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00043630 con 0x7f5b100cbce0 2024-03-04T10:46:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.331+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b100c9480 con 0x7f5b100cbce0 2024-03-04T10:46:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.331+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100c9a40 con 0x7f5b100cbce0 2024-03-04T10:46:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.333+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b100680b0 con 0x7f5b100cbce0 2024-03-04T10:46:50.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.368+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b00037070 con 0x7f5b100cbce0 2024-03-04T10:46:50.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.369+0000 7f5b06000640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5af006b520 0x7f5af006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:50.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.370+0000 7f5b0d400640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5af006b520 0x7f5af006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:50.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.371+0000 7f5b0d400640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5af006b520 0x7f5af006d9e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5b101e7800 tx=0x7f5afc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:50.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.634+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5b00078fd0 con 0x7f5b100cbce0 2024-03-04T10:46:50.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.644+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5b0003e070 con 0x7f5b100cbce0 2024-03-04T10:46:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.882+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b10157e60 con 0x7f5b100cbce0 2024-03-04T10:46:50.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.903+0000 7f5b06000640 1 -- 172.21.15.46:0/1083987762 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6632 (secure 0 0 0) 0x7f5b0007af30 con 0x7f5b100cbce0 2024-03-04T10:46:50.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:50.907 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6836/3772501694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3772501694},{"type":"v1","addr":"172.21.15.46:6836","nonce":3772501694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:49:40.471641+0000","modified":"2024-03-04T09:51:23.522459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4267,"mds_2":4262,"mds_3":4259,"mds_4":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6835/3860229017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3860229017},{"type":"v1","addr":"172.21.15.73:6835","nonce":3860229017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4259":{"gid":4259,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6838/381408316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":381408316},{"type":"v1","addr":"172.21.15.73:6838","nonce":381408316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4262":{"gid":4262,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6839/1890974908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6837","nonce":1890974908},{"type":"v1","addr":"172.21.15.73:6839","nonce":1890974908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6833/1752138796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1752138796},{"type":"v1","addr":"172.21.15.46:6833","nonce":1752138796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":919,"addr":"172.21.15.46:6837/3649809556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6835","nonce":3649809556},{"type":"v1","addr":"172.21.15.46:6837","nonce":3649809556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273,4267,4262,4259,4252]},"id":1}]} 2024-03-04T10:46:50.907 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-03-04T10:46:50.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5af006b520 msgr2=0x7f5af006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5af006b520 0x7f5af006d9e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5b101e7800 tx=0x7f5afc009190 comp rx=0 tx=0).stop 2024-03-04T10:46:50.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 msgr2=0x7f5b100c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:50.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 0x7f5b100c8690 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000c00 tx=0x7f5b000046c0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 shutdown_connections 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5af006b520 0x7f5af006d9e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b101546f0 0x7f5b10146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b10154310 0x7f5b101e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.905+0000 7f5b15200640 1 --2- 172.21.15.46:0/1083987762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b100cbce0 0x7f5b100c8690 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.906+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 >> 172.21.15.46:0/1083987762 conn(0x7f5b10067060 msgr2=0x7f5b101494b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.906+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 shutdown_connections 2024-03-04T10:46:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:50.906+0000 7f5b15200640 1 -- 172.21.15.46:0/1083987762 wait complete. 2024-03-04T10:46:50.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T10:46:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.110+0000 7f462ca00640 1 Processor -- start 2024-03-04T10:46:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.111+0000 7f462ca00640 1 -- start start 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.112+0000 7f462ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f462806d8c0 0x7f462806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.112+0000 7f462ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f46280716f0 0x7f4628151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.112+0000 7f462ca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462815b960 con 0x7f462806d4e0 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.112+0000 7f462ca00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462815bc40 con 0x7f462806d8c0 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.112+0000 7f462ca00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462815bf20 con 0x7f46280716f0 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.113+0000 7f4625e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f462806d4e0 0x7f4628158750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:51066/0 (socket says 172.21.15.46:51066) 2024-03-04T10:46:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.113+0000 7f4625e00640 1 -- 172.21.15.46:0/1835691439 learned_addr learned my addr 172.21.15.46:0/1835691439 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:51.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.113+0000 7f4626800640 1 --2- 172.21.15.46:0/1835691439 >> v2:172.21.15.73:3300/0 conn(0x7f46280716f0 0x7f4628151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.117+0000 7f4626800640 1 -- 172.21.15.46:0/1835691439 >> v2:172.21.15.46:3300/0 conn(0x7f462806d8c0 msgr2=0x7f462806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.117+0000 7f4626800640 1 --2- 172.21.15.46:0/1835691439 >> v2:172.21.15.46:3300/0 conn(0x7f462806d8c0 0x7f462806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.117+0000 7f4626800640 1 -- 172.21.15.46:0/1835691439 >> v1:172.21.15.73:6789/0 conn(0x7f462806d4e0 legacy=0x7f4628158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.117+0000 7f4626800640 1 -- 172.21.15.46:0/1835691439 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462815c200 con 0x7f46280716f0 2024-03-04T10:46:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.120+0000 7f4626800640 1 --2- 172.21.15.46:0/1835691439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46280716f0 0x7f4628151f70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4628067730 tx=0x7f462002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3edd8735886c3c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.172+0000 7f4624a00640 1 -- 172.21.15.46:0/1835691439 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620039070 con 0x7f46280716f0 2024-03-04T10:46:51.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.175+0000 7f4624a00640 1 -- 172.21.15.46:0/1835691439 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f462002cc80 con 0x7f46280716f0 2024-03-04T10:46:51.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.175+0000 7f4624a00640 1 -- 172.21.15.46:0/1835691439 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620034680 con 0x7f46280716f0 2024-03-04T10:46:51.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 -- 172.21.15.46:0/1835691439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46280716f0 msgr2=0x7f4628151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 --2- 172.21.15.46:0/1835691439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46280716f0 0x7f4628151f70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4628067730 tx=0x7f462002bed0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 -- 172.21.15.46:0/1835691439 shutdown_connections 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 --2- 172.21.15.46:0/1835691439 >> v2:172.21.15.46:3300/0 conn(0x7f462806d8c0 0x7f462806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 --2- 172.21.15.46:0/1835691439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46280716f0 0x7f4628151f70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 -- 172.21.15.46:0/1835691439 >> 172.21.15.46:0/1835691439 conn(0x7f46280c88d0 msgr2=0x7f46280c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 -- 172.21.15.46:0/1835691439 shutdown_connections 2024-03-04T10:46:51.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.176+0000 7f462ca00640 1 -- 172.21.15.46:0/1835691439 wait complete. 2024-03-04T10:46:51.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.179+0000 7f462ca00640 1 Processor -- start 2024-03-04T10:46:51.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.179+0000 7f462ca00640 1 -- start start 2024-03-04T10:46:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.180+0000 7f462ca00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f462806d4e0 0x7f4628159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.180+0000 7f462ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462806d8c0 0x7f46280c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.180+0000 7f462ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 0x7f462815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.181+0000 7f462ca00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628158fe0 con 0x7f46280716f0 2024-03-04T10:46:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.181+0000 7f462ca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628158e60 con 0x7f462806d8c0 2024-03-04T10:46:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.181+0000 7f462ca00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46281583a0 con 0x7f462806d4e0 2024-03-04T10:46:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.182+0000 7f4626800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 0x7f462815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.182+0000 7f4626800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 0x7f462815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45912/0 (socket says 172.21.15.46:45912) 2024-03-04T10:46:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.182+0000 7f4626800640 1 -- 172.21.15.46:0/4041949392 learned_addr learned my addr 172.21.15.46:0/4041949392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:51.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.183+0000 7f4625400640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462806d8c0 0x7f46280c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.188+0000 7f4626800640 1 -- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f462806d4e0 msgr2=0x7f4628159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.188+0000 7f4626800640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f462806d4e0 0x7f4628159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.188+0000 7f4626800640 1 -- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462806d8c0 msgr2=0x7f46280c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.188+0000 7f4626800640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462806d8c0 0x7f46280c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.188+0000 7f4626800640 1 -- 172.21.15.46:0/4041949392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462815a050 con 0x7f46280716f0 2024-03-04T10:46:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.192+0000 7f4626800640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 0x7f462815afa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4620037040 tx=0x7f4620004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.195+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620039050 con 0x7f46280716f0 2024-03-04T10:46:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.195+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628156400 con 0x7f46280716f0 2024-03-04T10:46:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.195+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46281580c0 con 0x7f46280716f0 2024-03-04T10:46:51.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.197+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46280680b0 con 0x7f46280716f0 2024-03-04T10:46:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.197+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4620045070 con 0x7f46280716f0 2024-03-04T10:46:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.197+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462003e810 con 0x7f46280716f0 2024-03-04T10:46:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.506+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f462003e9b0 con 0x7f46280716f0 2024-03-04T10:46:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.507+0000 7f461e000640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f460806b500 0x7f460806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.507+0000 7f4625e00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f460806b500 0x7f460806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.508+0000 7f4625e00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f460806b500 0x7f460806d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4618000f60 tx=0x7f4618007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:51.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.524+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f462003de40 con 0x7f46280716f0 2024-03-04T10:46:51.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.525+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f462007cb30 con 0x7f46280716f0 2024-03-04T10:46:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.778+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f462806e5a0 con 0x7f46280716f0 2024-03-04T10:46:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.827+0000 7f461e000640 1 -- 172.21.15.46:0/4041949392 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16598 (secure 0 0 0) 0x7f462007c430 con 0x7f46280716f0 2024-03-04T10:46:51.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-04T10:46:51.833 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"bc679561-c3d1-42a9-8f4c-6c87fdde4dff","created":"2024-03-04T08:49:02.759305+0000","modified":"2024-03-04T08:50:11.544052+0000","last_up_change":"2024-03-04T08:49:22.011478+0000","last_in_change":"2024-03-04T08:49:12.331604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:49:22.737500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:49:37.195578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:49:38.689323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2ab089f-ff10-45c7-bf37-a14a618a6742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6809","nonce":873994847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6811","nonce":873994847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6815","nonce":873994847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":873994847},{"type":"v1","addr":"172.21.15.46:6813","nonce":873994847}]},"public_addr":"172.21.15.46:6809/873994847","cluster_addr":"172.21.15.46:6811/873994847","heartbeat_back_addr":"172.21.15.46:6815/873994847","heartbeat_front_addr":"172.21.15.46:6813/873994847","state":["exists","up"]},{"osd":1,"uuid":"87d5bf27-09b9-4567-bd8f-f9094895fcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6801","nonce":2230640805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6803","nonce":2230640805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6808","nonce":2230640805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2230640805},{"type":"v1","addr":"172.21.15.46:6805","nonce":2230640805}]},"public_addr":"172.21.15.46:6801/2230640805","cluster_addr":"172.21.15.46:6803/2230640805","heartbeat_back_addr":"172.21.15.46:6808/2230640805","heartbeat_front_addr":"172.21.15.46:6805/2230640805","state":["exists","up"]},{"osd":2,"uuid":"24e4fc66-fd09-4374-be1e-42984152425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6819","nonce":604231528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6824","nonce":604231528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6831","nonce":604231528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6827","nonce":604231528},{"type":"v1","addr":"172.21.15.46:6829","nonce":604231528}]},"public_addr":"172.21.15.46:6819/604231528","cluster_addr":"172.21.15.46:6824/604231528","heartbeat_back_addr":"172.21.15.46:6831/604231528","heartbeat_front_addr":"172.21.15.46:6829/604231528","state":["exists","up"]},{"osd":3,"uuid":"e908b111-7c01-4a7a-be0e-6336b4c1dd68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6818","nonce":3736261078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6821","nonce":3736261078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6828","nonce":3736261078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":3736261078},{"type":"v1","addr":"172.21.15.46:6825","nonce":3736261078}]},"public_addr":"172.21.15.46:6818/3736261078","cluster_addr":"172.21.15.46:6821/3736261078","heartbeat_back_addr":"172.21.15.46:6828/3736261078","heartbeat_front_addr":"172.21.15.46:6825/3736261078","state":["exists","up"]},{"osd":4,"uuid":"7cbe4281-110a-4c9f-8521-79e30136452c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6820","nonce":2665089334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6824","nonce":2665089334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6832","nonce":2665089334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2665089334},{"type":"v1","addr":"172.21.15.73:6828","nonce":2665089334}]},"public_addr":"172.21.15.73:6820/2665089334","cluster_addr":"172.21.15.73:6824/2665089334","heartbeat_back_addr":"172.21.15.73:6832/2665089334","heartbeat_front_addr":"172.21.15.73:6828/2665089334","state":["exists","up"]},{"osd":5,"uuid":"41cad540-7ff0-454b-b366-d6e96fa26b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6821","nonce":4224855400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6825","nonce":4224855400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6831","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6833","nonce":4224855400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4224855400},{"type":"v1","addr":"172.21.15.73:6829","nonce":4224855400}]},"public_addr":"172.21.15.73:6821/4224855400","cluster_addr":"172.21.15.73:6825/4224855400","heartbeat_back_addr":"172.21.15.73:6833/4224855400","heartbeat_front_addr":"172.21.15.73:6829/4224855400","state":["exists","up"]},{"osd":6,"uuid":"547e18d0-b0bf-4c6d-8b07-a10c6de0d499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6811","nonce":1918032406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6813","nonce":1918032406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6817","nonce":1918032406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1918032406},{"type":"v1","addr":"172.21.15.73:6815","nonce":1918032406}]},"public_addr":"172.21.15.73:6811/1918032406","cluster_addr":"172.21.15.73:6813/1918032406","heartbeat_back_addr":"172.21.15.73:6817/1918032406","heartbeat_front_addr":"172.21.15.73:6815/1918032406","state":["exists","up"]},{"osd":7,"uuid":"1c113f5b-e4ca-44ef-aedc-298f00621e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6803","nonce":2569604158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6805","nonce":2569604158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6809","nonce":2569604158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2569604158},{"type":"v1","addr":"172.21.15.73:6807","nonce":2569604158}]},"public_addr":"172.21.15.73:6803/2569604158","cluster_addr":"172.21.15.73:6805/2569604158","heartbeat_back_addr":"172.21.15.73:6809/2569604158","heartbeat_front_addr":"172.21.15.73:6807/2569604158","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.890599+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.817267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.197281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:18.180141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.693376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.770175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.777178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:49:17.682202+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f460806b500 msgr2=0x7f460806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f460806b500 0x7f460806d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4618000f60 tx=0x7f4618007a80 comp rx=0 tx=0).stop 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 msgr2=0x7f462815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 0x7f462815afa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4620037040 tx=0x7f4620004a40 comp rx=0 tx=0).stop 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 shutdown_connections 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f460806b500 0x7f460806d9c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462806d8c0 0x7f46280c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46280716f0 0x7f462815afa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 --2- 172.21.15.46:0/4041949392 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f462806d4e0 0x7f4628159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 >> 172.21.15.46:0/4041949392 conn(0x7f46280c88d0 msgr2=0x7f4628158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 shutdown_connections 2024-03-04T10:46:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:51.830+0000 7f462ca00640 1 -- 172.21.15.46:0/4041949392 wait complete. 2024-03-04T10:46:51.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-04T10:46:52.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.051+0000 7fd699a00640 1 Processor -- start 2024-03-04T10:46:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.051+0000 7fd699a00640 1 -- start start 2024-03-04T10:46:52.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.053+0000 7fd699a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd694072110 0x7fd6940cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.053+0000 7fd699a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940c9040 con 0x7fd69413db70 2024-03-04T10:46:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.053+0000 7fd699a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd694158410 con 0x7fd6940cc520 2024-03-04T10:46:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.053+0000 7fd699a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940cb870 con 0x7fd694072110 2024-03-04T10:46:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.054+0000 7fd693400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd694072110 0x7fd6940cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.054+0000 7fd693e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd69413db70 0x7fd6940c8930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33986/0 (socket says 172.21.15.46:33986) 2024-03-04T10:46:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.054+0000 7fd693e00640 1 -- 172.21.15.46:0/3382572158 learned_addr learned my addr 172.21.15.46:0/3382572158 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.054+0000 7fd699000640 1 --1- 172.21.15.46:0/3382572158 >> v1:172.21.15.73:6789/0 conn(0x7fd6940cc520 0x7fd6940c5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49708/0 (socket says 172.21.15.46:49708) 2024-03-04T10:46:52.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.057+0000 7fd693400640 1 -- 172.21.15.46:0/3382572158 >> v1:172.21.15.73:6789/0 conn(0x7fd6940cc520 legacy=0x7fd6940c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.057+0000 7fd693400640 1 -- 172.21.15.46:0/3382572158 >> v1:172.21.15.46:6789/0 conn(0x7fd69413db70 legacy=0x7fd6940c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.057+0000 7fd693400640 1 -- 172.21.15.46:0/3382572158 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6941586f0 con 0x7fd694072110 2024-03-04T10:46:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.063+0000 7fd693400640 1 --2- 172.21.15.46:0/3382572158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd694072110 0x7fd6940cbfe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6800097a0 tx=0x7fd68002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770a2cd11de1a9c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:52.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.067+0000 7fd692a00640 1 -- 172.21.15.46:0/3382572158 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680034070 con 0x7fd694072110 2024-03-04T10:46:52.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.067+0000 7fd692a00640 1 -- 172.21.15.46:0/3382572158 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd680030610 con 0x7fd694072110 2024-03-04T10:46:52.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.067+0000 7fd692a00640 1 -- 172.21.15.46:0/3382572158 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680030a00 con 0x7fd694072110 2024-03-04T10:46:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 -- 172.21.15.46:0/3382572158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd694072110 msgr2=0x7fd6940cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 --2- 172.21.15.46:0/3382572158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd694072110 0x7fd6940cbfe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6800097a0 tx=0x7fd68002b960 comp rx=0 tx=0).stop 2024-03-04T10:46:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 -- 172.21.15.46:0/3382572158 shutdown_connections 2024-03-04T10:46:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 --2- 172.21.15.46:0/3382572158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd694072110 0x7fd6940cbfe0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 -- 172.21.15.46:0/3382572158 >> 172.21.15.46:0/3382572158 conn(0x7fd69406f110 msgr2=0x7fd69406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 -- 172.21.15.46:0/3382572158 shutdown_connections 2024-03-04T10:46:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.068+0000 7fd699a00640 1 -- 172.21.15.46:0/3382572158 wait complete. 2024-03-04T10:46:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.071+0000 7fd699a00640 1 Processor -- start 2024-03-04T10:46:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.071+0000 7fd699a00640 1 -- start start 2024-03-04T10:46:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.072+0000 7fd699a00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd694072110 0x7fd6940c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.072+0000 7fd699a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6940cc520 0x7fd6941e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.072+0000 7fd699a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd69413db70 0x7fd6941f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.072+0000 7fd699a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694158cb0 con 0x7fd69413db70 2024-03-04T10:46:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.072+0000 7fd699a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940cbb50 con 0x7fd6940cc520 2024-03-04T10:46:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.072+0000 7fd699a00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69413df50 con 0x7fd694072110 2024-03-04T10:46:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.073+0000 7fd693400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6940cc520 0x7fd6941e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.073+0000 7fd693e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd694072110 0x7fd6940c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.073+0000 7fd699000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd69413db70 0x7fd6941f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.074+0000 7fd693400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6940cc520 0x7fd6941e3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35002/0 (socket says 172.21.15.46:35002) 2024-03-04T10:46:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.074+0000 7fd693400640 1 -- 172.21.15.46:0/1535588956 learned_addr learned my addr 172.21.15.46:0/1535588956 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:52.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.078+0000 7fd699000640 1 -- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd694072110 msgr2=0x7fd6940c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.078+0000 7fd699000640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd694072110 0x7fd6940c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.078+0000 7fd699000640 1 -- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6940cc520 msgr2=0x7fd6941e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.078+0000 7fd699000640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6940cc520 0x7fd6941e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.078+0000 7fd699000640 1 -- 172.21.15.46:0/1535588956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940c30c0 con 0x7fd69413db70 2024-03-04T10:46:52.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.081+0000 7fd699000640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd69413db70 0x7fd6941f3110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00c6f0 tx=0x7fd68c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:52.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.086+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c017070 con 0x7fd69413db70 2024-03-04T10:46:52.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.086+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd68c005da0 con 0x7fd69413db70 2024-03-04T10:46:52.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.086+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00a860 con 0x7fd69413db70 2024-03-04T10:46:52.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.086+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940c33a0 con 0x7fd69413db70 2024-03-04T10:46:52.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.086+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6941546a0 con 0x7fd69413db70 2024-03-04T10:46:52.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.088+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69404f410 con 0x7fd69413db70 2024-03-04T10:46:52.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.422+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd68c01a070 con 0x7fd69413db70 2024-03-04T10:46:52.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.423+0000 7fd68be00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd67406b500 0x7fd67406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:52.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.424+0000 7fd693e00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd67406b500 0x7fd67406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:52.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.424+0000 7fd693e00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd67406b500 0x7fd67406d9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd684005880 tx=0x7fd684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:52.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.450+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd68c056450 con 0x7fd69413db70 2024-03-04T10:46:52.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.451+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd68c021020 con 0x7fd69413db70 2024-03-04T10:46:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.734+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd69406c1c0 con 0x7fd69413db70 2024-03-04T10:46:52.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.834+0000 7fd68be00640 1 -- 172.21.15.46:0/1535588956 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd68c0583b0 con 0x7fd69413db70 2024-03-04T10:46:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-04T10:46:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.836+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd67406b500 msgr2=0x7fd67406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.836+0000 7fd699a00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd67406b500 0x7fd67406d9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd684005880 tx=0x7fd684009040 comp rx=0 tx=0).stop 2024-03-04T10:46:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.836+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd69413db70 msgr2=0x7fd6941f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.836+0000 7fd699a00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd69413db70 0x7fd6941f3110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00c6f0 tx=0x7fd68c00cbb0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 shutdown_connections 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd67406b500 0x7fd67406d9c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6940cc520 0x7fd6941e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd69413db70 0x7fd6941f3110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 --2- 172.21.15.46:0/1535588956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd694072110 0x7fd6940c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 >> 172.21.15.46:0/1535588956 conn(0x7fd69406f110 msgr2=0x7fd6940ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 shutdown_connections 2024-03-04T10:46:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:52.837+0000 7fd699a00640 1 -- 172.21.15.46:0/1535588956 wait complete. 2024-03-04T10:46:52.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-04T10:46:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.039+0000 7f5d93e00640 1 Processor -- start 2024-03-04T10:46:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.039+0000 7f5d93e00640 1 -- start start 2024-03-04T10:46:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.040+0000 7f5d93e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d940cd1b0 0x7f5d940ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.040+0000 7f5d93e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9415a5c0 con 0x7f5d94154900 2024-03-04T10:46:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.040+0000 7f5d93e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940ca5c0 con 0x7f5d940cf0f0 2024-03-04T10:46:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.040+0000 7f5d93e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9415b490 con 0x7f5d940cd1b0 2024-03-04T10:46:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.042+0000 7f5d92000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d940cd1b0 0x7f5d940ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.042+0000 7f5d92a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5d94154900 0x7f5d9415ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34000/0 (socket says 172.21.15.46:34000) 2024-03-04T10:46:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.043+0000 7f5d92a00640 1 -- 172.21.15.46:0/515621079 learned_addr learned my addr 172.21.15.46:0/515621079 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:53.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.047+0000 7f5d92000640 1 -- 172.21.15.46:0/515621079 >> v1:172.21.15.73:6789/0 conn(0x7f5d940cf0f0 legacy=0x7f5d94164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:53.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.047+0000 7f5d92000640 1 -- 172.21.15.46:0/515621079 >> v1:172.21.15.46:6789/0 conn(0x7f5d94154900 legacy=0x7f5d9415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:53.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.047+0000 7f5d92000640 1 -- 172.21.15.46:0/515621079 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940ca8a0 con 0x7f5d940cd1b0 2024-03-04T10:46:53.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.053+0000 7f5d92000640 1 --2- 172.21.15.46:0/515621079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cd1b0 0x7f5d940ce090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d800097a0 tx=0x7f5d8002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a48c69c96ea4cc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:53.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.058+0000 7f5d91600640 1 -- 172.21.15.46:0/515621079 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035020 con 0x7f5d940cd1b0 2024-03-04T10:46:53.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.058+0000 7f5d91600640 1 -- 172.21.15.46:0/515621079 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d80031830 con 0x7f5d940cd1b0 2024-03-04T10:46:53.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.058+0000 7f5d91600640 1 -- 172.21.15.46:0/515621079 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80031c20 con 0x7f5d940cd1b0 2024-03-04T10:46:53.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 -- 172.21.15.46:0/515621079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cd1b0 msgr2=0x7f5d940ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 --2- 172.21.15.46:0/515621079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cd1b0 0x7f5d940ce090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d800097a0 tx=0x7f5d8002b8d0 comp rx=0 tx=0).stop 2024-03-04T10:46:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 -- 172.21.15.46:0/515621079 shutdown_connections 2024-03-04T10:46:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 --2- 172.21.15.46:0/515621079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cd1b0 0x7f5d940ce090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 -- 172.21.15.46:0/515621079 >> 172.21.15.46:0/515621079 conn(0x7f5d940b15b0 msgr2=0x7f5d940b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 -- 172.21.15.46:0/515621079 shutdown_connections 2024-03-04T10:46:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.059+0000 7f5d93e00640 1 -- 172.21.15.46:0/515621079 wait complete. 2024-03-04T10:46:53.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.062+0000 7f5d93e00640 1 Processor -- start 2024-03-04T10:46:53.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.062+0000 7f5d93e00640 1 -- start start 2024-03-04T10:46:53.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.063+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 0x7f5d940b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:53.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.063+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cf0f0 0x7f5d9414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:53.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.063+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d94154900 0x7f5d940c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:53.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.063+0000 7f5d93e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9406c5c0 con 0x7f5d940cf0f0 2024-03-04T10:46:53.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.063+0000 7f5d93e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940cab80 con 0x7f5d940cd1b0 2024-03-04T10:46:53.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.063+0000 7f5d93e00640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940c9730 con 0x7f5d94154900 2024-03-04T10:46:53.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.064+0000 7f5d92a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 0x7f5d940b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:53.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.064+0000 7f5d93400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d94154900 0x7f5d940c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:53.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.065+0000 7f5d92a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 0x7f5d940b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35006/0 (socket says 172.21.15.46:35006) 2024-03-04T10:46:53.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.065+0000 7f5d92a00640 1 -- 172.21.15.46:0/3710632232 learned_addr learned my addr 172.21.15.46:0/3710632232 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:53.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.068+0000 7f5d92a00640 1 -- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d94154900 msgr2=0x7f5d940c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:53.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.068+0000 7f5d92a00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d94154900 0x7f5d940c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:53.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.068+0000 7f5d92a00640 1 -- 172.21.15.46:0/3710632232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cf0f0 msgr2=0x7f5d9414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:53.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.068+0000 7f5d92a00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cf0f0 0x7f5d9414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:53.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.068+0000 7f5d92a00640 1 -- 172.21.15.46:0/3710632232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940c65f0 con 0x7f5d940cd1b0 2024-03-04T10:46:53.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.070+0000 7f5d92a00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 0x7f5d940b3b70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c3c0 tx=0x7f5d8400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:53.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.075+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84017070 con 0x7f5d940cd1b0 2024-03-04T10:46:53.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.075+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d84005da0 con 0x7f5d940cd1b0 2024-03-04T10:46:53.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.075+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84007310 con 0x7f5d940cd1b0 2024-03-04T10:46:53.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.075+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d940b2840 con 0x7f5d940cd1b0 2024-03-04T10:46:53.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.075+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d940b2e00 con 0x7f5d940cd1b0 2024-03-04T10:46:53.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.076+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d940682c0 con 0x7f5d940cd1b0 2024-03-04T10:46:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.395+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d8401a070 con 0x7f5d940cd1b0 2024-03-04T10:46:53.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.398+0000 7f5d8aa00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5d7406b520 0x7f5d7406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.398+0000 7f5d92000640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5d7406b520 0x7f5d7406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.399+0000 7f5d92000640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5d7406b520 0x7f5d7406d9e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5d80036000 tx=0x7f5d80030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.400+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6168+0+0 (secure 0 0 0) 0x7f5d84056330 con 0x7f5d940cd1b0 2024-03-04T10:46:53.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.419+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5d84021020 con 0x7f5d940cd1b0 2024-03-04T10:46:53.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:53.669+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d9404f410 con 0x7f5d940cd1b0 2024-03-04T10:46:54.021 INFO:tasks.ceph.mds.b.smithi073.stderr:==00:01:57:31.063 44428== 2024-03-04T10:46:54.021 INFO:tasks.ceph.mds.b.smithi073.stderr:==00:01:57:31.063 44428== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:46:54.113 INFO:tasks.ceph.mds.f.smithi073.stderr:==00:01:57:31.147 44430== 2024-03-04T10:46:54.113 INFO:tasks.ceph.mds.f.smithi073.stderr:==00:01:57:31.147 44430== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:46:54.156 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:01:57:31.194 44429== 2024-03-04T10:46:54.156 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:01:57:31.194 44429== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:46:54.219 INFO:tasks.ceph.mds.c.smithi046.stderr:==00:01:57:31.182 41780== 2024-03-04T10:46:54.219 INFO:tasks.ceph.mds.c.smithi046.stderr:==00:01:57:31.182 41780== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:46:54.220 INFO:tasks.ceph.mds.b.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:46:54.220 INFO:tasks.ceph.mds.d.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:46:54.303 INFO:tasks.ceph.mds.c.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:46:54.315 INFO:tasks.ceph.mds.f.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:46:54.343 INFO:tasks.ceph.mds.e.smithi046.stderr:==00:01:57:31.291 41781== 2024-03-04T10:46:54.343 INFO:tasks.ceph.mds.e.smithi046.stderr:==00:01:57:31.291 41781== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:46:54.515 INFO:tasks.ceph.mds.e.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:46:54.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-03-04T10:46:54.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-03-04T10:46:54.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-03-04T10:46:54.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.724+0000 7f5d8aa00640 1 -- 172.21.15.46:0/3710632232 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5d84058290 con 0x7f5d940cd1b0 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5d7406b520 msgr2=0x7f5d7406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5d7406b520 0x7f5d7406d9e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5d80036000 tx=0x7f5d80030000 comp rx=0 tx=0).stop 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 msgr2=0x7f5d940b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 0x7f5d940b3b70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c3c0 tx=0x7f5d8400c880 comp rx=0 tx=0).stop 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 shutdown_connections 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7f5d7406b520 0x7f5d7406d9e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d94154900 0x7f5d940c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cf0f0 0x7f5d9414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 --2- 172.21.15.46:0/3710632232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d940cd1b0 0x7f5d940b3b70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 >> 172.21.15.46:0/3710632232 conn(0x7f5d940b15b0 msgr2=0x7f5d9414dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:54.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 shutdown_connections 2024-03-04T10:46:54.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.728+0000 7f5d93e00640 1 -- 172.21.15.46:0/3710632232 wait complete. 2024-03-04T10:46:54.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-04T10:46:54.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.968+0000 7fbd3e000640 1 Processor -- start 2024-03-04T10:46:54.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.969+0000 7fbd3e000640 1 -- start start 2024-03-04T10:46:54.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.970+0000 7fbd3e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbd380cde40 0x7fbd380ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:54.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.970+0000 7fbd3e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380b21e0 0x7fbd380cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:54.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.970+0000 7fbd3e000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd380ce470 con 0x7fbd38154630 2024-03-04T10:46:54.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.970+0000 7fbd3e000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd380ca630 con 0x7fbd380cde40 2024-03-04T10:46:54.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.970+0000 7fbd3e000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380ca910 con 0x7fbd380b21e0 2024-03-04T10:46:54.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.971+0000 7fbd3d600640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380b21e0 0x7fbd380cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:54.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.971+0000 7fbd37e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbd380cde40 0x7fbd380ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:54.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.971+0000 7fbd3cc00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbd38154630 0x7fbd3815a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:49724/0 (socket says 172.21.15.46:49724) 2024-03-04T10:46:54.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.971+0000 7fbd3cc00640 1 -- 172.21.15.46:0/1190721882 learned_addr learned my addr 172.21.15.46:0/1190721882 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-03-04T10:46:54.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.973+0000 7fbd3d600640 1 -- 172.21.15.46:0/1190721882 >> v2:172.21.15.73:3300/0 conn(0x7fbd380cde40 msgr2=0x7fbd380ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:54.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.973+0000 7fbd3d600640 1 --2- 172.21.15.46:0/1190721882 >> v2:172.21.15.73:3300/0 conn(0x7fbd380cde40 0x7fbd380ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.973+0000 7fbd3d600640 1 -- 172.21.15.46:0/1190721882 >> v1:172.21.15.73:6789/0 conn(0x7fbd38154630 legacy=0x7fbd3815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:54.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.973+0000 7fbd3d600640 1 -- 172.21.15.46:0/1190721882 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38154a10 con 0x7fbd380b21e0 2024-03-04T10:46:54.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.976+0000 7fbd3d600640 1 --2- 172.21.15.46:0/1190721882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380b21e0 0x7fbd380cf2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009d90 tx=0x7fbd3002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45992fbb01b5cb0b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.980+0000 7fbd37400640 1 -- 172.21.15.46:0/1190721882 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30039070 con 0x7fbd380b21e0 2024-03-04T10:46:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.980+0000 7fbd37400640 1 -- 172.21.15.46:0/1190721882 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd3002cce0 con 0x7fbd380b21e0 2024-03-04T10:46:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.980+0000 7fbd37400640 1 -- 172.21.15.46:0/1190721882 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30034680 con 0x7fbd380b21e0 2024-03-04T10:46:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.980+0000 7fbd3e000640 1 -- 172.21.15.46:0/1190721882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380b21e0 msgr2=0x7fbd380cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.980+0000 7fbd3e000640 1 --2- 172.21.15.46:0/1190721882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380b21e0 0x7fbd380cf2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009d90 tx=0x7fbd3002bf30 comp rx=0 tx=0).stop 2024-03-04T10:46:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.981+0000 7fbd3e000640 1 -- 172.21.15.46:0/1190721882 shutdown_connections 2024-03-04T10:46:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.981+0000 7fbd3e000640 1 --2- 172.21.15.46:0/1190721882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380b21e0 0x7fbd380cf2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.981+0000 7fbd3e000640 1 --2- 172.21.15.46:0/1190721882 >> v2:172.21.15.73:3300/0 conn(0x7fbd380cde40 0x7fbd380ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.981+0000 7fbd3e000640 1 -- 172.21.15.46:0/1190721882 >> 172.21.15.46:0/1190721882 conn(0x7fbd38067270 msgr2=0x7fbd380b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:54.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.981+0000 7fbd3e000640 1 -- 172.21.15.46:0/1190721882 shutdown_connections 2024-03-04T10:46:54.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.981+0000 7fbd3e000640 1 -- 172.21.15.46:0/1190721882 wait complete. 2024-03-04T10:46:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.983+0000 7fbd3e000640 1 Processor -- start 2024-03-04T10:46:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.983+0000 7fbd3e000640 1 -- start start 2024-03-04T10:46:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.984+0000 7fbd3e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 0x7fbd3806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.984+0000 7fbd3e000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380cde40 0x7fbd380c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.984+0000 7fbd3e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd38154630 0x7fbd380c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.984+0000 7fbd3e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3815b260 con 0x7fbd38154630 2024-03-04T10:46:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.984+0000 7fbd3e000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3815b0e0 con 0x7fbd380b21e0 2024-03-04T10:46:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.984+0000 7fbd3e000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380ce820 con 0x7fbd380cde40 2024-03-04T10:46:54.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.985+0000 7fbd3cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 0x7fbd3806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:54.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.985+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380cde40 0x7fbd380c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:54.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.985+0000 7fbd3cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 0x7fbd3806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35020/0 (socket says 172.21.15.46:35020) 2024-03-04T10:46:54.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.985+0000 7fbd3cc00640 1 -- 172.21.15.46:0/2059880281 learned_addr learned my addr 172.21.15.46:0/2059880281 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:54.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.985+0000 7fbd3d600640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd38154630 0x7fbd380c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.988+0000 7fbd3cc00640 1 -- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380cde40 msgr2=0x7fbd380c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.988+0000 7fbd3cc00640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380cde40 0x7fbd380c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.988+0000 7fbd3cc00640 1 -- 172.21.15.46:0/2059880281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd38154630 msgr2=0x7fbd380c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.988+0000 7fbd3cc00640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd38154630 0x7fbd380c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.988+0000 7fbd3cc00640 1 -- 172.21.15.46:0/2059880281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380c2d50 con 0x7fbd380b21e0 2024-03-04T10:46:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.991+0000 7fbd3cc00640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 0x7fbd3806cdd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c420 tx=0x7fbd2800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:54.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.995+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28017070 con 0x7fbd380b21e0 2024-03-04T10:46:54.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.995+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd28005ce0 con 0x7fbd380b21e0 2024-03-04T10:46:55.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.995+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28007310 con 0x7fbd380b21e0 2024-03-04T10:46:55.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.995+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3814f680 con 0x7fbd380b21e0 2024-03-04T10:46:55.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.995+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3806d310 con 0x7fbd380b21e0 2024-03-04T10:46:55.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:54.996+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38150070 con 0x7fbd380b21e0 2024-03-04T10:46:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.017+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd2801a070 con 0x7fbd380b21e0 2024-03-04T10:46:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.019+0000 7fbd34c00640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbd1406b520 0x7fbd1406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.019+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6168+0+0 (secure 0 0 0) 0x7fbd280899c0 con 0x7fbd380b21e0 2024-03-04T10:46:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.019+0000 7fbd37e00640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbd1406b520 0x7fbd1406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.020+0000 7fbd37e00640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbd1406b520 0x7fbd1406d9e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd3814f490 tx=0x7fbd20009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.256+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd28021020 con 0x7fbd380b21e0 2024-03-04T10:46:55.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:55.492+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd380680b0 con 0x7fbd380b21e0 2024-03-04T10:46:56.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.082+0000 7fbd34c00640 1 -- 172.21.15.46:0/2059880281 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbd28058100 con 0x7fbd380b21e0 2024-03-04T10:46:56.088 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-03-04T10:46:56.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbd1406b520 msgr2=0x7fbd1406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:56.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbd1406b520 0x7fbd1406d9e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd3814f490 tx=0x7fbd20009190 comp rx=0 tx=0).stop 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 msgr2=0x7fbd3806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 0x7fbd3806cdd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c420 tx=0x7fbd2800c8e0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 shutdown_connections 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fbd1406b520 0x7fbd1406d9e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd38154630 0x7fbd380c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd380cde40 0x7fbd380c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 --2- 172.21.15.46:0/2059880281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd380b21e0 0x7fbd3806cdd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 >> 172.21.15.46:0/2059880281 conn(0x7fbd38067270 msgr2=0x7fbd380cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 shutdown_connections 2024-03-04T10:46:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.086+0000 7fbd3e000640 1 -- 172.21.15.46:0/2059880281 wait complete. 2024-03-04T10:46:56.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-04T10:46:56.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.309+0000 7fd262000640 1 Processor -- start 2024-03-04T10:46:56.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.310+0000 7fd262000640 1 -- start start 2024-03-04T10:46:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.311+0000 7fd262000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c152250 0x7fd25c0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.311+0000 7fd262000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd25c06f8a0 0x7fd25c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.311+0000 7fd262000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd25c158cf0 0x7fd25c0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.311+0000 7fd262000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c15bab0 con 0x7fd25c06f8a0 2024-03-04T10:46:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.311+0000 7fd262000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c15bd90 con 0x7fd25c158cf0 2024-03-04T10:46:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.311+0000 7fd262000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c15c070 con 0x7fd25c152250 2024-03-04T10:46:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.312+0000 7fd25be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd25c158cf0 0x7fd25c0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.312+0000 7fd25b400640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c152250 0x7fd25c0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.312+0000 7fd253e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd25c06f8a0 0x7fd25c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.312+0000 7fd25be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd25c158cf0 0x7fd25c0c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35036/0 (socket says 172.21.15.46:35036) 2024-03-04T10:46:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.312+0000 7fd25be00640 1 -- 172.21.15.46:0/81590801 learned_addr learned my addr 172.21.15.46:0/81590801 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:56.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.315+0000 7fd25b400640 1 -- 172.21.15.46:0/81590801 >> v2:172.21.15.73:3300/0 conn(0x7fd25c158cf0 msgr2=0x7fd25c0c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:56.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.315+0000 7fd25b400640 1 --2- 172.21.15.46:0/81590801 >> v2:172.21.15.73:3300/0 conn(0x7fd25c158cf0 0x7fd25c0c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.315+0000 7fd25b400640 1 -- 172.21.15.46:0/81590801 >> v2:172.21.15.46:3300/0 conn(0x7fd25c06f8a0 msgr2=0x7fd25c1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T10:46:56.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.315+0000 7fd25b400640 1 --2- 172.21.15.46:0/81590801 >> v2:172.21.15.46:3300/0 conn(0x7fd25c06f8a0 0x7fd25c1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.315+0000 7fd25b400640 1 -- 172.21.15.46:0/81590801 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c15c350 con 0x7fd25c152250 2024-03-04T10:46:56.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.317+0000 7fd25b400640 1 --2- 172.21.15.46:0/81590801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c152250 0x7fd25c0c6d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0c2410 tx=0x7fd24c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9d76e4195c0d07 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:56.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd25aa00640 1 -- 172.21.15.46:0/81590801 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c035020 con 0x7fd25c152250 2024-03-04T10:46:56.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd25aa00640 1 -- 172.21.15.46:0/81590801 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd24c031830 con 0x7fd25c152250 2024-03-04T10:46:56.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd25aa00640 1 -- 172.21.15.46:0/81590801 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c031c20 con 0x7fd25c152250 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 -- 172.21.15.46:0/81590801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c152250 msgr2=0x7fd25c0c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 --2- 172.21.15.46:0/81590801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c152250 0x7fd25c0c6d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0c2410 tx=0x7fd24c02b8d0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 -- 172.21.15.46:0/81590801 shutdown_connections 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 --2- 172.21.15.46:0/81590801 >> v2:172.21.15.73:3300/0 conn(0x7fd25c158cf0 0x7fd25c0c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 --2- 172.21.15.46:0/81590801 >> v2:172.21.15.46:3300/0 conn(0x7fd25c06f8a0 0x7fd25c1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 --2- 172.21.15.46:0/81590801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c152250 0x7fd25c0c6d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.321+0000 7fd262000640 1 -- 172.21.15.46:0/81590801 >> 172.21.15.46:0/81590801 conn(0x7fd25c06aff0 msgr2=0x7fd25c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:56.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.322+0000 7fd262000640 1 -- 172.21.15.46:0/81590801 shutdown_connections 2024-03-04T10:46:56.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.322+0000 7fd262000640 1 -- 172.21.15.46:0/81590801 wait complete. 2024-03-04T10:46:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.323+0000 7fd262000640 1 Processor -- start 2024-03-04T10:46:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.323+0000 7fd262000640 1 -- start start 2024-03-04T10:46:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.324+0000 7fd262000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd25c06f8a0 0x7fd25c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.324+0000 7fd262000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 0x7fd25c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.324+0000 7fd262000640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c158cf0 0x7fd25c1efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.324+0000 7fd262000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c06fe40 con 0x7fd25c06f8a0 2024-03-04T10:46:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.324+0000 7fd262000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c06fcc0 con 0x7fd25c152250 2024-03-04T10:46:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.324+0000 7fd262000640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c152630 con 0x7fd25c158cf0 2024-03-04T10:46:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.325+0000 7fd253e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 0x7fd25c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.325+0000 7fd25be00640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c158cf0 0x7fd25c1efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.325+0000 7fd25b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd25c06f8a0 0x7fd25c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.325+0000 7fd253e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 0x7fd25c156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:35038/0 (socket says 172.21.15.46:35038) 2024-03-04T10:46:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.325+0000 7fd253e00640 1 -- 172.21.15.46:0/4174974298 learned_addr learned my addr 172.21.15.46:0/4174974298 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-03-04T10:46:56.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.329+0000 7fd253e00640 1 -- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c158cf0 msgr2=0x7fd25c1efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:56.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.329+0000 7fd253e00640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c158cf0 0x7fd25c1efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.329+0000 7fd253e00640 1 -- 172.21.15.46:0/4174974298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd25c06f8a0 msgr2=0x7fd25c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:56.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.329+0000 7fd253e00640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd25c06f8a0 0x7fd25c14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:56.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.329+0000 7fd253e00640 1 -- 172.21.15.46:0/4174974298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0cc600 con 0x7fd25c152250 2024-03-04T10:46:56.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.331+0000 7fd253e00640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 0x7fd25c156160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd24400e870 tx=0x7fd24400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:56.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.333+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244017070 con 0x7fd25c152250 2024-03-04T10:46:56.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.333+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c1f3460 con 0x7fd25c152250 2024-03-04T10:46:56.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.333+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c1f39e0 con 0x7fd25c152250 2024-03-04T10:46:56.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.334+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c067b00 con 0x7fd25c152250 2024-03-04T10:46:56.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.335+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd24400ee60 con 0x7fd25c152250 2024-03-04T10:46:56.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.335+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244021060 con 0x7fd25c152250 2024-03-04T10:46:56.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.599+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd24401a070 con 0x7fd25c152250 2024-03-04T10:46:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.601+0000 7fd253400640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd23806b4d0 0x7fd23806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T10:46:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.602+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5730+0+0 (secure 0 0 0) 0x7fd24408a5a0 con 0x7fd25c152250 2024-03-04T10:46:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.602+0000 7fd25b400640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd23806b4d0 0x7fd23806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T10:46:56.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.603+0000 7fd25b400640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd23806b4d0 0x7fd23806d990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd24c036000 tx=0x7fd24c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T10:46:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.609+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd244058d00 con 0x7fd25c152250 2024-03-04T10:46:56.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:56.817+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd25c0680b0 con 0x7fd25c152250 2024-03-04T10:46:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.414+0000 7fd253400640 1 -- 172.21.15.46:0/4174974298 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd24405cda0 con 0x7fd25c152250 2024-03-04T10:46:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-03-04T10:46:57.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd23806b4d0 msgr2=0x7fd23806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd23806b4d0 0x7fd23806d990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd24c036000 tx=0x7fd24c03c040 comp rx=0 tx=0).stop 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 msgr2=0x7fd25c156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 0x7fd25c156160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd24400e870 tx=0x7fd24400ed30 comp rx=0 tx=0).stop 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 shutdown_connections 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:6800/3189456460,v1:172.21.15.73:6801/3189456460] conn(0x7fd23806b4d0 0x7fd23806d990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c152250 0x7fd25c156160 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd25c158cf0 0x7fd25c1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 --2- 172.21.15.46:0/4174974298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd25c06f8a0 0x7fd25c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 >> 172.21.15.46:0/4174974298 conn(0x7fd25c06aff0 msgr2=0x7fd25c0c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 shutdown_connections 2024-03-04T10:46:57.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-04T10:46:57.418+0000 7fd262000640 1 -- 172.21.15.46:0/4174974298 wait complete. 2024-03-04T10:46:57.444 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-04T10:46:57.445 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-04T10:46:57.445 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:46:57.465 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-03-04T10:46:57.446+0000 b5f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 41769) UID: 0 2024-03-04T10:46:57.467 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-03-04T10:46:57.448+0000 b5f1640 -1 mds.a *** got signal Terminated *** 2024-03-04T10:47:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-03-04T10:47:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-03-04T10:47:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-03-04T10:47:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-03-04T10:47:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-03-04T10:47:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2024-03-04T10:47:03.546 INFO:tasks.ceph.mds.a:Stopped 2024-03-04T10:47:03.546 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-04T10:47:03.547 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:03.547 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:47:03.547 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2024-03-04T10:47:03.548 INFO:tasks.ceph.mds.c:Stopped 2024-03-04T10:47:03.548 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-04T10:47:03.548 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:03.548 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:47:03.549 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-03-04T10:47:03.549 INFO:tasks.ceph.mds.e:Stopped 2024-03-04T10:47:03.549 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-04T10:47:03.549 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:03.549 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:47:03.549 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2024-03-04T10:47:03.550 INFO:tasks.ceph.mds.b:Stopped 2024-03-04T10:47:03.550 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-04T10:47:03.550 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:03.550 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:47:03.550 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-03-04T10:47:03.550 INFO:tasks.ceph.mds.d:Stopped 2024-03-04T10:47:03.550 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-03-04T10:47:03.550 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:03.550 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:47:03.551 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2024-03-04T10:47:03.551 INFO:tasks.ceph.mds.f:Stopped 2024-03-04T10:47:03.551 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-04T10:47:03.551 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-04T10:47:03.551 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:03.553 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-04T10:47:03.550+0000 7f8bee000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37883) UID: 0 2024-03-04T10:47:03.553 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-04T10:47:03.550+0000 7f8bee000640 -1 osd.0 29 *** Got signal Terminated *** 2024-03-04T10:47:07.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-04T10:47:07.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-03-04T10:47:07.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-03-04T10:47:07.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-03-04T10:47:07.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-03-04T10:47:07.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-03-04T10:47:07.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-03-04T10:47:09.307 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:58:20.108 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.313 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:58:20.177 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.316 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:58:20.180 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.318 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:58:20.183 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.322 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:58:20.186 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.327 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:58:20.127 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.350 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:58:20.214 38202== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.350 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:58:20.214 38201== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.533 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:58:20.333 37613== Warning: unimplemented fcntl command: 1036 2024-03-04T10:47:09.652 INFO:tasks.ceph.osd.0:Stopped 2024-03-04T10:47:09.653 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-04T10:47:09.653 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:09.655 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-04T10:47:09.652+0000 7f120fa00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37886) UID: 0 2024-03-04T10:47:09.655 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-04T10:47:09.652+0000 7f120fa00640 -1 osd.1 30 *** Got signal Terminated *** 2024-03-04T10:47:11.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:47:11.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:47:11.533 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T10:47:11.530+0000 7face5711640 -1 calc_pg_upmaps abort due to max <= 0 2024-03-04T10:47:13.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-04T10:47:13.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-04T10:47:15.755 INFO:tasks.ceph.osd.1:Stopped 2024-03-04T10:47:15.755 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-04T10:47:15.755 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:15.757 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T10:47:15.753+0000 7f97ab000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37889) UID: 0 2024-03-04T10:47:15.757 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-04T10:47:15.753+0000 7f97ab000640 -1 osd.2 32 *** Got signal Terminated *** 2024-03-04T10:47:19.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-04T10:47:19.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-04T10:47:21.858 INFO:tasks.ceph.osd.2:Stopped 2024-03-04T10:47:21.858 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-04T10:47:21.859 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:21.860 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-04T10:47:21.856+0000 7f40b7c00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37890) UID: 0 2024-03-04T10:47:21.861 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-04T10:47:21.856+0000 7f40b7c00640 -1 osd.3 33 *** Got signal Terminated *** 2024-03-04T10:47:25.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-04T10:47:25.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-04T10:47:27.960 INFO:tasks.ceph.osd.3:Stopped 2024-03-04T10:47:27.961 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-04T10:47:27.961 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:27.962 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-03-04T10:47:27.958+0000 7fbc6a620640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 38871) UID: 0 2024-03-04T10:47:27.962 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-03-04T10:47:27.958+0000 7fbc6a620640 -1 osd.4 34 *** Got signal Terminated *** 2024-03-04T10:47:30.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-04T10:47:30.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-04T10:47:34.062 INFO:tasks.ceph.osd.4:Stopped 2024-03-04T10:47:34.063 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-04T10:47:34.063 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:34.064 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T10:47:34.060+0000 7f5eac835640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 38874) UID: 0 2024-03-04T10:47:34.064 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-03-04T10:47:34.060+0000 7f5eac835640 -1 osd.5 35 *** Got signal Terminated *** 2024-03-04T10:47:36.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-04T10:47:40.164 INFO:tasks.ceph.osd.5:Stopped 2024-03-04T10:47:40.164 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-04T10:47:40.165 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:40.165 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-03-04T10:47:40.162+0000 7fb9b1a89640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 38876) UID: 0 2024-03-04T10:47:40.166 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-03-04T10:47:40.162+0000 7fb9b1a89640 -1 osd.6 36 *** Got signal Terminated *** 2024-03-04T10:47:41.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:47:41.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:47:42.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-04T10:47:46.268 INFO:tasks.ceph.osd.6:Stopped 2024-03-04T10:47:46.269 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-04T10:47:46.269 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:46.270 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-03-04T10:47:46.266+0000 7f27e1375640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 38878) UID: 0 2024-03-04T10:47:46.270 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-03-04T10:47:46.266+0000 7f27e1375640 -1 osd.7 36 *** Got signal Terminated *** 2024-03-04T10:47:47.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-04T10:47:47.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-04T10:47:52.371 INFO:tasks.ceph.osd.7:Stopped 2024-03-04T10:47:52.372 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-04T10:47:52.372 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-04T10:47:52.372 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:53.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-04T10:47:53.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-04T10:47:58.475 INFO:tasks.ceph.mgr.y:Stopped 2024-03-04T10:47:58.475 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-04T10:47:58.475 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:58.476 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-03-04T10:47:58.473+0000 7fad45a64640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 38199) UID: 0 2024-03-04T10:47:58.503 INFO:tasks.ceph.mgr.x:Stopped 2024-03-04T10:47:58.503 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-04T10:47:58.504 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-04T10:47:58.504 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:47:58.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-04T10:47:58.568 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-03-04T10:47:58.531+0000 9f9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 37606) UID: 0 2024-03-04T10:47:58.569 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-03-04T10:47:58.536+0000 9f9a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-04T10:47:59.685 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:59:10.485 37613== 2024-03-04T10:47:59.685 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:01:59:10.485 37613== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:47:59.744 INFO:tasks.ceph.mon.a.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:48:03.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-04T10:48:04.605 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:48:04.606 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-03-04T10:48:04.606 INFO:tasks.ceph.mon.a:Stopped 2024-03-04T10:48:04.607 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-04T10:48:04.607 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:48:04.623 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-03-04T10:48:04.608+0000 9f9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 38194) UID: 0 2024-03-04T10:48:04.623 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-03-04T10:48:04.610+0000 9f9a640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-03-04T10:48:05.149 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:59:16.013 38201== 2024-03-04T10:48:05.149 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:01:59:16.013 38201== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:48:05.160 INFO:tasks.ceph.mon.b.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:48:08.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-03-04T10:48:08.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-04T10:48:10.707 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:48:10.708 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-03-04T10:48:10.708 INFO:tasks.ceph.mon.b:Stopped 2024-03-04T10:48:10.708 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-04T10:48:10.708 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T10:48:10.724 INFO:tasks.ceph.mon.c.smithi073.stderr:2024-03-04T10:48:10.709+0000 9f9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 38196) UID: 0 2024-03-04T10:48:10.724 INFO:tasks.ceph.mon.c.smithi073.stderr:2024-03-04T10:48:10.711+0000 9f9a640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-03-04T10:48:11.272 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:59:22.137 38202== 2024-03-04T10:48:11.273 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:59:22.137 38202== Exit program on first error (--exit-on-first-error=yes) 2024-03-04T10:48:11.283 INFO:tasks.ceph.mon.c.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-03-04T10:48:11.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:48:11.498 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:48:13.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-04T10:48:13.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-03-04T10:48:16.809 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-04T10:48:16.810 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-03-04T10:48:16.810 INFO:tasks.ceph.mon.c:Stopped 2024-03-04T10:48:16.810 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-04T10:48:16.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-03-04T10:48:16.922 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T10:48:16.922 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-04T10:48:17.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T10:48:17.162 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-04T10:48:17.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T10:48:17.307 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-04T10:48:17.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T10:48:17.505 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-04T10:48:17.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T10:48:17.664 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-04T10:48:17.830 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T10:48:17.830 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-04T10:48:17.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T10:48:17.901 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-04T10:48:17.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T10:48:17.966 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-04T10:48:18.023 INFO:tasks.ceph:Archiving mon data... 2024-03-04T10:48:18.025 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/data/mon.a.tgz 2024-03-04T10:48:18.025 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-03-04T10:48:18.085 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.uXhNe7LiF4 2024-03-04T10:48:18.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uXhNe7LiF4 2024-03-04T10:48:18.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.uXhNe7LiF4 2024-03-04T10:48:18.413 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.uXhNe7LiF4 is 343KB 2024-03-04T10:48:18.524 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.uXhNe7LiF4 2024-03-04T10:48:18.583 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/data/mon.b.tgz 2024-03-04T10:48:18.583 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-04T10:48:18.602 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.dV1GTjoHKW 2024-03-04T10:48:18.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dV1GTjoHKW 2024-03-04T10:48:18.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.dV1GTjoHKW 2024-03-04T10:48:18.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-04T10:48:18.831 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.dV1GTjoHKW is 351KB 2024-03-04T10:48:18.928 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.dV1GTjoHKW 2024-03-04T10:48:18.942 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/data/mon.c.tgz 2024-03-04T10:48:18.943 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-04T10:48:18.997 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Nw4ftDYyct 2024-03-04T10:48:18.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Nw4ftDYyct 2024-03-04T10:48:19.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Nw4ftDYyct 2024-03-04T10:48:19.203 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Nw4ftDYyct is 351KB 2024-03-04T10:48:19.298 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Nw4ftDYyct 2024-03-04T10:48:19.311 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-04T10:48:19.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T10:48:19.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T10:48:19.733 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-04T10:48:20.004 INFO:tasks.ceph:Archiving crash dumps... 2024-03-04T10:48:20.007 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/remote/smithi046/crash 2024-03-04T10:48:20.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T10:48:20.110 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/remote/smithi073/crash 2024-03-04T10:48:20.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T10:48:20.136 INFO:tasks.ceph:Shutting down logrotate 2024-03-04T10:48:20.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:48:20.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T10:48:20.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-04T10:48:20.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-04T10:48:20.410 INFO:tasks.ceph:Compressing logs... 2024-03-04T10:48:20.410 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T10:48:20.418 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T10:48:20.483 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38780.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.38780.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38473.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38780.log.gz 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mon.c.log: /var/log/ceph/valgrind/mds.f.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-03-04T10:48:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mds.d.log: 69.5% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38604.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38515.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1%/var/log/ceph/ceph-osd.4.log: -- replaced with /var/log/ceph/ceph-client.admin.38604.log.gz 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38515.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38515.log.gz/var/log/ceph/ceph-osd.7.log: 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38433.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38433.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-04T10:48:20.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9%/var/log/ceph/ceph-mds.f.log: -- replaced with /var/log/ceph/ceph-client.admin.38433.log.gz 2024-03-04T10:48:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-03-04T10:48:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T10:48:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38393.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-03-04T10:48:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-04T10:48:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-04T10:48:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: 94.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T10:48:20.508 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50869.log 2024-03-04T10:48:20.510 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-04T10:48:20.511 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50869.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50869.log.gz 2024-03-04T10:48:20.511 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2024-03-04T10:48:20.513 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38737.log 2024-03-04T10:48:20.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31538.log 2024-03-04T10:48:20.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50785.log 2024-03-04T10:48:20.514 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2024-03-04T10:48:20.515 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.31538.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31538.log.gz 2024-03-04T10:48:20.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51570.log 2024-03-04T10:48:20.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43065.log 2024-03-04T10:48:20.516 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50785.log.gz 2024-03-04T10:48:20.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51570.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51570.log.gz 2024-03-04T10:48:20.517 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42294.log 2024-03-04T10:48:20.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-03-04T10:48:20.519 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2024-03-04T10:48:20.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51443.log 2024-03-04T10:48:20.520 INFO:teuthology.orchestra.run.smithi046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42294.log.gz 2024-03-04T10:48:20.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44144.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2024-03-04T10:48:20.522 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51317.log 2024-03-04T10:48:20.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38564.log 2024-03-04T10:48:20.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51037.log 2024-03-04T10:48:20.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51317.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51443.log.gz 2024-03-04T10:48:20.524 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51317.log.gz 2024-03-04T10:48:20.524 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-03-04T10:48:20.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51037.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51037.log.gz 2024-03-04T10:48:20.525 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-03-04T10:48:20.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-03-04T10:48:20.526 INFO:teuthology.orchestra.run.smithi046.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-03-04T10:48:20.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.a.log: 57.1% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-03-04T10:48:20.527 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-03-04T10:48:20.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44414.log 2024-03-04T10:48:20.528 INFO:teuthology.orchestra.run.smithi046.stderr: 69.5% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-03-04T10:48:20.529 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.e.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-03-04T10:48:20.529 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2024-03-04T10:48:20.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50122.log 2024-03-04T10:48:20.530 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44414.log.gz 2024-03-04T10:48:20.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38737.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-04T10:48:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2024-03-04T10:48:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44630.log 2024-03-04T10:48:20.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-03-04T10:48:20.533 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50122.log.gz 2024-03-04T10:48:20.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-03-04T10:48:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38564.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38737.log.gz 2024-03-04T10:48:20.535 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44630.log.gz 2024-03-04T10:48:20.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44060.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-03-04T10:48:20.535 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2024-03-04T10:48:20.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2024-03-04T10:48:20.537 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-03-04T10:48:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43276.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2024-03-04T10:48:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45194.log 2024-03-04T10:48:20.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44456.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2024-03-04T10:48:20.539 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2024-03-04T10:48:20.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.45194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-03-04T10:48:20.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45194.log.gz 2024-03-04T10:48:20.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51401.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gzgzip 2024-03-04T10:48:20.541 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-03-04T10:48:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50995.log 2024-03-04T10:48:20.542 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-03-04T10:48:20.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-03-04T10:48:20.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.c.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38564.log.gz 2024-03-04T10:48:20.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50995.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-03-04T10:48:20.545 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44288.log 2024-03-04T10:48:20.545 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50995.log.gz 2024-03-04T10:48:20.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42042.log 2024-03-04T10:48:20.545 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-03-04T10:48:20.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-03-04T10:48:20.547 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44288.log.gz 2024-03-04T10:48:20.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2024-03-04T10:48:20.547 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42042.log.gz 2024-03-04T10:48:20.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-03-04T10:48:20.549 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-03-04T10:48:20.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42799.log 2024-03-04T10:48:20.550 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2024-03-04T10:48:20.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42493.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-03-04T10:48:20.551 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41897.log 2024-03-04T10:48:20.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51079.log 2024-03-04T10:48:20.552 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42799.log.gz 2024-03-04T10:48:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42586.log 2024-03-04T10:48:20.553 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz 2024-03-04T10:48:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2024-03-04T10:48:20.554 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51079.log.gz 2024-03-04T10:48:20.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50575.log 2024-03-04T10:48:20.555 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42586.log.gz 2024-03-04T10:48:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-03-04T10:48:20.556 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2024-03-04T10:48:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2024-03-04T10:48:20.557 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50575.log.gz 2024-03-04T10:48:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43050.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T10:48:20.558 INFO:teuthology.orchestra.run.smithi046.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-03-04T10:48:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37611.log 2024-03-04T10:48:20.560 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2024-03-04T10:48:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-03-04T10:48:20.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37611.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T10:48:20.562 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41663.log 2024-03-04T10:48:20.562 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.37611.log.gz 2024-03-04T10:48:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-03-04T10:48:20.564 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-03-04T10:48:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43412.log 2024-03-04T10:48:20.564 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41663.log.gz 2024-03-04T10:48:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44498.log 2024-03-04T10:48:20.565 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-03-04T10:48:20.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42715.log 2024-03-04T10:48:20.566 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43412.log.gz 2024-03-04T10:48:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2024-03-04T10:48:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42715.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.44498.log.gz 2024-03-04T10:48:20.568 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42715.log.gz 2024-03-04T10:48:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2024-03-04T10:48:20.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42084.log 2024-03-04T10:48:20.570 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2024-03-04T10:48:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2024-03-04T10:48:20.570 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2024-03-04T10:48:20.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42084.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42084.log.gz 2024-03-04T10:48:20.572 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.51235.log 2024-03-04T10:48:20.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50617.log 2024-03-04T10:48:20.573 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2024-03-04T10:48:20.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51235.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-04T10:48:20.574 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2024-03-04T10:48:20.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50617.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50617.log.gz 2024-03-04T10:48:20.575 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50743.log 2024-03-04T10:48:20.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42126.log 2024-03-04T10:48:20.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51163.log 2024-03-04T10:48:20.577 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50743.log.gz 2024-03-04T10:48:20.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42126.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42126.log.gz 2024-03-04T10:48:20.578 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2024-03-04T10:48:20.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2024-03-04T10:48:20.579 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51163.log.gz 2024-03-04T10:48:20.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41823.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2024-03-04T10:48:20.581 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42405.log 2024-03-04T10:48:20.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2024-03-04T10:48:20.582 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2024-03-04T10:48:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42405.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42405.log.gz 2024-03-04T10:48:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2024-03-04T10:48:20.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51528.log 2024-03-04T10:48:20.584 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz 2024-03-04T10:48:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2024-03-04T10:48:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2024-03-04T10:48:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2024-03-04T10:48:20.587 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51528.log.gz 2024-03-04T10:48:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50827.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2024-03-04T10:48:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 2024-03-04T10:48:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43060.log 2024-03-04T10:48:20.589 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2024-03-04T10:48:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42673.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz 2024-03-04T10:48:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43047.log 2024-03-04T10:48:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38044.log 2024-03-04T10:48:20.591 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43060.log.gz 2024-03-04T10:48:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43047.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43047.log.gz 2024-03-04T10:48:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50080.log 2024-03-04T10:48:20.593 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.38044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-03-04T10:48:20.594 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38044.log.gz 2024-03-04T10:48:20.594 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50080.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50080.log.gz 2024-03-04T10:48:20.594 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2024-03-04T10:48:20.595 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 2024-03-04T10:48:20.596 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-03-04T10:48:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44564.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-04T10:48:20.597 INFO:teuthology.orchestra.run.smithi046.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2024-03-04T10:48:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2024-03-04T10:48:20.598 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2024-03-04T10:48:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43301.log 2024-03-04T10:48:20.601 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2024-03-04T10:48:20.601 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2024-03-04T10:48:20.602 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43451.log 2024-03-04T10:48:20.602 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43301.log.gz 2024-03-04T10:48:20.603 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44864.log 2024-03-04T10:48:20.604 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2024-03-04T10:48:20.605 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42356.log 2024-03-04T10:48:20.605 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43451.log.gz 2024-03-04T10:48:20.607 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44864.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-03-04T10:48:20.607 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44864.log.gz 2024-03-04T10:48:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-03-04T10:48:20.608 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42356.log.gz 2024-03-04T10:48:20.609 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2024-03-04T10:48:20.611 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37895.log 2024-03-04T10:48:20.612 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42757.log: /var/log/ceph/ceph-client.admin.43064.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-03-04T10:48:20.612 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-04T10:48:20.612 INFO:teuthology.orchestra.run.smithi046.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2024-03-04T10:48:20.613 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42883.log 2024-03-04T10:48:20.614 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 2024-03-04T10:48:20.615 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50659.log 2024-03-04T10:48:20.616 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43365.log 2024-03-04T10:48:20.616 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42883.log.gz 2024-03-04T10:48:20.618 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44372.log 2024-03-04T10:48:20.618 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50659.log.gz 2024-03-04T10:48:20.619 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-03-04T10:48:20.619 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43365.log.gz 2024-03-04T10:48:20.620 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43597.log 2024-03-04T10:48:20.621 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44372.log.gz 2024-03-04T10:48:20.622 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51275.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-03-04T10:48:20.623 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.43597.log: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-04T10:48:20.623 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43597.log.gz 2024-03-04T10:48:20.624 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44102.log 2024-03-04T10:48:20.626 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42841.log 2024-03-04T10:48:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44102.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44102.log.gz 2024-03-04T10:48:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42841.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42841.log.gz 2024-03-04T10:48:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-03-04T10:48:20.631 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-03-04T10:48:20.632 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43758.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-03-04T10:48:20.633 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50038.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-03-04T10:48:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-03-04T10:48:20.635 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2024-03-04T10:48:20.637 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50323.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-03-04T10:48:20.638 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50491.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2024-03-04T10:48:20.639 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51359.log 2024-03-04T10:48:20.640 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50911.log 2024-03-04T10:48:20.642 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51359.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51359.log.gz 2024-03-04T10:48:20.643 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50911.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50911.log.gz 2024-03-04T10:48:20.644 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49996.log 2024-03-04T10:48:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2024-03-04T10:48:20.647 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49996.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49996.log.gz 2024-03-04T10:48:20.648 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44018.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2024-03-04T10:48:20.648 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42252.log 2024-03-04T10:48:20.650 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T10:48:20.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42252.log.gz 2024-03-04T10:48:20.654 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43657.log 2024-03-04T10:48:20.656 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43976.log 2024-03-04T10:48:20.659 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43657.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43657.log.gz 2024-03-04T10:48:20.659 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-04T10:48:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43976.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43976.log.gz 2024-03-04T10:48:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51485.log 2024-03-04T10:48:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-04T10:48:20.666 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51485.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43058.log 2024-03-04T10:48:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: 88.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T10:48:20.670 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51485.log.gz 2024-03-04T10:48:20.672 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2024-03-04T10:48:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43058.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43058.log.gz 2024-03-04T10:48:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2024-03-04T10:48:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43934.log 2024-03-04T10:48:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50953.log 2024-03-04T10:48:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43934.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43934.log.gz 2024-03-04T10:48:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42168.log 2024-03-04T10:48:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50953.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50953.log.gz 2024-03-04T10:48:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43850.log 2024-03-04T10:48:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42168.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42168.log.gz 2024-03-04T10:48:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43738.log 2024-03-04T10:48:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43850.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43850.log.gz 2024-03-04T10:48:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-03-04T10:48:20.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43738.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43738.log.gz 2024-03-04T10:48:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-04T10:48:20.698 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-03-04T10:48:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50182.log 2024-03-04T10:48:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-04T10:48:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50182.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50182.log.gz 2024-03-04T10:48:20.734 INFO:teuthology.orchestra.run.smithi046.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-04T10:48:20.751 INFO:teuthology.orchestra.run.smithi073.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-04T10:48:20.835 INFO:teuthology.orchestra.run.smithi073.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-03-04T10:48:20.868 INFO:teuthology.orchestra.run.smithi073.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-04T10:48:21.002 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-04T10:48:21.511 INFO:teuthology.orchestra.run.smithi073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-04T10:48:22.363 INFO:teuthology.orchestra.run.smithi073.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-04T10:48:22.609 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-04T10:48:23.158 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-04T10:48:23.741 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-04T10:48:23.780 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-04T10:48:23.892 INFO:teuthology.orchestra.run.smithi073.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-04T10:48:24.626 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-04T10:48:24.695 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-04T10:48:24.697 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-04T10:48:24.697 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m4.233s 2024-03-04T10:48:24.698 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m19.795s 2024-03-04T10:48:24.698 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.703s 2024-03-04T10:48:24.800 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-04T10:48:26.151 INFO:teuthology.orchestra.run.smithi046.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-04T10:48:26.226 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-04T10:49:23.804 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-03-04T10:49:23.807 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-03-04T10:49:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:real 1m3.342s 2024-03-04T10:49:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:user 1m19.199s 2024-03-04T10:49:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m5.877s 2024-03-04T10:49:23.809 INFO:tasks.ceph:Archiving logs... 2024-03-04T10:49:23.809 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/remote/smithi046/log 2024-03-04T10:49:23.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T10:49:36.243 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/remote/smithi073/log 2024-03-04T10:49:36.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T10:49:39.107 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-04T10:49:39.236 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-04T10:49:39.249 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-04T10:49:39.250 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-04T10:49:39.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T10:49:39.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T10:49:39.395 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-04T10:49:39.404 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-04T10:49:39.404 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T10:49:39.412 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T10:49:39.428 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-03-04T10:49:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T10:49:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-04T10:49:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +2792us[+2792us] +/- 114ms 2024-03-04T10:49:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 8 377 178 -1308us[-1295us] +/- 74ms 2024-03-04T10:49:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +585us[ +585us] +/- 88ms 2024-03-04T10:49:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T10:49:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-03-04T10:49:39.470 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T10:49:39.470 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-03-04T10:49:39.470 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +2595us[+2595us] +/- 114ms 2024-03-04T10:49:39.471 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 8 377 108 -1462us[-1359us] +/- 75ms 2024-03-04T10:49:39.471 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +386us[ +386us] +/- 88ms 2024-03-04T10:49:39.471 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T10:49:39.472 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-04T10:49:39.481 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-04T10:49:39.482 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-04T10:49:39.490 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T10:49:39.727 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T10:49:39.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T10:49:39.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T10:49:39.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T10:49:39.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T10:49:39.945 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-04T10:49:39.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-04T10:49:40.019 INFO:teuthology.task.internal:Duration was 8258.488897 seconds 2024-03-04T10:49:40.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-04T10:49:40.029 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-04T10:49:40.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T10:49:40.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T10:49:40.082 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T10:49:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T10:49:40.704 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-04T10:49:40.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-03-04T10:49:40.704 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T10:49:40.775 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-03-04T10:49:40.775 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T10:49:40.802 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-04T10:49:40.802 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T10:49:40.810 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T10:49:40.904 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-04T10:49:40.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T10:49:40.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T10:49:41.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-04T10:49:41.167 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-04T10:49:41.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T10:49:41.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T10:49:41.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-04T10:49:41.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T10:49:41.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T10:49:41.362 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-03-04T10:49:41.418 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-03-04T10:49:41.477 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T10:49:41.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T10:49:41.530 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T10:49:41.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T10:49:41.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-04T10:49:41.556 INFO:teuthology.task.internal:Transferring archived files... 2024-03-04T10:49:41.557 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/remote/smithi046 2024-03-04T10:49:41.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T10:49:41.675 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793/remote/smithi073 2024-03-04T10:49:41.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T10:49:41.713 INFO:teuthology.task.internal:Removing archive directory... 2024-03-04T10:49:41.713 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T10:49:41.721 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T10:49:41.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-04T10:49:41.787 INFO:teuthology.task.internal:Not uploading archives. 2024-03-04T10:49:41.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-04T10:49:41.799 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-04T10:49:41.799 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T10:49:41.805 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T10:49:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 10:49 /home/ubuntu/cephtest 2024-03-04T10:49:41.856 INFO:teuthology.orchestra.run.smithi046.stdout: 525017 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 10:49 /home/ubuntu/cephtest 2024-03-04T10:49:41.859 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-04T10:49:41.870 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-04T10:49:41.881 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-04T10:49:41.881 INFO:teuthology.nuke:Checking targets against current locks 2024-03-04T10:49:41.904 DEBUG:teuthology.nuke:shortname: smithi046 2024-03-04T10:49:41.904 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T10:49:41.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:22:41.871266', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLb7Z7EPVxMPYzF/6rWPNFS9DfiAeqlcl5Y1Q6EkJIe1yFjFj/+sf0mUP/7vvnFxPebkOnRqzY1AxeeEll4KJfE='} 2024-03-04T10:49:41.930 DEBUG:teuthology.nuke:shortname: smithi073 2024-03-04T10:49:41.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T10:49:41.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580793', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:22:41.873201', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrqS1ehcIsnNv6RY6quTF0fMMAA5EcU54XZW/hflhW5HB5E4ECzFDA0eaVoDl9UJDaYVa58vro8uy76Yy5sQ74='} 2024-03-04T10:49:41.969 INFO:teuthology.orchestra.console.smithi046:Power off 2024-03-04T10:49:41.969 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T10:49:41.990 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-03-04T10:49:41.990 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:42.006 INFO:teuthology.orchestra.console.smithi073:Power off 2024-03-04T10:49:42.007 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T10:49:42.015 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-04T10:49:42.028 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-03-04T10:49:42.028 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:42.065 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-04T10:49:46.016 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:46.066 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:46.127 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-04T10:49:46.177 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-04T10:49:50.128 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:50.178 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:50.239 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-03-04T10:49:50.288 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-04T10:49:50.341 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-03-04T10:49:54.290 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T10:49:54.399 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-03-04T10:49:54.500 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-03-04T10:49:54.604 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 786939134d7eee4dc7a805245d3f595929af37d7 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} duration: 8258.488897323608 failure_reason: 'valgrind error: Leak_PossiblyLost calloc __trans_list_add ' flavor: default owner: scheduled_leonidus@teuthology status: fail success: false 2024-03-04T10:49:54.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T10:49:54.688 INFO:teuthology.run:FAIL